Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Theoretical Computer Science

464 missions · 238 completed

The mathematical foundations of computation: which problems can be solved, by what algorithms, and at what cost in time, space, or communication. Distinguished by its emphasis on rigor and unconditional lower bounds, it spans computational complexity, algorithm design, automata and computability, cryptography, and the analysis of Boolean functions.

Missions

Open226Completed238All464
🏆Completed
Operations ResearchOptimization·Captain: mikedeng1

Assortment Optimisation Under a General Discrete Choice Model: A Tight Analysis of Revenue-Ordered Assortments II: Revenue-Ordered Assortments Earn OPT/(1 + ln ν), ν the Optimum's Purchase RatioResearch Paper

Motivation

A retailer that can display only some of its products must choose an assortment: the set of products offered to an arriving customer. Customers substitute: whether a given product is bought depends on what else is on the shelf. The assortment problem asks for the offer set that maximises expected revenue under a model of this substitution behaviour. It is a core problem of revenue management (Talluri and van Ryzin, Management Science 2004), and it is NP-hard already for a mixture of two multinomial logit models (Rusmevichientong, Shmoys, Tong and Topaloglu, POMS 2014).

The heuristic used most widely in practice is revenue-ordered assortments: sort the products by price and offer, for some threshold, every product priced at least that threshold. It is optimal under the multinomial logit model (Talluri and van Ryzin 2004) but not in general. Berbeglia and Joret (arXiv:1606.01371v3, 2019; Algorithmica 2020) give a tight analysis of its approximation ratio for every regular discrete choice model, a class that includes all random utility models. They prove three incomparable guarantees. This mission formalizes the third, Theorem 3.3, whose ratio depends on the purchase behaviour of an optimal assortment rather than on the prices. Companion missions in this series cover the price-ratio bound (Theorem 3.2) and the tightness of all three bounds (Theorem 3.4).

Setting

Let C\mathcal CC be a finite nonempty set of products. A system of choice probabilities gives, for every offer set S⊆CS\subseteq\mathcal CS⊆C and product xxx, the probability P(x,S)\mathcal P(x,S)P(x,S) that a customer offered SSS buys xxx. Buying nothing is the option 000, with P(0,S)=1−∑x∈SP(x,S)\mathcal P(0,S)=1-\sum_{x\in S}\mathcal P(x,S)P(0,S)=1−∑x∈S​P(x,S). The model is regular when

  1. P(x,S)≥0\mathcal P(x,S)\ge0P(x,S)≥0 for products and for x=0x=0x=0;
  2. P(x,S)=0\mathcal P(x,S)=0P(x,S)=0 for x∉Sx\notin Sx∈/S;
  3. ∑x∈SP(x,S)≤1\sum_{x\in S}\mathcal P(x,S)\le1∑x∈S​P(x,S)≤1;
  4. P(x,S)≥P(x,S′)\mathcal P(x,S)\ge\mathcal P(x,S')P(x,S)≥P(x,S′) whenever S⊆S′S\subseteq S'S⊆S′ and x∈S∪{0}x\in S\cup\{0\}x∈S∪{0}.

Axiom 4 at x=0x=0x=0 says that enlarging the offer set never makes buying nothing more likely.

Prices are a function r:C→R>0r:\mathcal C\to\mathbb R_{>0}r:C→R>0​. Offering SSS earns rev(S)=∑x∈SP(x,S) r(x)\mathrm{rev}(S)=\sum_{x\in S}\mathcal P(x,S)\,r(x)rev(S)=∑x∈S​P(x,S)r(x), and OPT=max⁡S⊆Crev(S)\mathrm{OPT}=\max_{S\subseteq\mathcal C}\mathrm{rev}(S)OPT=maxS⊆C​rev(S). Let r1<⋯<rkr_1<\dots<r_kr1​<⋯<rk​ be the distinct values of rrr, and let Si={x:r(x)≥ri}S_i=\{x:r(x)\ge r_i\}Si​={x:r(x)≥ri​} for i∈[k]i\in[k]i∈[k]. The revenue-ordered strategy earns

RO=max⁡1≤i≤krev(Si).\mathrm{RO}=\max_{1\le i\le k}\mathrm{rev}(S_i).RO=1≤i≤kmax​rev(Si​).

For an assortment S∗S^*S∗, the purchase profile is

Ni=∑x∈S∗, r(x)≥riP(x,S∗)(i∈[k]),Nk+1:=0,N_i=\sum_{x\in S^*,\ r(x)\ge r_i}\mathcal P(x,S^*)\qquad(i\in[k]),\qquad N_{k+1}:=0,Ni​=x∈S∗, r(x)≥ri​∑​P(x,S∗)(i∈[k]),Nk+1​:=0,

the probability that a customer offered S∗S^*S∗ buys something priced at least rir_iri​. It is non-increasing in iii.

Formalization targets

Goal: Theorem 3.3 (p. 9)

Let S∗S^*S∗ be optimal, rev(S∗)=OPT\mathrm{rev}(S^*)=\mathrm{OPT}rev(S∗)=OPT, suppose N1>0N_1>0N1​>0, and let ℓ∈[k]\ell\in[k]ℓ∈[k] be maximum with Nℓ>0N_\ell>0Nℓ​>0. Then

OPT≤(∑i=1ℓNi−Ni+1Ni)ROand∑i=1ℓNi−Ni+1Ni≤1+ln⁡ν,ν=N1Nℓ.\mathrm{OPT}\le\Big(\sum_{i=1}^{\ell}\frac{N_i-N_{i+1}}{N_i}\Big)\mathrm{RO} \qquad\text{and}\qquad \sum_{i=1}^{\ell}\frac{N_i-N_{i+1}}{N_i}\le1+\ln\nu,\quad\nu=\frac{N_1}{N_\ell}.OPT≤(i=1∑ℓ​Ni​Ni​−Ni+1​​)ROandi=1∑ℓ​Ni​Ni​−Ni+1​​≤1+lnν,ν=Nℓ​N1​​.

The first inequality is the paper's sum-form factor, the bound that Theorem 3.4 shows to be tight. The second is the closed form 1/(1+ln⁡ν)1/(1+\ln\nu)1/(1+lnν).

Milestones (in proof order)

  • Lemma 2.1 (p. 6): ∑x∈SP(x,S)≤∑x∈S′P(x,S′)\sum_{x\in S}\mathcal P(x,S)\le\sum_{x\in S'}\mathcal P(x,S')∑x∈S​P(x,S)≤∑x∈S′​P(x,S′) for S⊆S′S\subseteq S'S⊆S′.
  • First observation of the proof (p. 9): Ni≤∑x∈SiP(x,Si)N_i\le\sum_{x\in S_i}\mathcal P(x,S_i)Ni​≤∑x∈Si​​P(x,Si​) and Niri≤∑x∈SiP(x,Si)riN_ir_i\le\sum_{x\in S_i}\mathcal P(x,S_i)r_iNi​ri​≤∑x∈Si​​P(x,Si​)ri​.
  • Inequality (6) (p. 9): Niri≤RON_ir_i\le\mathrm{RO}Ni​ri​≤RO for every i∈[k]i\in[k]i∈[k].
  • Revenue identity (p. 9): rev(S∗)=∑i=1ℓ(Ni−Ni+1)ri=∑i=1ℓNi−Ni+1NiNiri\mathrm{rev}(S^*)=\sum_{i=1}^{\ell}(N_i-N_{i+1})r_i=\sum_{i=1}^{\ell}\frac{N_i-N_{i+1}}{N_i}N_ir_irev(S∗)=∑i=1ℓ​(Ni​−Ni+1​)ri​=∑i=1ℓ​Ni​Ni​−Ni+1​​Ni​ri​.
  • Logarithmic step (p. 9, the comparison 1/∑≥1/(1+ln⁡ν)1/\sum\ge1/(1+\ln\nu)1/∑≥1/(1+lnν) in Theorem 3.3, used in the last inequality of the proof): for N1≥⋯≥Nℓ>0N_1\ge\dots\ge N_\ell>0N1​≥⋯≥Nℓ​>0 and Nℓ+1=0N_{\ell+1}=0Nℓ+1​=0, ∑i=1ℓ(Ni−Ni+1)/Ni≤1+ln⁡(N1/Nℓ)\sum_{i=1}^{\ell}(N_i-N_{i+1})/N_i\le1+\ln(N_1/N_\ell)∑i=1ℓ​(Ni​−Ni+1​)/Ni​≤1+ln(N1​/Nℓ​). The paper states this step without proof.

Significance

Theorem 3.3 gives a guarantee that is independent of prices. The bound 1+ln⁡(rk/r1)1+\ln(r_k/r_1)1+ln(rk​/r1​) of Theorem 3.2 grows when prices are spread out. The bound 1+ln⁡ν1+\ln\nu1+lnν is small whenever an optimal assortment sells its expensive products with probability comparable to its overall purchase probability. In §4 the paper combines it with a reduction from unit-demand pricing to derive, for example, the 1/(1+ln⁡m)1/(1+\ln m)1/(1+lnm) guarantee of uniform pricing for the unit-demand min-pricing problem (Corollary 4.8, originally due to Aggarwal et al.). Together with Theorems 3.1 and 3.2, it describes the performance of the most common assortment heuristic over the whole class of regular models, with no parametric assumption on customer behaviour.

The theorem is proved on paper. To our knowledge it has no machine-checked proof, and no regular choice model has been formalized on the platform. This mission produces the regular model as a reusable definition, a statement of Theorem 3.3 in which every hypothesis is explicit, and formal versions of the proof's identities and inequalities. The logarithmic step is asserted without proof in the source, so a formal proof of it completes the paper's argument.

Difficulty

Each step is elementary. The difficulty is bookkeeping. The revenue of S∗S^*S∗ has to be regrouped by distinct price levels rather than by products: several products may share a price, and kkk counts values. The regrouping uses an Abel-type rearrangement with the boundary convention Nk+1=0N_{k+1}=0Nk+1​=0. Comparing NiN_iNi​ with the purchase probability of SiS_iSi​ needs regularity twice. First, axiom 4 for products passes from S∗S^*S∗ to S∗∩SiS^*\cap S_iS∗∩Si​. Then the no-purchase case passes from S∗∩SiS^*\cap S_iS∗∩Si​ to SiS_iSi​. A proof that uses axiom 4 only for products fails at the second step, and the claim is false without it.

Formalization scope

  • Products form a finite type C with [Fintype C] [DecidableEq C]. The goal adds [Nonempty C], the paper's k≥1k\ge1k≥1. Offer sets are Finset C, and P\mathcal PP is P : C → Finset C → ℝ. The no-purchase option is not a product: P(0,S)\mathcal P(0,S)P(0,S) is the derived quantity noPurchase P S. IsRegular P carries axioms 1–4, including both no-purchase cases.
  • OPT\mathrm{OPT}OPT is Finset.sup' over all subsets. RO\mathrm{RO}RO is Finset.sup' over the indices 1,…,k1,\dots,k1,…,k of the threshold sets only.
  • Indices are 1-based natural numbers. level r i is rir_iri​ for 1≤i≤k1\le i\le k1≤i≤k. purchaseProfile P r S i is NiN_iNi​ for 1≤i≤k1\le i\le k1≤i≤k and 000 otherwise, which builds in Nk+1=0N_{k+1}=0Nk+1​=0.
  • Optimality is the hypothesis rev(S∗)=OPT\mathrm{rev}(S^*)=\mathrm{OPT}rev(S∗)=OPT. The index ℓ\ellℓ is a variable with hypotheses 1≤ℓ≤k1\le\ell\le k1≤ℓ≤k, Nℓ>0N_\ell>0Nℓ​>0, and Ni≯0N_i\not>0Ni​>0 for ℓ<i≤k\ell<i\le kℓ<i≤k. N1>0N_1>0N1​>0 is kept as in the paper.
  • The approximation factor is stated in product form, OPT≤D⋅RO\mathrm{OPT}\le D\cdot\mathrm{RO}OPT≤D⋅RO, never as a ratio. Both the sum form and the logarithmic form are stated. ln⁡\lnln is Real.log, applied to ν≥1\nu\ge1ν≥1.
  • The milestones other than the goal are stated for an arbitrary S∗S^*S∗, because the proof does not use optimality there.

The following statements are trivial or false and are not this mission: a maximum over all subsets in place of RO\mathrm{RO}RO; regularity without its no-purchase case; a purchase profile taken from a non-optimal set while rev(S∗)\mathrm{rev}(S^*)rev(S∗) is still called the optimum; the logarithmic form alone; a specific choice model (MNL, Markov chain) in place of an arbitrary regular P\mathcal PP.

A complete development needs finite sums regrouped by the values of a function and an elementary logarithm inequality. The regular choice model and the revenue-ordered sets are shared with the other missions of this series and are reusable for any analysis of assortment heuristics. Proofs of any milestone are welcome. So are alternative arguments for the logarithmic step and a proof that NNN is non-increasing.

Selected references

  • G. Berbeglia and G. Joret, Assortment Optimisation Under a General Discrete Choice Model: A Tight Analysis of Revenue-Ordered Assortments, arXiv:1606.01371v3, 2019; Algorithmica 82, 2020. https://arxiv.org/abs/1606.01371v3
  • K. Talluri and G. van Ryzin, Revenue Management Under a General Discrete Choice Model of Consumer Behavior, Management Science 50(1), 2004. https://doi.org/10.1287/mnsc.1030.0147
  • P. Rusmevichientong, D. Shmoys, C. Tong and H. Topaloglu, Assortment Optimization under the Multinomial Logit Model with Random Choice Parameters, Production and Operations Management 23(11), 2014. https://doi.org/10.1111/poms.12191
9 thms2 active usersReviewed
🏆Completed
Formal Verification·Captain: mikedeng1

Consensus in the Presence of Partial Synchrony II: With Synchronous Processors, Partially Synchronous Communication and t Fail-Stop Faults, No Consensus Protocol Exists When 2 ≤ N ≤ 2tResearch Paper

Motivation

Consensus asks NNN processors, each holding an initial value, to agree on one value despite some of them failing. It underlies replicated databases, atomic commit and state-machine replication. Its solvability depends on the timing assumptions. With fully synchronous processors and communication, ttt fail-stop faults can be tolerated for any t<Nt < Nt<N. With fully asynchronous communication, Fischer, Lynch and Paterson showed that no deterministic protocol tolerates even one fail-stop fault (JACM 1985).

Dwork, Lynch and Stockmeyer (JACM 1988) introduced partial synchrony, a model between these two extremes. Message delays have an upper bound Δ\DeltaΔ, but either the bound is unknown to the protocol, or it holds only from an unknown time on. For each fault type they found the exact number of faults that can be tolerated. This mission formalizes the lower bound for fail-stop faults: when the processors are synchronous and communication is partially synchronous, no consensus protocol tolerates ttt faults once N≤2tN \le 2tN≤2t.

Timeline. 1985: Fischer, Lynch, Paterson, impossibility of consensus with one fail-stop fault under asynchrony. 1987: Dolev, Dwork, Stockmeyer, which combinations of synchrony assumptions admit consensus (JACM 1987). 1988: Dwork, Lynch, Stockmeyer, partial synchrony, with matching upper and lower bounds on resiliency for fail-stop, omission, authenticated Byzantine and Byzantine faults. The global stabilization time of the 1988 paper became a common liveness assumption for later fault-tolerant agreement protocols.

Setting

There are NNN processors p1,…,pNp_1, \dots, p_Np1​,…,pN​. Each processor holds an initial value vi∈{0,1}v_i \in \{0, 1\}vi​∈{0,1}. Each runs a deterministic protocol: a transition diagram over a possibly infinite set of states. In each state the next instruction is either Send(m,pj)\mathrm{Send}(m, p_j)Send(m,pj​), which puts message mmm in pjp_jpj​'s buffer, or Receive(pi)\mathrm{Receive}(p_i)Receive(pi​), which removes a set SSS of messages from pip_ipi​'s buffer and delivers it. The next state depends on the current state and, for a Receive, on SSS. A step never both sends and receives. Each state may record a decision, and the first decision a processor records is final.

Real time is the ticks 1,2,3,…1, 2, 3, \dots1,2,3,…. A run fixes the initial values and, at each tick, which processors take a step and which messages each Receive delivers. A message is delivered only after the tick at which it was sent, only to its addressee, and at most once.

  • Synchronous processors (Φ=1\Phi = 1Φ=1): every correct processor takes a step at every tick.
  • Fail-stop faults: a faulty processor follows the protocol until it stops, and it never restarts. A processor that stops at time 000 is initially dead.
  • Δ\DeltaΔ holds in [T,∞)[T, \infty)[T,∞): a message sent at a tick s1≥Ts_1 \ge Ts1​≥T is delivered no later than any Receive of its addressee at a tick s2≥s1+Δs_2 \ge s_1 + \Deltas2​≥s1​+Δ.
  • Delta holds eventually: Δ\DeltaΔ is a fixed positive integer known to the protocol. In every run, Δ\DeltaΔ holds in [T,∞)[T, \infty)[T,∞) for some unknown global stabilization time TTT. Messages sent before TTT may be delayed arbitrarily or lost.
  • Delta is unknown: the protocol is fixed first. In every run, some positive Δ\DeltaΔ holds in [1,∞)[1, \infty)[1,∞).

A protocol is a ttt-resilient consensus protocol achieving weak unanimity if the following holds for every set CCC of at least N−tN - tN−t processors and every allowed run in which the processors of CCC are correct and the others fail-stop. No two processors of CCC decide differently (consistency). Every processor of CCC decides (termination). If all initial values are vvv and no processor is faulty, every decision is vvv (weak unanimity).

Formalization targets

Goal: Theorem 4.3

For integers t≤Nt \le Nt≤N with

2≤N≤2t,2 \le N \le 2t,2≤N≤2t,

there is no ttt-resilient consensus protocol achieving weak unanimity for binary values with fail-stop faults and synchronous processors. This holds for every positive Δ\DeltaΔ when Δ\DeltaΔ holds eventually, and when delta is unknown.

Milestones: the three scenarios of the proof

Split the processors into groups PPP and QQQ with 1≤∣P∣,∣Q∣≤t1 \le |P|, |Q| \le t1≤∣P∣,∣Q∣≤t.

  • Scenario A: all inputs 000 and QQQ initially dead. The processors of PPP decide by some time TAT_ATA​, and they decide 000.
  • Scenario B: all inputs 111 and PPP initially dead. The processors of QQQ decide 111 by some time TBT_BTB​.
  • Scenario C: all processors alive, PPP starting with 000 and QQQ with 111, and messages between the groups held back past a time TTT. Up to time TTT, every processor of PPP is in the same state as in Scenario A, and every processor of QQQ in the same state as in Scenario B.

Significance

The result. Theorem 4.3 shows that the resiliency N≥2t+1N \ge 2t + 1N≥2t+1 of the paper's fail-stop and omission protocols (Theorems 4.1 and 4.2) is optimal. It holds even under three restrictions: binary values, weak unanimity, and processors in perfect lock-step. Partial synchrony costs a majority of correct processors, whereas full synchrony costs nothing. The same scenarios give the authenticated Byzantine bound N≥3t+1N \ge 3t + 1N≥3t+1 (Theorem 4.4). The halting remark of Section 4.2 rests on an argument of the same kind.

The formalization. The theorem is proved in the paper, and its proof is short. It is not machine-checked anywhere known to the mission. No message-passing model is on the platform. This mission supplies one: a step-level model with buffers, per-message timing, fail-stop faults and both partially synchronous communication models. It also gives a machine-checked impossibility on top of that model. FLP, Theorem 4.4 and the lower bounds of Section 6 are natural follow-ups on the same definitions.

Difficulty

The informal proof is an indistinguishability argument. Making it formal means comparing different runs of the same deterministic protocol. Two points need care.

First, the scenarios must be allowed runs. Scenario C holds messages between the groups back past max⁡(TA,TB)\max(T_A, T_B)max(TA​,TB​). With delta unknown, this needs a Δ\DeltaΔ larger than that delay. When Δ\DeltaΔ holds eventually, Δ\DeltaΔ is fixed before the protocol, and the protocol fixes TAT_ATA​ and TBT_BTB​. So the delay is legal only for messages sent before the global stabilization time, which must therefore be placed after max⁡(TA,TB)\max(T_A, T_B)max(TA​,TB​). Read literally, "every message between the groups takes more than max⁡(TA,TB)\max(T_A, T_B)max(TA​,TB​) steps" is not an allowed run in this model.

Second, "the processors of PPP act exactly as they do in Scenario A" is a claim about whole runs. Two runs must agree on states, on which messages are in which buffer, and on when each message is delivered, tick by tick up to TTT. With one-to-one sends and atomic steps, "delivered in exactly time 1" also needs a reading: a processor that sends at the next tick cannot receive at that tick.

Formalization scope

All declarations live in the namespace DLSConsensus.LowerBound. Processor pip_ipi​ is the index i−1i - 1i−1 of Fin N. Values are Bool. The protocol's state type and message type are arbitrary types in Type, finite or infinite. R.state i n is the state after tick nnn. A message instance is identified in the run by its sender and send tick. A Receive hands the protocol each delivered message as (sender, content); the absolute send tick is not exposed.

Explicit readings and conventions:

  • "Fail-stop or omission faults": the goal is the fail-stop impossibility. It implies the omission case, because a fail-stop processor looks to the others like one whose sends are all omitted. The omission case is not a separate item.
  • A fail-stop processor may skip ticks before its final stop. The processor timing bound Φ=1\Phi = 1Φ=1 applies to correct processors.
  • "Decides": the first state that records a decision. Irreversibility therefore holds by definition.
  • "Delivered in exactly time 1": the message is delivered no later than the addressee's first Receive at least one tick after the send.
  • "Within time TAT_ATA​" and "for some finite TBT_BTB​": an explicit ∃\exists∃ before the decision bound.
  • "Messages between the groups take more than max⁡(TA,TB)\max(T_A, T_B)max(TA​,TB​) steps": no message between the groups is delivered at a tick ≤T\le T≤T, for any given TTT.
  • "Act exactly as they do": equal local states at every tick n≤Tn \le Tn≤T.
  • Quantifier order: when Δ\DeltaΔ holds eventually, Δ\DeltaΔ is chosen first, then the protocol, then the run with its stabilization time. When delta is unknown, the protocol is chosen first and each run carries its own Δ\DeltaΔ. In both models Δ>0\Delta > 0Δ>0.

Trivializing formalizations are ruled out. The model has allowed runs for every protocol, so Resilient is never vacuously true. Correct processors step at every tick, so termination does not fail for the wrong reason. Unanimity is the weak form, applied only when no processor is faulty.

Contributions welcome: a general simulation lemma (equal inputs up to a tick give equal states up to that tick), the construction of runs from a delivery schedule, and proofs of the scenarios. These parts are reusable for the other lower bounds of the paper.

Selected references

  • C. Dwork, N. Lynch, L. Stockmeyer, Consensus in the presence of partial synchrony, Journal of the ACM 35(2), 1988, 288–323. https://doi.org/10.1145/42282.42283
  • M. J. Fischer, N. A. Lynch, M. S. Paterson, Impossibility of distributed consensus with one faulty process, Journal of the ACM 32(2), 1985, 374–382. https://doi.org/10.1145/3149.214121
  • D. Dolev, C. Dwork, L. Stockmeyer, On the minimal synchronism needed for distributed consensus, Journal of the ACM 34(1), 1987, 77–97. https://doi.org/10.1145/7531.7533
5 thms2 active usersReviewed
🏆Completed
CombinatoricsOperations ResearchProbability·Captain: mikedeng1

Online Stochastic Matching: Beating 1-1/e 2: The Suggested Matching Algorithm Achieves 1 − 1/e with High Probability, and This Is Tight Even in ExpectationResearch Paper

Motivation

Online bipartite matching models decisions that must be made as requests arrive: an advertiser can be assigned to a compatible request once, and an assignment cannot be revised when later requests reveal a better alternative. Display advertising is the motivating example in Feldman, Mehta, Mirrokni, and Muthukrishnan's 2009 preprint: an ad server knows which advertisers accept each kind of impression and has estimates of how frequently those kinds will arrive. The question is how much this advance distributional information helps when decisions still have to be immediate.

This mission studies the paper's first offline-guided algorithm. It computes a maximum matching for the expected traffic and follows that matching during the actual random run. The paper shows that this natural policy reaches the familiar 1−1/e1-1/e1−1/e performance level and that its own analysis cannot be improved for this policy, even if performance is averaged over runs. The result sets the baseline for the paper's later two-suggested-matchings algorithm, which improves on that level under its stated assumptions. Feldman et al., §§1 and 4.1

Setting

An instance consists of a finite advertiser set AAA, a finite impression-type set III, and allowed edges E⊆A×IE\subseteq A\times IE⊆A×I. For each type iii, the nonnegative integer eie_iei​ is its expected number of arrivals. There are n=∑i∈Iei>0n=\sum_{i\in I}e_i>0n=∑i∈I​ei​>0 arrivals. Each arrival independently has type iii with probability ei/ne_i/nei​/n. A type with ei=0e_i=0ei​=0 remains in the graph but has zero arrival probability. On an arrival of type iii, an online algorithm may assign it to an adjacent advertiser that has not been assigned before, or may leave it unassigned. The hindsight optimum, OPT(ω)\mathrm{OPT}(\omega)OPT(ω), is the largest matching in the realization graph with one vertex for every arrival position, including separate vertices for repeated types. Feldman et al., §2, pp. 3–4

The suggested matching algorithm first selects any maximum integral flow in the expected-instance network. Each advertiser has capacity one, and each type iii has capacity eie_iei​. Equivalently, the selected edges form a maximum degree-capped bipartite matching M⊆EM\subseteq EM⊆E. Let A∗A^*A∗ be the advertisers covered by MMM. When type iii arrives, the algorithm chooses each advertiser joined to iii by a selected edge with probability 1/ei1/e_i1/ei​; any remaining probability chooses no advertiser. It assigns the chosen advertiser if available and otherwise makes no assignment. Its number of assignments is ALG(ω)\mathrm{ALG}(\omega)ALG(ω). This rule includes the algorithm's random choice in addition to the random arrival types. Feldman et al., §4.1, p. 5

The canonical residual cut of MMM places each advertiser and impression type on the source side if it is reachable from the source by residual edges. Write ATA_TAT​ for advertisers on the sink side and ISI_SIS​ for types on the source side. These sets describe the comparison between the expected-instance matching and the optimum of a realized run. The mission also uses occupancy: after nnn independent uniform throws into nnn bins, count how many bins in a fixed subset receive at least one ball. Feldman et al., §§2.1 and 4.1

Formalization targets

Theorem 4's general-instance guarantee is expressed in the additive form established by its analysis. For every ε>0\varepsilon>0ε>0, there are δ>0\delta>0δ>0 and NNN, uniform across all finite instances, all maximum integral flows, and all valid ways of realizing the algorithm's random choice, such that n≥Nn\ge Nn≥N implies

Pr⁡ ⁣[ALG(ω)≥(1−e−1)OPT(ω)−εn]≥1−e−δn.\Pr\!\left[\mathrm{ALG}(\omega)\ge(1-e^{-1})\mathrm{OPT}(\omega)-\varepsilon n\right] \ge 1-e^{-\delta n}.Pr[ALG(ω)≥(1−e−1)OPT(ω)−εn]≥1−e−δn.

The complete bipartite family gives the tightness target. When A=I={0,…,n−1}A=I=\{0,\ldots,n-1\}A=I={0,…,n−1} and every ei=1e_i=1ei​=1, every maximum expected-instance matching is perfect. For every run, OPT=n\mathrm{OPT}=nOPT=n, and

E[ALG]=n(1−(1−1n)n),lim⁡n→∞E[ALG]n=1−e−1.\mathbb E[\mathrm{ALG}] =n\left(1-\left(1-\frac1n\right)^n\right), \qquad \lim_{n\to\infty}\frac{\mathbb E[\mathrm{ALG}]}{n}=1-e^{-1}.E[ALG]=n(1−(1−n1​)n),n→∞lim​nE[ALG]​=1−e−1.

The milestone list follows the paper's Fact 1 and the named passages “Bounding ALG,” “Bounding OPT,” and “Tightness of the Analysis” in §4.1. The cut identity ∣A∗∣=∣AT∣+∑i∈ISei|A^*|=|A_T|+\sum_{i\in I_S}e_i∣A∗∣=∣AT​∣+∑i∈IS​​ei​ is a separate deterministic milestone. Feldman et al., Theorem 4 and §4.1, pp. 5–6

Significance

The result establishes exactly what this one-matching policy achieves under integer-frequency independent arrivals. It gives a guarantee for the actual number of assignments relative to the best assignment made with hindsight, and a family on which the limiting expected ratio equals the guarantee. That tight family explains why the paper introduces a second suggested matching rather than seeking a stronger bound for the same policy. Feldman et al., §4

The mathematical theorem is proved in the paper; the mission asks for its machine-checked formalization. The development would also provide reusable finite models of repeated-type realizations, integral degree-capped bipartite matchings, uniform occupancy, and residual reachability cuts. No machine-checked proof of these mission items is being claimed by this draft.

Difficulty

The expected-instance matching is selected before the arrivals, but the hindsight optimum can exploit the actual multiplicities of every type. Counting only the ads selected online does not compare the algorithm with that hindsight optimum. Also, a type may have several selected advertisers when ei>1e_i>1ei​>1, so replacing the algorithm's random choice by a deterministic designated ad would change its law. The cut and concentration statements have to apply uniformly to every maximum integral flow, including flows chosen by different tie-breaking rules. Feldman et al., §4.1, pp. 5–6

Formalization scope

Advertisers and types are finite Lean types. The edge relation is a finite set, and eie_iei​ and nnn are natural numbers with n=∑iei>0n=\sum_i e_i>0n=∑i​ei​>0. An integral maximum flow is represented by a maximum cardinality edge set with advertiser degree at most one and type-iii degree at most eie_iei​. The theorem quantifies over every such set. This is the unit-advertiser, integer-type-capacity flow used in §4.1, without a separate real-valued flow object. The canonical cut is defined through residual reachability. The hindsight optimum maximizes over matchings of the realized graph, with each arrival position distinct.

The run uses nnn independent uniform draws from ∑i{0,…,ei−1}\sum_i\{0,\ldots,e_i-1\}∑i​{0,…,ei​−1}. A valid labelling assigns each selected advertiser at type iii to a distinct copy. The drawn copy determines the type and, if labelled, the ad selected by the algorithm. This gives type probability ei/ne_i/nei​/n, conditional ad probability 1/ei1/e_i1/ei​ on selected edges, and the remaining “no ad” probability. Counts, probabilities, and expectations use finite sums, so there is no integrability convention. Since n>0n>0n>0, the run sample space is nonempty; no value of ALG/OPT\mathrm{ALG}/\mathrm{OPT}ALG/OPT at OPT=0\mathrm{OPT}=0OPT=0 is needed. The complete-graph family has n≥1n\ge1n≥1.

The paper writes 1−e−Ω(n)1-e^{-\Omega(n)}1−e−Ω(n) in both bounding passages. The Lean statements spell this out as ∀ε>0, ∃δ>0, ∃N, ∀\forall\varepsilon>0,\ \exists\delta>0,\ \exists N,\ \forall∀ε>0, ∃δ>0, ∃N, ∀ instances with n≥Nn\ge Nn≥N, with δ,N\delta,Nδ,N preceding the instance. Theorem 4's ratio language is represented by the additive estimate its proof yields; a vanishing ratio error requires a separate lower bound on OPT/n\mathrm{OPT}/nOPT/n. The exact finite-nnn expectation and its limit make “tight, even in expectation” precise. The printed Fact 1 exponent is εn/2\varepsilon n/2εn/2, while its Appendix A proof yields ε2n/2\varepsilon^2n/2ε2n/2; the formalized concentration statement uses the proved exponent and the milestone retains the printed wording. Neither a ratio with a zero denominator nor a labelling that changes the algorithm's choice law is accepted as a shortcut.

Contributions toward the occupancy bound, the residual cut identity, the realized matching bound, and the complete-graph expectation are welcome. The finite occupancy and matching interfaces are intended for reuse beyond this specific algorithm.

Selected references

  • Jon Feldman, Aranyak Mehta, Vahab Mirrokni, and S. Muthukrishnan, Online Stochastic Matching: Beating 1-1/e, arXiv:0905.4100v1, 2009; FOCS 2009. Preprint
10 thms2 active usersReviewed
🏆Completed
Formal Verification·Captain: mikedeng1

Consensus in the Presence of Partial Synchrony I: For N ≥ 2t + 1, Algorithm 1 Achieves Consistency, Strong Unanimity and Termination in the Basic Round Model with Fail-Stop or Omission FaultsResearch Paper

Motivation

Consensus asks NNN processors, each starting with a value, to agree on one value although some of them may be faulty. It underlies replicated databases, atomic commitment and state-machine replication. Two classical models bracket the problem. In a fully synchronous system, with known bounds on message delay and processor speed, consensus is solvable for many fault types. In a fully asynchronous system, Fischer, Lynch and Paterson showed in 1985 that no deterministic protocol tolerates even one fail-stop fault (FLP, J. ACM 1985).

Dwork, Lynch and Stockmeyer (J. ACM 35(2), 1988, 288–323) introduced partial synchrony between these extremes: message delays are bounded, but either the bound is unknown, or it holds only from an unknown global stabilization time (GST) on. This model, and the GST abstraction in particular, became the standard assumption under which practical consensus protocols (Paxos-style and Byzantine fault-tolerant replication) are proved live. The paper determines, for each fault type, the largest number ttt of faults that consensus can tolerate under partial synchrony. This mission formalizes its first positive result: for fail-stop and omission faults, N≥2t+1N \ge 2t+1N≥2t+1 processors suffice.

Setting

There are NNN processors p1,…,pNp_1,\dots,p_Np1​,…,pN​, an integer t≤Nt \le Nt≤N, and an arbitrary set VVV of values; processor pip_ipi​ starts with init(pi)∈V\mathrm{init}(p_i)\in Vinit(pi​)∈V.

In the basic round model (Section 3.1 of the paper), computation proceeds in rounds r=1,2,3,…r = 1, 2, 3, \dotsr=1,2,3,…. In each round every processor sends messages, each message is either delivered in that round or lost, and every processor then performs a state transition on the messages it received. Losses are described by a predicate deliv(r,q,p)\mathrm{deliv}(r,q,p)deliv(r,q,p). A set CCC of processors (the correct ones) and a round GST\mathrm{GST}GST constrain it: every message sent at a round r≥GSTr \ge \mathrm{GST}r≥GST from a processor of CCC to a processor of CCC is delivered. Before GST any message may be lost, and messages from or to processors outside CCC may be lost at any time. Processors outside CCC follow the protocol but lose sends and receptions (omission faults, which include fail-stop faults).

Algorithm 1 (Section 3.2.1) works as follows. Every processor keeps a set PROPER\mathrm{PROPER}PROPER, initially {init(p)}\{\mathrm{init}(p)\}{init(p)}, attaches it to every message, and merges in every PROPER set it receives. A processor may hold locks, each a value with an associated phase number; vvv is acceptable to ppp if ppp has no lock on a value other than vvv. Phase k≥1k \ge 1k≥1 belongs to pip_ipi​ when k≡i(modN)k \equiv i \pmod Nk≡i(modN). Trying phase kkk occupies rounds 4k−34k-34k−3, 4k−24k-24k−2, 4k−14k-14k−1:

  1. every processor sends the owner the list of its acceptable values that are in its PROPER set; the owner proposes, by an arbitrary choice, a value appearing in at least N−tN-tN−t of the lists received, if there is one;
  2. the owner broadcasts (lock v,k)(\mathrm{lock}\ v, k)(lock v,k); each receiver locks vvv with phase kkk;
  3. each receiver acknowledges; with at least t+1t+1t+1 acknowledgements the owner decides vvv.

Lock-release phase kkk is round 4k4k4k: every processor broadcasts its locks (v,h)(v,h)(v,h), and a lock on vvv with phase hhh is released on receipt of some (w,h′)(w,h')(w,h′) with w≠vw \ne vw=v and h′≥hh' \ge hh′≥h.

The correctness conditions (Section 2.4) for the set CCC are consistency (no two decisions of processors in CCC differ), termination (every processor in CCC decides), and strong unanimity (if all NNN initial values equal vvv, every decision in CCC is vvv).

Formalization targets

Goal: Theorem 3.1

For all N,tN, tN,t with N≥2t+1N \ge 2t+1N≥2t+1, every value type VVV, all initial values, every CCC with ∣C∣≥N−t|C| \ge N-t∣C∣≥N−t, every GST\mathrm{GST}GST, every delivery pattern allowed for CCC and GST\mathrm{GST}GST, and every admissible choice of proposals,

Algorithm 1 achievesConsistency(C) ∧ StrongUnanimity(C) ∧ Termination(C).\text{Algorithm 1 achieves}\quad \text{Consistency}(C)\ \wedge\ \text{StrongUnanimity}(C)\ \wedge\ \text{Termination}(C).Algorithm 1 achievesConsistency(C) ∧ StrongUnanimity(C) ∧ Termination(C).

This is the theorem as printed; it fixes no constants.

Milestones

  • Lemma 3.1: no two distinct values acquire locks with the same associated phase.
  • Lemma 3.2: if vvv is decided at the first phase kkk at which any decision is made, then at least t+1t+1t+1 processors lock vvv at phase kkk, and each keeps, from then on, a lock on vvv with phase at least kkk.
  • Lemma 3.3: immediately after a lock-release round 4k≥GST4k \ge \mathrm{GST}4k≥GST, the processors of CCC together hold locks on at most one value.
  • Round bound (Section 3.2.1, p. 298): every processor of CCC decides at some phase kkk with
4k−1≤GST+4(N+1).4k-1 \le \mathrm{GST} + 4(N+1).4k−1≤GST+4(N+1).

Significance

Theorem 3.1 shows that, against omission and fail-stop faults, partially synchronous communication costs nothing in resilience compared with a majority bound: N≥2t+1N \ge 2t+1N≥2t+1 suffices, and Section 4 of the paper shows that N≤2tN \le 2tN≤2t does not. The lock-and-release structure of Algorithm 1 (a value is decided only after a quorum locks it, and locks are released only on evidence of a later competing lock) recurs in later partially synchronous protocols, where safety must hold regardless of timing and liveness is obtained only after stabilization. The result separates the two concerns cleanly: consistency and strong unanimity hold in every run, while termination uses GST.

The result is proved in the paper; to the best of the available information it has not been formalized in Lean, and no distributed-computing model exists on Prove2Me. The mission produces a machine-checked model of the basic round model with a GST delivery guarantee, a full executable specification of Algorithm 1, and proofs of its safety and liveness. The paper's own proof of Lemma 3.3 is one line and the termination argument relies on "sufficient communication"; a formal proof must make these steps explicit.

Difficulty

The safety argument is an invariant over an unbounded number of phases with an arbitrary loss pattern: a lock on the decided value must be shown never to be released without being replaced by a higher lock on the same value, while competing locks on other values may exist at faulty or slow processors. The obvious argument ("after a decision, every later proposal must equal the decided value") is circular without a persistence statement for locks such as Lemma 3.2. Liveness requires reasoning about what every correct processor knows after GST (its PROPER set and the locks of the others), and it depends on processors sending lock-release and list messages even when these carry no locks or no acceptable values. Quorum counting with N−tN-tN−t and t+1t+1t+1 must be carried out over distinct senders.

Formalization scope

  • Processors are Fin N; the paper's pip_ipi​ is the processor of index i−1i-1i−1. Rounds start at 111; exec … 0 is the initial state and exec … r the state after round rrr. Phases start at 111.
  • The paper's "chooses one arbitrarily" is a parameter pick : ℕ → Set V → V, required only to pick an element of every nonempty candidate set, and universally quantified in every theorem.
  • The paper's "the behavior of the processors not in CCC is allowed by the fault type FFF" is read as: processors outside CCC run Algorithm 1, and any message from or to them may be lost (omission faults, containing fail-stop).
  • The GST guarantee covers a processor's messages to itself when it is in CCC; before GST self-messages may be lost like any other.
  • Every processor sends its list in round 4k−34k-34k−3 and its lock-release message in round 4k4k4k even when they are empty, since both carry the PROPER set (Section 3.2: PROPER sets are piggybacked on all messages).
  • A decision is the event DecidesAt p k v (owner of phase kkk, proposed vvv, at least t+1t+1t+1 acknowledgements in round 4k−14k-14k−1); consistency requires all such events of processors in CCC to agree.
  • "Decide by round GST+4(N+1)\mathrm{GST}+4(N+1)GST+4(N+1)" is read as: the deciding phase kkk satisfies 4k−1≤GST+4(N+1)4k-1 \le \mathrm{GST}+4(N+1)4k−1≤GST+4(N+1).
  • Not formalized: Remark 1's asymptotic claims, the PROPER simplifications for weak unanimity, Algorithms 2 and 3.

A formalization in which a run cannot exist, the delivery constraint is unsatisfiable, the choice of proposals is fixed, or faulty processors are absent (CCC = all processors) would trivialize the theorem; the model here admits runs in which processors decide, and CCC ranges over all sets of at least N−tN-tN−t processors.

Reusable beyond this mission: the round-based message-passing model with a GST delivery guarantee and omission faults. Contributions of general lemmas about runs (monotonicity of PROPER sets, persistence of locks, quorum intersection over Finset) are welcome.

Selected references

  • C. Dwork, N. Lynch, L. Stockmeyer, Consensus in the presence of partial synchrony, Journal of the ACM 35(2), 1988, 288–323. https://doi.org/10.1145/42282.42283
  • M. J. Fischer, N. A. Lynch, M. S. Paterson, Impossibility of distributed consensus with one faulty process, Journal of the ACM 32(2), 1985, 374–382. https://doi.org/10.1145/3149.214121
6 thms2 active usersReviewed
🏆Completed
CombinatoricsOperations Research·Captain: mikedeng1

On the Approximability of Single-Machine Scheduling with Precedence Constraints 2: Every Convex Bipartite Order Has a Realizer of Size 3Research Paper

Motivation

The single-machine scheduling problem 1∣prec∣∑wjCj1|\mathrm{prec}|\sum w_j C_j1∣prec∣∑wj​Cj​ asks for an order in which to process nnn jobs, each with a processing time and a weight, on one machine, respecting a partial order of precedence constraints, so that the weighted sum of completion times is as small as possible. It is NP-hard, and the best known approximation ratio for general precedence constraints is 222. Ambühl, Mastrolilli, Mutsanas and Svensson (Math. Oper. Res. 36(4), 2011) relate the problem to the dimension theory of partial orders: their Theorem 3.2 states that when the precedence constraints are given together with a realizer of size kkk, the problem has a (2−2/k)(2 - 2/k)(2−2/k)-approximation algorithm. Small realizers of structured precedence orders therefore translate directly into better approximation ratios.

This mission formalizes one such structural result, Lemma 4.1 of the paper: every convex bipartite order has a realizer of size 333. Convex bipartite orders form a class of precedence constraints that lies strictly between strong bipartite orders and general bipartite orders (Möhring, 1989). Combined with Theorem 3.2, the lemma gives a 4/34/34/3-approximation for 1∣prec∣∑wjCj1|\mathrm{prec}|\sum w_j C_j1∣prec∣∑wj​Cj​ on this class. According to the authors, the bound dim⁡≤3\dim \le 3dim≤3 for convex bipartite orders had not been known before.

Setting

A poset is a set NNN with a reflexive, antisymmetric, transitive relation PPP. Two elements x,yx, yx,y are incomparable, written x∥yx \parallel yx∥y, when neither (x,y)∈P(x,y) \in P(x,y)∈P nor (y,x)∈P(y,x) \in P(y,x)∈P; the set of incomparable pairs is inc(P)\mathrm{inc}(P)inc(P). A linear extension of PPP is a linear order LLL on NNN with P⊆LP \subseteq LP⊆L. A linear order LLL reverses the pair (x,y)(x,y)(x,y) when y<xy < xy<x in LLL. A realizer of size ttt is a family L1,…,LtL_1, \dots, L_tL1​,…,Lt​ of linear extensions of PPP such that every incomparable pair (x,y)(x,y)(x,y) is reversed by at least one LiL_iLi​. The dimension dim⁡(P)\dim(P)dim(P) is the least ttt for which a realizer of size ttt exists.

A convex bipartite order has jobs N=J−∪J+N = J^- \cup J^+N=J−∪J+ split into minus jobs J−={j1,…,ja}J^- = \{j_1, \dots, j_a\}J−={j1​,…,ja​} and plus jobs J+={ja+1,…,jn}J^+ = \{j_{a+1}, \dots, j_n\}J+={ja+1​,…,jn​}. Each plus job jkj_kjk​ carries two indices 1≤l(k)≤r(k)≤a1 \le l(k) \le r(k) \le a1≤l(k)≤r(k)≤a, and a minus job jij_iji​ precedes jkj_kjk​ exactly when l(k)≤i≤r(k)l(k) \le i \le r(k)l(k)≤i≤r(k). There are no other precedences: the predecessors of each plus job form a nonempty interval of consecutive minus jobs.

For the Appendix construction, the incomparable pairs are sorted into three sets E1,E2,E3E_1, E_2, E_3E1​,E2​,E3​ according to the kinds of the two jobs, the order of their indices and, for a pair (plus job jij_iji​, minus job jjj_jjj​), whether jjj_jjj​ precedes some plus job of larger index than iii. The sets Eˉm=Em∪P\bar E_m = E_m \cup PEˉm​=Em​∪P describe what the mmm-th linear order of the realizer must contain.

Formalization targets

Goal: Lemma 4.1

For every convex bipartite order (N,P):∃ L1,L2,L3 linear extensions of P with ∀(x,y)∈inc(P) ∃m: y<Lmx.\text{For every convex bipartite order } (N, P):\quad \exists\, L_1, L_2, L_3 \text{ linear extensions of } P \text{ with } \forall (x,y) \in \mathrm{inc}(P)\ \exists m:\ y <_{L_m} x .For every convex bipartite order (N,P):∃L1​,L2​,L3​ linear extensions of P with ∀(x,y)∈inc(P) ∃m: y<Lm​​x.

Equivalently, dim⁡(P)≤3\dim(P) \le 3dim(P)≤3. The goal holds for every numbering of the jobs and every choice of interval ends l,rl, rl,r.

Milestones

  • Lemma A.1. E1,E2,E3E_1, E_2, E_3E1​,E2​,E3​ partition inc(P)\mathrm{inc}(P)inc(P), and for each mmm, (x,y)∈Em(x,y) \in E_m(x,y)∈Em​ implies (y,x)∉Em(y,x) \notin E_m(y,x)∈/Em​.
  • Lemma A.2. Under the Appendix's numbering of the plus jobs (i<ji < ji<j implies l(i)≤l(j)l(i) \le l(j)l(i)≤l(j)), each Eˉm\bar E_mEˉm​ is contained in a linear order on NNN.

Significance

The result. Lemma 4.1 places convex bipartite orders among the classes of precedence constraints for which 1∣prec∣∑wjCj1|\mathrm{prec}|\sum w_j C_j1∣prec∣∑wj​Cj​ has an approximation ratio strictly below 222, namely 4/34/34/3 through Theorem 3.2 of the paper. The bound is tight: a bipartite order has dimension 222 exactly when it is a strong bipartite order (Möhring), so the bound 333 cannot be lowered for the class of convex bipartite orders. Since dim⁡(P)=3\dim(P) = 3dim(P)=3 also gives χ(GP)=3\chi(G_P) = 3χ(GP​)=3 for the graph of incomparable pairs, a 333-realizer yields an optimal colouring of that graph.

Formalizing it. The result is proved in the paper, with a short case analysis in the Appendix. No machine-checked proof is known to exist. Mathlib has no dimension theory of posets: realizers, reversals of incomparable pairs and the construction of linear extensions containing a given acyclic relation have to be set up here. The definitions of realizer and linear extension are stated for an arbitrary relation and can be reused for other dimension bounds (interval orders, semiorders, the other missions of this series).

Difficulty

The three relations Eˉm\bar E_mEˉm​ are not partial orders. Eˉ2\bar E_2Eˉ2​, for instance, is not transitive: with two minus jobs and one plus job j3j_3j3​ with l(3)=r(3)=2l(3) = r(3) = 2l(3)=r(3)=2, the pairs (j1,j2)∈E2(j_1, j_2) \in E_2(j1​,j2​)∈E2​ and (j2,j3)∈P(j_2, j_3) \in P(j2​,j3​)∈P are present but (j1,j3)(j_1, j_3)(j1​,j3​) lies in E1E_1E1​. The step that requires work is to show that each Eˉm\bar E_mEˉm​ has no cycle, so that it extends to a linear order. For Eˉ2\bar E_2Eˉ2​ this depends on the convexity of the predecessor intervals and on the numbering of the plus jobs by their left ends: it is not a consequence of bipartiteness alone. The goal itself carries no numbering assumption, so any proof must also account for renumbering the plus jobs.

Formalization scope

All declarations live in the namespace SingleMachinePrec.ConvexBipartite.

  • Relations. A relation on NNN is a predicate N → N → Prop. Linear orders use Mathlib's unbundled class IsLinearOrder. A linear extension of PPP is a linear order LLL with P⊆LP \subseteq LP⊆L; LLL reverses (x,y)(x,y)(x,y) when L y xL\,y\,xLyx and y≠xy \ne xy=x. A realizer of size ttt is a function Fin t → N → N → Prop, so repeated members are allowed, as in the paper's multisets.
  • Convex bipartite orders. The jobs are the type Fin a ⊕ Fin b: Sum.inl i is the minus job ji+1j_{i+1}ji+1​, Sum.inr k the plus job ja+k+1j_{a+k+1}ja+k+1​, with indices starting at 000. The interval ends are maps l r : Fin b → Fin a with l k ≤ r k, and PPP is equality together with the pairs (minus iii, plus kkk) with l(k)≤i≤r(k)l(k) \le i \le r(k)l(k)≤i≤r(k). A file-level instance records that PPP is a partial order. Any convex bipartite order in the paper's sense is one of these after naming its jobs. The cases a=0a = 0a=0 and b=0b = 0b=0 are allowed.
  • E1,E2,E3E_1, E_2, E_3E1​,E2​,E3​. Each set is defined as "incomparable and satisfies the paper's case condition". In the plus–minus clauses, "k>ik > ik>i" compares plus indices, because kkk exceeds the index of a plus job.
  • Lemma A.2. "Eˉm\bar E_mEˉm​ is an extension of PPP" is formalized as "there is a linear order containing Eˉm\bar E_mEˉm​", which is what the paper's proof establishes (absence of cycles) and what its final paragraph uses. Reading it as "Eˉm\bar E_mEˉm​ is a partial order" would make the lemma false (see Difficulty). The Appendix's numbering assumption is the hypothesis Monotone l of this milestone only.
  • Algorithmic wording not formalized. The paper states Lemma 4.1 as "a realizer of size 3 can be computed in polynomial time". What is formalized is the existence of the realizer; the running time is not.

A trivializing formalization would let the members of the realizer be arbitrary relations, which makes reversing every pair free. Here every member must be a linear order containing PPP.

Contributions welcome: proofs of the two milestones and of the goal; a general lemma that a relation whose transitive closure is antisymmetric extends to a linear order on a finite type; and the renumbering argument that removes the numbering assumption.

Selected references

  • C. Ambühl, M. Mastrolilli, N. Mutsanas, O. Svensson, On the Approximability of Single-Machine Scheduling with Precedence Constraints, Mathematics of Operations Research 36(4):653–669, 2011. https://doi.org/10.1287/moor.1110.0512
  • G. R. Brightwell, E. R. Scheinerman, Fractional dimension of partial orders, Order 9(2):139–158, 1992.
  • R. H. Möhring, Computationally tractable classes of ordered sets, in I. Rival (ed.), Algorithms and Order, NATO ASI Series 255, Kluwer, 1989, pp. 105–193.
  • W. T. Trotter, Combinatorics and Partially Ordered Sets: Dimension Theory, Johns Hopkins University Press, 1992.
7 thms2 active usersReviewed
CombinatoricsOperations ResearchProbability·Captain: mikedeng1

Online Stochastic Matching: Beating 1-1/e 1: When OPT = Ω(n), the Two Suggested Matchings Algorithm Achieves ALG/OPT ≥ (1 − 2/e²)/(4/3 − 2/(3e)) − ε ≈ 0.670 with Probability 1 − e^(−Ω(n))Research Paper

Motivation

Online bipartite matching models a platform that must commit each arriving request to a resource immediately. The motivating application of Feldman, Mehta, Mirrokni and Muthukrishnan is display advertising: an ad server knows from past traffic how many impressions of each type (web page, audience segment) to expect, sells them to advertisers in advance, and must assign each impression to an interested advertiser the moment a user loads the page. The goal is to fill as many contracted impressions as possible.

When arrivals are chosen by an adversary, the best ratio an online algorithm can guarantee is 1−1/e≈0.6321 - 1/e \approx 0.6321−1/e≈0.632, achieved by the RANKING algorithm of Karp, Vazirani and Vazirani (STOC 1990). The ad server, however, is not facing an adversary: it has a forecast. The i.i.d. model captures this: the graph and the distribution of impression types are known in advance, and the impressions are independent draws. The paper asks whether this knowledge allows an online algorithm to beat 1−1/e1 - 1/e1−1/e, and answers yes.

Timeline.

  • 1990: Karp, Vazirani and Vazirani give RANKING, with ratio 1−1/e1 - 1/e1−1/e for adversarial arrivals, and show this is optimal in that model.
  • 2005: Mehta, Saberi, Vazirani and Vazirani obtain 1−1/e1 - 1/e1−1/e for the budgeted AdWords generalization.
  • 2009: Feldman, Mehta, Mirrokni and Muthukrishnan (arXiv:0905.4100, FOCS 2009) show that in the i.i.d. model the two suggested matchings algorithm achieves about 0.6700.6700.670 with high probability when OPT is linear in nnn, the first ratio above 1−1/e1 - 1/e1−1/e for this model, and that no online algorithm reaches 26/2726/2726/27 in expectation.

Setting

An instance is a bipartite graph G=(A,I,E)G = (A, I, E)G=(A,I,E) with a finite set AAA of advertisers, a finite set III of impression types, and edges E⊆A×IE \subseteq A \times IE⊆A×I recording which advertisers want which types. The mission treats the case analysed throughout §4.2 of the paper, in which one impression of each type is expected (ei=1e_i = 1ei​=1). So n=∣I∣n = |I|n=∣I∣ impressions arrive one at a time, with types ω(0),…,ω(n−1)\omega(0), \dots, \omega(n-1)ω(0),…,ω(n−1) drawn independently and uniformly from III. On arrival an impression must be assigned at once and irrevocably to a still unassigned advertiser adjacent to its type, or discarded. ALG(ω)\mathrm{ALG}(\omega)ALG(ω) is the number of impressions an algorithm assigns. OPT(ω)\mathrm{OPT}(\omega)OPT(ω) is the size of a maximum matching of the realization graph, which has one node per arrival ttt, joined to every advertiser aaa with (a,ω(t))∈E(a, \omega(t)) \in E(a,ω(t))∈E.

The two suggested matchings (TSM) algorithm works offline first. Its boosted flow graph GfG_fGf​ has a source arc of capacity 222 into every advertiser, a unit-capacity arc along every edge of EEE, and an arc of capacity 222 from every type to a sink. The algorithm takes the edge set EfE_fEf​ of an integral maximum flow. Every vertex then has at most two edges of EfE_fEf​, so EfE_fEf​ splits into vertex-disjoint paths and cycles. The algorithm colours each component blue and red:

  • on cycles, the colours alternate;
  • on odd paths, the colours alternate, with more blue than red;
  • on even paths between advertisers, the colours alternate;
  • on even paths between types, the first two edges are blue, then the colours alternate, ending in blue.

Online, the first arrival of type iii tries the advertiser along iii's blue edge, the second tries the one along its red edge, and later arrivals are discarded. A tried advertiser that is already taken is not reassigned. The advertisers fall into four classes by their coloured edges: ABRA_{BR}ABR​ (one blue, one red), ABBA_{BB}ABB​ (two blue), ABA_BAB​ (one blue only) and ARA_RAR​ (one red only).

Formalization targets

Goal: Theorem 5, first sentence, ei=1e_i = 1ei​=1

Let

α=1−2/e24/3−2/(3e)≈0.67029.\alpha = \frac{1 - 2/e^2}{4/3 - 2/(3e)} \approx 0.67029 .α=4/3−2/(3e)1−2/e2​≈0.67029.

The goal has three parts. First, every maximum flow edge set admits a colouring that follows the rules. Second, for every ε>0\varepsilon > 0ε>0 and c>0c > 0c>0 there are δ>0\delta > 0δ>0 and NNN such that, for every instance with n≥Nn \ge Nn≥N, every maximum flow edge set and every rule-following colouring,

Pr⁡ω[ OPT≥c n  ⟹  ALG≥(α−ε) OPT ]  ≥  1−e−δn.\Pr_\omega\big[\ \mathrm{OPT} \ge c\,n \implies \mathrm{ALG} \ge (\alpha - \varepsilon)\,\mathrm{OPT}\ \big] \;\ge\; 1 - e^{-\delta n}.ωPr​[ OPT≥cn⟹ALG≥(α−ε)OPT ]≥1−e−δn.

Third, α>1−1/e\alpha > 1 - 1/eα>1−1/e.

Milestones

  1. Facts 1 and 2: concentration for two balls-in-bins statistics.
  2. The note of §4.2.1: each type has no coloured edge, one blue edge, or one blue and one red edge.
  3. Equation (1): ∣Ef∣=2∣ABR∣+2∣ABB∣+∣AB∣+∣AR∣|E_f| = 2|A_{BR}| + 2|A_{BB}| + |A_B| + |A_R|∣Ef​∣=2∣ABR​∣+2∣ABB​∣+∣AB​∣+∣AR​∣.
  4. Equation (2): with high probability, ALG≥(1−1/e2)∣ABB∣+(1−2/e2)∣ABR∣+(1−3/(2e))(∣AB∣+∣AR∣)−4εn\mathrm{ALG} \ge (1 - 1/e^2)|A_{BB}| + (1 - 2/e^2)|A_{BR}| + (1 - 3/(2e))(|A_B| + |A_R|) - 4\varepsilon nALG≥(1−1/e2)∣ABB​∣+(1−2/e2)∣ABR​∣+(1−3/(2e))(∣AB​∣+∣AR​∣)−4εn.
  5. Equation (3): ∣Ef∣=2(∣AT∣+∣IS∣)+∣Eδ∣|E_f| = 2(|A_T| + |I_S|) + |E_\delta|∣Ef​∣=2(∣AT​∣+∣IS​∣)+∣Eδ​∣ for the surgered residual cut (S,T)(S,T)(S,T) of GfG_fGf​.
  6. Equation (4): with high probability, OPT≤∣ABR∣+∣ABB∣+12(∣AB∣+∣AR∣)+(12−1e)∣Eδ∣+εn\mathrm{OPT} \le |A_{BR}| + |A_{BB}| + \tfrac12(|A_B| + |A_R|) + (\tfrac12 - \tfrac1e)|E_\delta| + \varepsilon nOPT≤∣ABR​∣+∣ABB​∣+21​(∣AB​∣+∣AR​∣)+(21​−e1​)∣Eδ​∣+εn.
  7. Lemma 1: ∣Eδ∣≤23∣ABR∣+43∣ABB∣+∣AB∣+13∣AR∣|E_\delta| \le \tfrac23|A_{BR}| + \tfrac43|A_{BB}| + |A_B| + \tfrac13|A_R|∣Eδ​∣≤32​∣ABR​∣+34​∣ABB​∣+∣AB​∣+31​∣AR​∣.

Significance

The theorem separates the i.i.d. model from the adversarial one: knowing the distribution is worth a constant factor above 1−1/e1 - 1/e1−1/e. The suggested matching algorithm of the same paper (Theorem 4) shows that following a single offline matching gets exactly 1−1/e1 - 1/e1−1/e, so the second, red matching is what crosses the barrier. The paper's question started a line of work on the i.i.d. and random-order models, with later improvements to the constant by other authors under further assumptions.

The result has a written proof but, as far as the platform record shows, no machine-checked one. The mission formalizes the paper's own argument: the flow-and-colouring construction, the balls-in-bins concentration facts, the cut-based bound on OPT and the combinatorial Lemma 1. It also fixes two slips in the printed statements (see Formalization scope). The pieces are reusable beyond this paper. The occupancy concentration (Fact 1) and the satisfied-sequences bound (Fact 2) recur in analyses of online algorithms with stochastic input. The degree-capped flow encoding and its path/cycle decomposition are standard tools for 2-matchings.

Difficulty

The upper bound on OPT is the delicate part. A cut of the flow graph bounds the maximum matching of the realization graph only after a second surgery that depends on the random arrivals. Its size must then be compared with the colour classes, which are defined by a different structure (the components of EfE_fEf​). Lemma 1 bridges the two, and it depends on the exact colouring rules: a colouring that only satisfies local degree conditions can put red edges at both ends of an even advertiser path, which breaks the inequality ∣AB∣≥∣AR∣|A_B| \ge |A_R|∣AB​∣≥∣AR​∣ behind (2). On the probabilistic side, the advertisers of ABRA_{BR}ABR​ share impression types with each other, so the success events are dependent, and Fact 2 needs a bounded-differences argument in which one ball affects up to ddd sequences.

Formalization scope

All declarations live in the namespace OnlineStochMatching.TSM. Advertisers and types are finite types A I : Type, and EEE is a Finset (A × I). Probabilities are counting ratios #{ω:Fin n→I∣P ω}/∣I∣n\#\{\omega : \mathrm{Fin}\ n \to I \mid P\,\omega\}/|I|^n#{ω:Fin n→I∣Pω}/∣I∣n, so there are no measurability side conditions. OPT is a maximum over the finite, nonempty set of partial injective assignments. An integral flow of GfG_fGf​ is its set of saturated middle edges, i.e. a subset of EEE with at most two edges per vertex; EfE_fEf​ is such a set of maximum cardinality. A colouring is given by a listing of the components of EfE_fEf​ as vertex sequences. Every theorem quantifies over every maximum EfE_fEf​ and every colouring the rules allow, since the paper fixes neither.

The paper's asymptotic phrases are replaced by explicit quantifiers that come from its own proofs:

  • "with probability 1−e−Ω(n)1 - e^{-\Omega(n)}1−e−Ω(n)" and "with high probability" (Theorem 5, (2), (4)) become: ∃ δ>0, ∃ N\exists\, \delta > 0,\ \exists\, N∃δ>0, ∃N, chosen before the instance, with probability at least 1−e−δn1 - e^{-\delta n}1−e−δn for all n≥Nn \ge Nn≥N;
  • "as long as OPT =Ω(n)= \Omega(n)=Ω(n)" becomes the event OPT≥c n\mathrm{OPT} \ge c\,nOPT≥cn for an arbitrary c>0c > 0c>0 fixed before δ\deltaδ and NNN;
  • the O(1)O(1)O(1) term in the bound on ∣Aδ∗∣|A^*_\delta|∣Aδ∗​∣ (p. 8) is absorbed into εn\varepsilon nεn for n≥Nn \ge Nn≥N.

Corrections to the printed statements:

  • Theorem 5 prints ALG/OPT−ϵ≥α\mathrm{ALG}/\mathrm{OPT} - \epsilon \ge \alphaALG/OPT−ϵ≥α; the proof concludes ALG/OPT+ϵ≥α\mathrm{ALG}/\mathrm{OPT} + \epsilon \ge \alphaALG/OPT+ϵ≥α, so the goal states ALG≥(α−ε)OPT\mathrm{ALG} \ge (\alpha - \varepsilon)\mathrm{OPT}ALG≥(α−ε)OPT;
  • Fact 1 prints the failure probability 2e−ϵn/22e^{-\epsilon n/2}2e−ϵn/2; its proof gives 2e−ϵ2n/22e^{-\epsilon^2 n/2}2e−ϵ2n/2, which is used;
  • Fact 2 states two hypotheses its proof uses: the bins of a sequence are distinct, and c2<nc^2 < nc2<n.

The ratio is multiplied out, so no division by OPT occurs. A colouring condition that is unsatisfiable, or a flow set that is not maximum, would make the goal vacuous or false; part (a) of the goal rules out the first, and every statement requires maximality. Not included: the reduction to general integer eie_iei​ (§4.2.4), the tightness sentence of Theorem 5 (§4.2.5), and footnote 7's variant of the algorithm.

Useful infrastructure: bounded-differences (McDiarmid/Azuma) inequalities for functions of i.i.d. uniform variables, which exist on the platform as separate theorems; path/cycle decomposition of graphs of maximum degree two; and max-flow min-cut for unit-capacity bipartite networks. Contributions are welcome on Facts 1 and 2 independently of the combinatorics, and on Lemma 1 and equations (1) and (3), which are deterministic.

Selected references

  • J. Feldman, A. Mehta, V. Mirrokni, S. Muthukrishnan, Online Stochastic Matching: Beating 1-1/e, FOCS 2009; arXiv:0905.4100v1. https://arxiv.org/abs/0905.4100
  • R. M. Karp, U. V. Vazirani, V. V. Vazirani, An optimal algorithm for on-line bipartite matching, STOC 1990. https://doi.org/10.1145/100216.100262
  • A. Mehta, A. Saberi, U. Vazirani, V. Vazirani, AdWords and generalized online matching, FOCS 2005; J. ACM 54(5), 2007. https://doi.org/10.1145/1284320.1284321
13 thms2 active usersReviewed
Linear OptimizationOperations ResearchOptimization·Captain: mikedeng1

Approximation Algorithms for Precedence-Constrained Scheduling Problems on Parallel Machines That Run at Different Speeds: A min{K + 2√K + 1, 1.89 log m + O(√log m)}-Approximation for Q|prec|CmaxResearch Paper

Scheduling precedence-constrained jobs on machines of different speeds

Graham (1966) showed that list scheduling finds a schedule within a factor 222 of optimal for precedence-constrained jobs on identical parallel machines, the first performance guarantee for an approximation algorithm. When the machines run at different speeds (uniformly related machines), the same analysis breaks down, and for two decades the problem Q∣prec∣Cmax⁡Q|prec|C_{\max}Q∣prec∣Cmax​ resisted a guarantee independent of the speeds better than O(m)O(\sqrt m)O(m​).

Timeline:

  • 1974, Liu and Liu: list scheduling on machines of different speeds, with a guarantee that depends on the speeds and can be arbitrarily large even for a fixed number of machines.
  • 1980, Jaffe: list scheduling on the machines whose speed is within a factor m\sqrt mm​ of the fastest gives an O(m)O(\sqrt m)O(m​)-approximation.
  • 1978, Lenstra and Rinnooy Kan: with precedence constraints, no ρ\rhoρ-approximation with ρ<4/3\rho < 4/3ρ<4/3 exists unless P = NP. This bound already holds for identical machines.
  • 1997–1999, Chudak and Shmoys: an LP-guided variant of list scheduling achieves O(log⁡m)O(\log m)O(logm), and K+2K+1K + 2\sqrt K + 1K+2K​+1 when there are only KKK distinct speeds (J. Algorithms 30 (1999) 323–343; conference version SODA 1997).

The mission formalizes the makespan half of that paper, up to its Theorem 3.7.

Setting

An instance has nnn jobs and m≥1m \ge 1m≥1 machines. Job jjj requires pj>0p_j > 0pj​>0 units of processing, and machine iii runs at speed si>0s_i > 0si​>0, so job jjj takes pj/sip_j/s_ipj​/si​ time units on machine iii. A strict partial order ≺\prec≺ on the jobs gives precedence constraints: j≺kj \prec kj≺k means that job kkk may not start until job jjj has completed.

A schedule runs each job jjj without interruption on one machine μ(j)\mu(j)μ(j), from a start time Sj≥0S_j \ge 0Sj​≥0 to its completion time Cj=Sj+pj/sμ(j)C_j = S_j + p_j/s_{\mu(j)}Cj​=Sj​+pj​/sμ(j)​. A machine processes at most one job at a time, and j≺kj \prec kj≺k forces Cj≤SkC_j \le S_kCj​≤Sk​. Its length is Cmax⁡=max⁡jCjC_{\max} = \max_j C_jCmax​=maxj​Cj​. Cmax⁡∗C^*_{\max}Cmax∗​ is the length of an optimal schedule.

Let sˉ1>sˉ2>⋯>sˉK\bar s_1 > \bar s_2 > \cdots > \bar s_Ksˉ1​>sˉ2​>⋯>sˉK​ be the distinct speeds and mkm_kmk​ the number of machines of speed sˉk\bar s_ksˉk​. An assignment k(j)k(j)k(j) names the speed class at which job jjj is to run. Its loads are Dk=1mk∑j:k(j)=kpj/sˉkD_k = \frac{1}{m_k}\sum_{j:k(j)=k} p_j/\bar s_kDk​=mk​1​∑j:k(j)=k​pj​/sˉk​, and its chain bound CCC is the largest value of ∑j∈Cpj/sˉk(j)\sum_{j\in\mathcal C} p_j/\bar s_{k(j)}∑j∈C​pj​/sˉk(j)​ over chains C\mathcal CC of ≺\prec≺. Speed-based list scheduling is Graham's rule restricted by the assignment: whenever a machine of speed sˉk\bar s_ksˉk​ is idle, it starts the first available job jjj on the list with k(j)=kk(j) = kk(j)=k.

The linear program LP has variables xkj≥0x_{kj} \ge 0xkj​≥0, CjC_jCj​ and DDD. It minimizes DDD subject to the following constraints:

  • ∑kxkj=1\sum_k x_{kj} = 1∑k​xkj​=1;
  • 1mksˉk∑jpjxkj≤D\frac{1}{m_k\bar s_k}\sum_j p_j x_{kj} \le Dmk​sˉk​1​∑j​pj​xkj​≤D;
  • ∑k(pj/sˉk)xkj≤Cj\sum_k (p_j/\bar s_k)x_{kj} \le C_j∑k​(pj​/sˉk​)xkj​≤Cj​, and ∑k(pj/sˉk)xkj≤Cj−Cj′\sum_k (p_j/\bar s_k)x_{kj} \le C_j - C_{j'}∑k​(pj​/sˉk​)xkj​≤Cj​−Cj′​ whenever j′≺jj' \prec jj′≺j;
  • Cj≤DC_j \le DCj​≤D.

From a solution, with pˉj=∑k(pj/sˉk)xkj\bar p_j = \sum_k (p_j/\bar s_k)x_{kj}pˉ​j​=∑k​(pj​/sˉk​)xkj​, the assignment algorithm gives each job jjj the speed class k∉Bj={k:pj/sˉk>γpˉj}k \notin B_j = \{k : p_j/\bar s_k > \gamma\bar p_j\}k∈/Bj​={k:pj​/sˉk​>γpˉ​j​} of largest capacity sˉkmk\bar s_k m_ksˉk​mk​.

Formalization targets

Goal: Theorem 3.7 (p. 10)

There is an absolute constant ccc such that for every instance with m≥2m \ge 2m≥2 machines and KKK distinct speeds, the better of the two schedules below has length at most

min⁡{K+2K+1, 1.89log⁡2m+clog⁡2m}⋅Cmax⁡∗.\min\bigl\{K + 2\sqrt K + 1,\ 1.89\log_2 m + c\sqrt{\log_2 m}\bigr\}\cdot C^*_{\max}.min{K+2K​+1, 1.89log2​m+clog2​m​}⋅Cmax∗​.
  • (A) An optimal LP solution, the assignment algorithm with γ=K+1\gamma = \sqrt K + 1γ=K​+1, and speed-based list scheduling.
  • (B) The same algorithm run on speeds rounded down to powers of eee, with machines slower than sˉ1/(mlog⁡2m)\bar s_1/(m\log_2 m)sˉ1​/(mlog2​m) dropped, and read back on the original machines.

Milestones, in proof order

  • Existence of speed-based list schedules (p. 4).
  • Theorem 2.1: Cmax⁡≤C+∑kDkC_{\max} \le C + \sum_k D_kCmax​≤C+∑k​Dk​.
  • The LP lower bound Dˉ≤Cmax⁡∗\bar D \le C^*_{\max}Dˉ≤Cmax∗​ (p. 6).
  • Lemmas 3.1–3.4: chain bounds 2Dˉ2\bar D2Dˉ and (K+1)Dˉ(\sqrt K + 1)\bar D(K​+1)Dˉ, and load bounds 2KDˉ2K\bar D2KDˉ and (K+K)Dˉ(K + \sqrt K)\bar D(K+K​)Dˉ.
  • Theorem 3.5 and Corollary 3.6: the factor K+2K+1K + 2\sqrt K + 1K+2K​+1 against Cmax⁡∗C^*_{\max}Cmax∗​ and against Dˉ\bar DDˉ.
  • Rounded schedules serve the original instance (p. 9).
  • The speed rounding: at most ⌊log⁡β(αm)⌋+1\lfloor\log_\beta(\alpha m)\rfloor + 1⌊logβ​(αm)⌋+1 speeds, and the LP value grows by a factor of at most β(1+1/α)\beta(1 + 1/\alpha)β(1+1/α) (p. 10).
  • The "In fact" form of the guarantee, relative to any feasible LP solution (p. 10).

Significance

The result gives the first O(log⁡m)O(\log m)O(logm) guarantee for Q∣prec∣Cmax⁡Q|prec|C_{\max}Q∣prec∣Cmax​, independent of the speeds, and a guarantee depending only on the number of distinct speeds. Through the batching technique of Shmoys, Wein and Williamson it extends to release dates (Corollary 3.8). Since LP also relaxes the preemptive problem, it gives an O(log⁡m)O(\log m)O(logm) bound on the ratio between the nonpreemptive and preemptive optima (Corollaries 3.9, 3.10). The "In fact" form, relative to an arbitrary feasible LP solution, drives the paper's ∑wjCj\sum w_jC_j∑wj​Cj​ algorithm in §4.

The result is proved in the literature but, as far as is known, not formalized. A formal proof requires machine-checking the following:

  • the continuous-time list-scheduling argument for different speeds;
  • the filtering argument of Lin and Vitter;
  • the reduction to logarithmically many speeds, including the off-by-one count of rounded speeds that the page leaves implicit.

Later work gave a combinatorial O(log⁡m)O(\log m)O(logm)-approximation (Chekuri and Bender, 2001) and an O(log⁡m/log⁡log⁡m)O(\log m/\log\log m)O(logm/loglogm)-approximation (Li, 2017). These are not part of this mission.

Difficulty

Graham's argument has two lower bounds:

  1. the total processing along a chain;
  2. the time during which every machine is busy.

With different speeds, the first bound fails: a chain may have been run on slow machines, and its length then says nothing about Cmax⁡∗C^*_{\max}Cmax∗​. Forcing every job onto a fast machine repairs chains but can leave most machines idle, so the second bound fails. The paper only guarantees that all machines of one speed are busy at each moment of an idle period. Making this pay off requires an assignment that controls chain lengths and per-class loads simultaneously. That assignment is the delicate part: Theorem 2.1 is the bookkeeping, while Lemmas 3.2 and 3.4 rely on the LP. Two of the formal steps are routine on paper but fiddly in Lean: time-interval accounting over a continuous-time schedule, and the counting of rounded speed classes.

Formalization scope

  • Representation. Jobs are Fin n and machines Fin m with m≥1m \ge 1m≥1. pj>0p_j > 0pj​>0 and si>0s_i > 0si​>0. ≺\prec≺ is a strict partial order, and a chain is a finite set of pairwise comparable jobs. Cmax⁡C_{\max}Cmax​ is the maximum completion time, or 000 with no jobs.
  • Speed classes. The classes are computed from the speeds, so mk≥1m_k \ge 1mk​≥1 and sˉk>0\bar s_k > 0sˉk​>0 by construction. The Lean index 000 is the paper's fastest class sˉ1\bar s_1sˉ1​.
  • The algorithm as predicates. Speed-based list scheduling is the predicate the proof of Theorem 2.1 uses: jobs run at their assigned speed, and no machine of a job's speed idles while that job is available and unstarted. Every list order and every order of idle machines satisfies it. The assignment algorithm is a predicate allowing every maximizer, since the page does not break ties. Theorems 3.5 and 3.7 quantify over all optimal LP solutions, all such assignments and all such schedules. Existence is supplied by the milestones.
  • Comparator. The bound is stated against every feasible schedule of the same instance, never against the LP value or a best schedule of the rounded instance. A statement asserting only that some good schedule exists would be trivially true (the optimum witnesses it); the goal bounds the schedule the algorithm returns.
  • Constants and logarithms. log⁡m\log mlogm is log⁡2m\log_2 mlog2​m, as the paper specifies. m≥2m \ge 2m≥2 is assumed in Theorem 3.7 and in the "In fact" remark, which are asymptotic in mmm. The O(log⁡m)O(\sqrt{\log m})O(logm​) term is one absolute constant ccc, quantified before the instance, and 1.891.891.89 is the page's number.
  • Generalizations and corrections. Lemmas 3.1–3.4 are stated for every feasible LP solution, since their proofs use only feasibility. The speed rounding is relative to sˉ1\bar s_1sˉ1​, with no normalization. The count of rounded speeds is ⌊log⁡β(αm)⌋+1\lfloor\log_\beta(\alpha m)\rfloor + 1⌊logβ​(αm)⌋+1; the page writes log⁡β(αm)\log_\beta(\alpha m)logβ​(αm).
  • Not formalized. Polynomial running time is not formalized.
  • Out of scope. Corollaries 3.8–3.10, Theorem 3.11 and §4 are excluded.

Proofs of any milestone are welcome. Reusable beyond this mission are the following: the model of nonpreemptive schedules on uniformly related machines with precedence, the speed-based list-scheduling predicate with Theorem 2.1, and the LP.

Selected references

  • F. A. Chudak and D. B. Shmoys, Approximation algorithms for precedence-constrained scheduling problems on parallel machines that run at different speeds, J. Algorithms 30 (1999) 323–343 (authors' manuscript used here). https://doi.org/10.1006/jagm.1998.0987
  • R. L. Graham, Bounds for certain multiprocessing anomalies, Bell System Technical Journal 45 (1966) 1563–1581. https://doi.org/10.1002/j.1538-7305.1966.tb01709.x
  • J. M. Jaffe, Efficient scheduling of tasks without full use of processor resources, Theoretical Computer Science 12 (1980) 1–17. https://doi.org/10.1016/0304-3975(80)90002-4
  • J.-H. Lin and J. S. Vitter, ε-approximations with minimum packing constraint violation, STOC 1992, 771–782. https://doi.org/10.1145/129712.129787
  • D. B. Shmoys, J. Wein and D. P. Williamson, Scheduling parallel machines on-line, SIAM J. Computing 24 (1995) 1313–1331. https://doi.org/10.1137/S0097539793248317
  • C. Chekuri and M. A. Bender, An efficient approximation algorithm for minimizing makespan on uniformly related machines, J. Algorithms 41 (2001) 212–224. https://doi.org/10.1006/jagm.2001.1184
  • S. Li, Scheduling to minimize total weighted completion time via time-indexed linear programming relaxations, SIAM J. Computing 46 (2017) 409–440. https://doi.org/10.1137/15M1053163
16 thms2 active usersReviewed
CombinatoricsMachine Learning·Captain: mikedeng1

A Characterization of Multiclass Learnability 1: Classes of Finite DS Dimension Have n → r Sample Compression Schemes with r Polylogarithmic in nResearch Paper

Motivation

In multiclass classification a learner sees examples (x,y)(x, y)(x,y) with xxx in a domain X\mathcal XX and a label yyy in a set Y\mathcal YY, and must predict labels of new points. When Y\mathcal YY is finite, the Natarajan dimension characterizes PAC learnability, extending the role of the VC dimension in binary classification (Natarajan 1989; Ben-David, Cesa-Bianchi, Haussler, Long 1995). Label sets in practice are often unbounded: structured prediction, ranking, and language modelling all predict from very large or infinite label spaces. For infinite Y\mathcal YY the Natarajan dimension fails to characterize learnability, and the question of which combinatorial parameter does was left open by Daniely and Shalev-Shwartz.

Timeline:

  • 1989–1995. Natarajan, then Ben-David et al. and Haussler–Long: for finite Y\mathcal YY, learnability is equivalent to finite Natarajan dimension, with sample complexity depending on log⁡∣Y∣\log|\mathcal Y|log∣Y∣.
  • 2011–2015. Daniely, Sabato, Ben-David and Shalev-Shwartz show that ERM can fail for multiclass problems with many labels. Daniely and Shalev-Shwartz (COLT 2014) introduce the DS dimension, prove that finite DS dimension is necessary for learnability, and ask whether it is sufficient.
  • 2022. Brukhim, Carmon, Dinur, Moran, Yehudayoff prove sufficiency, so the DS dimension characterizes multiclass PAC learnability, and show that the Natarajan dimension does not.

Setting

A concept class is a set H⊆YX\mathcal H\subseteq\mathcal Y^{\mathcal X}H⊆YX of functions. For a sequence S=(x1,…,xn)S=(x_1,\dots,x_n)S=(x1​,…,xn​) the projection H∣S⊆Yn\mathcal H|_S\subseteq\mathcal Y^nH∣S​⊆Yn is the set of label words (h(x1),…,h(xn))(h(x_1),\dots,h(x_n))(h(x1​),…,h(xn​)), h∈Hh\in\mathcal Hh∈H. A finite non-empty set B⊆YdB\subseteq\mathcal Y^dB⊆Yd is a pseudo-cube if every h∈Bh\in Bh∈B has, in every coordinate iii, a neighbour g∈Bg\in Bg∈B that differs from hhh exactly in coordinate iii. The sequence SSS is DS-shattered if H∣S\mathcal H|_SH∣S​ contains an nnn-dimensional pseudo-cube, and the DS dimension dDS(H)d_{DS}(\mathcal H)dDS​(H) is the maximum length of a DS-shattered sequence. The Natarajan dimension dN(H)≤dDS(H)d_N(\mathcal H)\le d_{DS}(\mathcal H)dN​(H)≤dDS​(H) is the same with Boolean cubes ∏i{f(i),g(i)}\prod_i\{f(i),g(i)\}∏i​{f(i),g(i)}, f(i)≠g(i)f(i)\ne g(i)f(i)=g(i), in place of pseudo-cubes.

A sample S∈(X×Y)nS\in(\mathcal X\times\mathcal Y)^nS∈(X×Y)n is H\mathcal HH-realizable if some h∈Hh\in\mathcal Hh∈H is consistent with it. An n→rn\to rn→r sample compression scheme for H\mathcal HH (Littlestone and Warmuth 1986) is a single reconstruction function ρ:(X×Y)r→YX\rho:(\mathcal X\times\mathcal Y)^r\to\mathcal Y^{\mathcal X}ρ:(X×Y)r→YX such that every realizable sample of size nnn contains rrr of its examples S′S'S′ with ρ(S′)\rho(S')ρ(S′) consistent with the whole sample. Logarithms are base 222 throughout.

Formalization targets

Goal: Theorem 36 (p. 22)

For H\mathcal HH with dDS(H)=dDS<∞d_{DS}(\mathcal H)=d_{DS}<\inftydDS​(H)=dDS​<∞ and dN(H)=dNd_N(\mathcal H)=d_NdN​(H)=dN​, and all integers n,t>0n,t>0n,t>0, there is an n→rn\to rn→r sample compression scheme, r≤nr\le nr≤n, with

r≤(dDS+t+1t+1(dDS+t)+103dNlog⁡((dDS+t+1t+1)log⁡(2n)))log⁡(2n).r\le\left(\frac{d_{DS}+t+1}{t+1}(d_{DS}+t)+10^3d_N\log\left(\binom{d_{DS}+t+1}{t+1}\log(2n)\right)\right)\log(2n).r≤(t+1dDS​+t+1​(dDS​+t)+103dN​log((t+1dDS​+t+1​)log(2n)))log(2n).

Milestones

The scheme combines two components, each with its own chain of results:

  • List learning from the DS dimension. Lemma 13 (orientations of out-degree ≤d\le d≤d on Yd+1\mathcal Y^{d+1}Yd+1), Claim 16 (the one-inclusion algorithm is right on some leave-one-out example), Fact 14 (leave-one-out symmetrization), Proposition 32 (a list PAC learner with list size (d+tt)\binom{d+t}{t}(td+t​) and success probability t+1d+t+1\frac{t+1}{d+t+1}d+t+1t+1​), Lemma 39 (an n→r1n\to r_1n→r1​ list compression scheme with r1≤dDS+t+1t+1(dDS+t)log⁡(2n)r_1\le\frac{d_{DS}+t+1}{t+1}(d_{DS}+t)\log(2n)r1​≤t+1dDS​+t+1​(dDS​+t)log(2n) and menu size ≤(dDS+t+1t+1)log⁡(2n)\le\binom{d_{DS}+t+1}{t+1}\log(2n)≤(t+1dDS​+t+1​)log(2n)).
  • Learning from a menu via shifting. Claim 22, Corollary 23, Claim 26, Proposition 27 (avd⁡≤4dE\operatorname{avd}\le4d_Eavd≤4dE​), Corollary 28, Lemma 29 (dE≤5dNlog⁡pd_E\le5d_N\log pdE​≤5dN​logp), Lemma 17 (orientations of out-degree ≤20dNlog⁡p\le20d_N\log p≤20dN​logp on [p]n[p]^n[p]n), Proposition 34 (error ≤20dNlog⁡(p)/n\le20d_N\log(p)/n≤20dN​log(p)/n given a ppp-menu), Lemma 40 (an n→r2n\to r_2n→r2​ compression scheme given a ppp-menu with r2≤103dNlog⁡(p)log⁡(2n)r_2\le10^3d_N\log(p)\log(2n)r2​≤103dN​log(p)log(2n)).

Significance

Theorem 36 is the algorithmic heart of the characterization: by the standard "compression implies generalization" argument it gives PAC learnability of every class of finite DS dimension, with sample complexity O~(dDS3/2/ϵ)\tilde O(d_{DS}^{3/2}/\epsilon)O~(dDS3/2​/ϵ) in the realizable case (t=⌈dDS1/2⌉t=\lceil d_{DS}^{1/2}\rceilt=⌈dDS1/2​⌉), and with the agnostic case following by known reductions. It also exhibits sample compression schemes of size polylogarithmic in nnn for multiclass classes with infinitely many labels, in contrast to the constant-size schemes known for finite VC classes.

The result is proved in the paper; none of it is formalized. The formalization would produce a machine-checked theory of one-inclusion graphs and their orientations, multiclass shifting, the exponential dimension, list learning, and sample compression schemes for arbitrary label sets. These objects recur throughout learning theory (one-inclusion graphs in optimal PAC learning, shifting in VC theory), so the infrastructure is reusable beyond this mission.

Difficulty

The natural first idea, running empirical risk minimization or bounding the Natarajan dimension, fails: classes with Natarajan dimension 111 and infinitely many labels can be unlearnable, and ERM can fail even for learnable classes. The DS dimension gives only a weak guarantee: by Claim 16, among d+1d+1d+1 leave-one-out runs, one is correct. Turning this into a learner requires a list learner whose menus are still of unbounded total size, and then learning with a menu of size ppp, where the obstacle is controlling one-inclusion graph orientations over [p]n[p]^n[p]n by the Natarajan dimension. Multiclass shifting does not preserve the average degree (Example 20), so the binary argument breaks down, and a new potential (avd⁡′\operatorname{avd}'avd′) and a new dimension (dEd_EdE​) are needed. Lemma 13 for infinite classes needs a compactness argument.

Formalization scope

Lean conventions:

  • A class is H : Set (X → Y) with arbitrary types X, Y; sequences and samples are functions on Fin n ([n][n][n] is 0-based).
  • The DS, Natarajan and exponential dimensions are suprema in ℕ∞, so unbounded families give ⊤; hypotheses are written dsDim H = dDS with dDS : ℕ. A pseudo-cube is required to be finite.
  • Logarithms are Real.logb 2. Menu sizes use Set.encard.
  • A compression scheme is a reconstruction function fixed before the sample (∃ ρ, ∀ S, ∃ S'); a subsample may repeat and reorder examples. Theorem 36 states r≤nr\le nr≤n explicitly.
  • Orientations of the one-inclusion graph of V⊆YmV\subseteq\mathcal Y^mV⊆Ym are maps sending a direction iii and a vertex vvv to the head of the edge of direction iii through vvv; the out-degree of vvv counts directions whose head is not vvv.
  • Classes over [p][p][p] use labels Fin p; the shifting condition 1≤g(i)≤∣ef∣1\le g(i)\le|e_f|1≤g(i)≤∣ef​∣ becomes g(i)<∣ef∣g(i)<|e_f|g(i)<∣ef​∣.
  • The one-inclusion algorithm (Algorithms 1 and 3) is parametrized by a permutation-equivariant choice of minimal orientations, the reading under which the paper's leave-one-out proofs are valid; statements about the algorithm hold for every such choice. Its default output on non-realizable input requires a non-empty label set, assumed in Claim 16 and Propositions 32 and 34. Lemma 40 assumes a non-empty label set because it is false for X≠∅=Y\mathcal X\ne\emptyset=\mathcal YX=∅=Y.
  • Distributions are discrete (PMF), and i.i.d. probabilities are sums over Zm\mathcal Z^mZm. The measure-theoretic generality of the paper is not attempted.

A trivial formalization is ruled out by these choices. Placing the reconstruction function after the sample would let it output the consistent hypothesis. A dimension in ℕ defined by sSup would be 000 for infinite dimension. Pseudo-cubes without finiteness would change the dimension (Example 8).

Contributions welcome: proofs of any milestone, in particular the shifting results of §3 (self-contained combinatorics on finite classes), Fact 14 (pure discrete probability), and Lemma 13; general-purpose lemmas about one-inclusion graphs, orientations and sample compression schemes are reusable by other learning-theory missions.

Selected references

  • N. Brukhim, D. Carmon, I. Dinur, S. Moran, A. Yehudayoff, A Characterization of Multiclass Learnability, FOCS 2022; arXiv:2203.01550v1 (2022). https://arxiv.org/abs/2203.01550
  • A. Daniely, S. Shalev-Shwartz, Optimal Learners for Multiclass Problems, COLT 2014. https://arxiv.org/abs/1405.2690
  • N. Littlestone, M. Warmuth, Relating Data Compression and Learnability, unpublished technical report, University of California, Santa Cruz, 1986 (no stable link).
  • D. Haussler, N. Littlestone, M. Warmuth, Predicting {0,1}-Functions on Randomly Drawn Points, Information and Computation 115(2), 1994. https://doi.org/10.1006/inco.1994.1097
  • D. Haussler, P. M. Long, A Generalization of Sauer's Lemma, Journal of Combinatorial Theory, Series A 71(2), 1995. https://doi.org/10.1016/0097-3165(95)90006-3
  • S. Ben-David, N. Cesa-Bianchi, D. Haussler, P. M. Long, Characterizations of Learnability for Classes of {0,…,n}-Valued Functions, JCSS 50(1), 1995. https://doi.org/10.1006/jcss.1995.1008
  • B. K. Natarajan, On Learning Sets and Functions, Machine Learning 4, 1989. https://doi.org/10.1007/BF00114804
20 thms2 active usersReviewed
🏆Completed
CombinatoricsOperations Research·Captain: mikedeng1

On the Approximability of Single-Machine Scheduling with Precedence Constraints 6: The Optimal Value of S_G Lies Between n² − an²(ln 1/a + 2) and n² − an²Research Paper

Motivation

The problem 1 ∣ prec ∣ ∑wjCj1\,|\,\mathrm{prec}\,|\,\sum w_jC_j1∣prec∣∑wj​Cj​ asks for a single-machine sequence of jobs, respecting precedence constraints, that minimizes the weighted sum of completion times. It has been known to be strongly NP-hard since Lawler (1978) and Lenstra and Rinnooy Kan (1978), several different 2-approximation algorithms are known, and closing the approximability gap is listed by Schuurman and Woeginger (1999) as one of ten outstanding open problems in scheduling theory. Ambühl, Mastrolilli, Mutsanas and Svensson (Math. Oper. Res. 36(4), 2011) give the first inapproximability result for this problem: under a widely believed complexity assumption it has no polynomial-time approximation scheme (PTAS). The bridge to that result is a quantitative link, Lemma 9.1, between the optimal value of a special bipartite scheduling instance and the maximum edge biclique of a bipartite graph, a problem whose hardness of approximation was established by Ambühl, Mastrolilli and Svensson (FOCS 2007). This mission formalizes that link.

Setting

A schedule of a finite job set is a sequence σ\sigmaσ listing every job once; the machine processes the jobs in that order from time 000 without idle time or pre-emption. Job jjj has a processing time pjp_jpj​ and a weight wjw_jwj​; its completion time CjC_jCj​ is the sum of the processing times of the jobs up to and including jjj, and the value of σ\sigmaσ is val(σ)=∑jwjCj\mathrm{val}(\sigma)=\sum_j w_jC_jval(σ)=∑j​wj​Cj​. Precedence constraints are a relation PPP on jobs: (i,j)∈P(i,j)\in P(i,j)∈P with i≠ji\ne ji=j means job iii must be completed before job jjj starts. A schedule respecting all of them is feasible, and a feasible schedule σ∗\sigma^*σ∗ of least value is optimal.

Let G=(U,V,E)G=(U,V,E)G=(U,V,E) be an nnn-by-nnn bipartite graph: ∣U∣=∣V∣=n|U|=|V|=n∣U∣=∣V∣=n and E⊆U×VE\subseteq U\times VE⊆U×V. An edge biclique is a pair A⊆UA\subseteq UA⊆U, B⊆VB\subseteq VB⊆V with A×B⊆EA\times B\subseteq EA×B⊆E, of value ∣A∣⋅∣B∣|A|\cdot|B|∣A∣⋅∣B∣; the maximum edge biclique problem (Definition 9.1) asks for one of largest value. The bipartite scheduling instance SGS_GSG​ has jobs U∪VU\cup VU∪V and precedence constraints

P=(U×V)∖E,P=(U\times V)\setminus E,P=(U×V)∖E,

so u∈Uu\in Uu∈U must precede v∈Vv\in Vv∈V exactly when (u,v)(u,v)(u,v) is not an edge. Jobs of UUU have p=1p=1p=1, w=0w=0w=0; jobs of VVV have p=0p=0p=0, w=1w=1w=1. Thus val(σ)=∑v∈VCv\mathrm{val}(\sigma)=\sum_{v\in V}C_vval(σ)=∑v∈V​Cv​, where CvC_vCv​ is the number of UUU-jobs scheduled before vvv. For i≥1i\ge1i≥1, σ(i)\sigma(i)σ(i) denotes the number of VVV-jobs scheduled before iii jobs of UUU have been scheduled.

In the Lean development these are weightedCompletion, IsOptimalSchedule, IsEdgeBiclique, maxBicliqueValue, precSG, procSG, weightSG, valSG, IsOptimalSG and vBefore in the namespace SingleMachinePrec.Biclique.

Formalization targets

Goal: Lemma 9.1 (p. 666)

If a maximum edge biclique of GGG has value an2an^2an2 with a∈(0,1]a\in(0,1]a∈(0,1], then SGS_GSG​ has an optimal schedule and every optimal schedule σ∗\sigma^*σ∗ satisfies

n2−an2(ln⁡1a+2)≤val(σ∗)≤n2−an2.n^2-an^2\Bigl(\ln\frac1a+2\Bigr)\le\mathrm{val}(\sigma^*)\le n^2-an^2 .n2−an2(lna1​+2)≤val(σ∗)≤n2−an2.

Milestones (proof of Lemma 9.1, §9, p. 666)

  1. For every edge biclique (A,B)(A,B)(A,B), a schedule in the block order U∖A→B→A→V∖BU\setminus A\to B\to A\to V\setminus BU∖A→B→A→V∖B exists, and every such schedule is feasible with
val(σ)=n2−∣A∣⋅∣B∣.\mathrm{val}(\sigma)=n^2-|A|\cdot|B| .val(σ)=n2−∣A∣⋅∣B∣.
  1. For every schedule, σ(n+1)=n\sigma(n+1)=nσ(n+1)=n and
val(σ)=∑i=1n(σ(i+1)−σ(i))i=n2−∑i=1nσ(i).\mathrm{val}(\sigma)=\sum_{i=1}^n\bigl(\sigma(i+1)-\sigma(i)\bigr)i=n^2-\sum_{i=1}^n\sigma(i).val(σ)=i=1∑n​(σ(i+1)−σ(i))i=n2−i=1∑n​σ(i).
  1. For every feasible schedule and i=1,…,ni=1,\dots,ni=1,…,n,
σ(i)(n−i+1)≤an2,σ(i)≤n.\sigma(i)(n-i+1)\le an^2,\qquad \sigma(i)\le n .σ(i)(n−i+1)≤an2,σ(i)≤n.

Significance

Lemma 9.1 shows that the optimal value of SGS_GSG​ determines the maximum edge biclique of GGG up to a factor of order ln⁡(1/a)\ln(1/a)ln(1/a) in the "area above the work line" n2−val(σ∗)n^2-\mathrm{val}(\sigma^*)n2−val(σ∗). Combined with the hardness of approximating maximum edge biclique (Theorem 9.1, cited from Ambühl, Mastrolilli and Svensson 2007) it yields Theorem 9.2: 1 ∣ prec ∣ ∑wjCj1\,|\,\mathrm{prec}\,|\,\sum w_jC_j1∣prec∣∑wj​Cj​ has no PTAS unless SAT can be decided by a probabilistic algorithm in time 2Nϵ2^{N^\epsilon}2Nϵ for every ϵ>0\epsilon>0ϵ>0. It also makes precise the two-dimensional Gantt chart picture of Eastman, Even and Isaacs (1964) and of Goemans and Williamson (2000), in which every point on the work line of a schedule defines an edge biclique.

The lemma is proved in the paper; it is not formalized anywhere to our knowledge. A formal proof certifies the combinatorial core of the no-PTAS result independently of the complexity-theoretic layer, and its definitions (the bipartite instance SGS_GSG​, edge bicliques, the profile σ(i)\sigma(i)σ(i)) are reusable for the gap inequality behind Theorem 9.2.

Difficulty

The upper bound is a direct computation on one explicit schedule. The lower bound is a statement about every feasible schedule, of which there are exponentially many, and it must hold with the explicit constant 222 and the factor ln⁡(1/a)\ln(1/a)ln(1/a) for every a∈(0,1]a\in(0,1]a∈(0,1]. The printed argument splits the sum at i=(1−a)ni=(1-a)ni=(1−a)n and uses ⌊an⌋\lfloor an\rfloor⌊an⌋, treating ananan as an integer; for general aaa (for example n=3n=3n=3, value 222, an=2/3an=2/3an=2/3) the split point is not an integer, so the printed estimate does not apply verbatim and the constant 222 has to be re-checked for non-integral ananan. On the formal side, the value identity requires relating completion times in a list to counting UUU-jobs before each VVV-job, with ties among zero-length jobs.

Formalization scope

Jobs are the disjoint union U ⊕ V of two finite types with Fintype.card U = Fintype.card V = n; EEE is a relation U → V → Prop. A schedule is a duplicate-free list containing every job; feasibility is the published LawlerPrec.MinMax.IsFeasible and completion times are the published MooreLateJobs.Shared.completionTime (time 000 start, no idle time). Processing times and weights are reals, here in {0,1}\{0,1\}{0,1}. The maximum edge biclique value is the maximum of ∣A∣⋅∣B∣|A|\cdot|B|∣A∣⋅∣B∣ over all edge bicliques, the empty ones included, so the hypothesis a>0a>0a>0 means E≠∅E\ne\emptysetE=∅. The logarithm is natural (Real.log).

Conventions and readings committed to:

  • The goal is stated for every optimal schedule, and the existence of an optimal schedule is a separate conclusion, so the bounds cannot hold vacuously. Proving the bounds for one particular schedule, or for an optimal value defined as an infimum that could be a junk default, would not be this lemma.
  • No integrality hypothesis on ananan is added.
  • Milestones 2 and 3 are stated for every schedule (respectively every feasible schedule), not only for σ∗\sigma^*σ∗; milestone 1 states the value of the block-order schedule as an equality, where the paper writes "≤⋯=\le\cdots=≤⋯=".
  • The paper's P=(U×V)∖EP=(U\times V)\setminus EP=(U×V)∖E is irreflexive; feasibility only constrains distinct jobs, so it agrees with the reflexive partial order of §1.

Not formalized: Theorem 9.1 (cited hardness of maximum edge biclique) and Theorem 9.2 (no PTAS under a complexity assumption); no polynomial-time or complexity-theoretic statement appears in the mission. Contributions welcome: proofs of the three milestones and of the goal; Mathlib's bounds on harmonic numbers (Mathlib/NumberTheory/Harmonic/Bounds.lean) are the relevant library.

Selected references

  • C. Ambühl, M. Mastrolilli, N. Mutsanas, O. Svensson, On the Approximability of Single-Machine Scheduling with Precedence Constraints, Mathematics of Operations Research 36(4):653–669, 2011. https://doi.org/10.1287/moor.1110.0512
  • C. Ambühl, M. Mastrolilli, O. Svensson, Inapproximability results for sparsest cut, optimal linear arrangement, and precedence constraint scheduling, Proc. 48th IEEE FOCS, 329–337, 2007 (reference [4] of the paper).
  • W. L. Eastman, S. Even, I. M. Isaacs, Bounds for the optimal scheduling of n jobs on m processors, Management Science 11(2):268–279, 1964 (reference [11]).
  • M. X. Goemans, D. P. Williamson, Two-dimensional Gantt charts and a scheduling algorithm of Lawler, SIAM J. Discrete Math. 13(3):281–294, 2000 (reference [15]).
  • P. Schuurman, G. J. Woeginger, Polynomial time approximation algorithms for machine scheduling: ten open problems, J. Scheduling 2(5):203–213, 1999 (reference [36]).
8 thms2 active usersReviewed
🏆Completed
CombinatoricsGraph TheoryOperations Research·Captain: mikedeng1

On the Approximability of Single-Machine Scheduling with Precedence Constraints 4: Vertex Cover in Connected Graphs of Degree ≤ 3 Reduces to Weighted Vertex Cover for Interval-Order InstancesResearch Paper

Motivation

In the single-machine scheduling problem 1∣prec∣∑wjCj1|\mathrm{prec}|\sum w_jC_j1∣prec∣∑wj​Cj​, a set NNN of nnn jobs, each with a processing time pj≥0p_j\ge 0pj​≥0 and a weight wj≥0w_j\ge 0wj​≥0, is processed on one machine without interruption, subject to precedence constraints given by a partial order PPP on NNN. The aim is to minimize the weighted sum of completion times ∑jwjCj\sum_j w_jC_j∑j​wj​Cj​. The problem is strongly NP-hard for general precedence constraints (Lawler 1978; Lenstra and Rinnooy Kan 1978), and its approximability was a recurring open question in scheduling theory (Schuurman and Woeginger 1999).

A line of work by Chudak and Hochbaum, Correa and Schulz, and Ambühl and Mastrolilli showed that the problem is a special case of minimum weighted vertex cover in a graph GPSG^S_PGPS​ built from the instance. Many problems on partial orders become polynomial when the order is an interval order, so it is natural to ask whether this one does too. Section 7 of Ambühl, Mastrolilli, Mutsanas and Svensson (Math. Oper. Res. 2011) answers no: the problem stays NP-hard on interval orders. The proof is a reduction from vertex cover in connected graphs of maximum degree 3. This mission formalizes the correctness of that reduction.

Setting

A poset P=(N,P)P=(N,P)P=(N,P) is read as a reflexive relation: (x,y)∈P(x,y)\in P(x,y)∈P means x≤yx\le yx≤y. Jobs x,yx,yx,y are incomparable if neither (x,y)(x,y)(x,y) nor (y,x)(y,x)(y,x) is in PPP, and inc⁡(P)\operatorname{inc}(P)inc(P) is the set of ordered incomparable pairs. The vertex cover graph GPSG^S_PGPS​ has one node (i,j)(i,j)(i,j) for each incomparable pair, weighted piwjp_iw_jpi​wj​. Two nodes (i,j)(i,j)(i,j) and (k,ℓ)(k,\ell)(k,ℓ) are adjacent if j=kj=kj=k and i=ℓi=\elli=ℓ, or j=kj=kj=k and (i,ℓ)∈P(i,\ell)\in P(i,ℓ)∈P, or (i,ℓ)∈P(i,\ell)\in P(i,ℓ)∈P and (k,j)∈P(k,j)\in P(k,j)∈P. Write w(CI)w(C_I)w(CI​) for the minimum weight of a vertex cover of GISG^S_IGIS​.

A poset is an interval order if each element xxx can be assigned a closed real interval [ax,bx][a_x,b_x][ax​,bx​] such that x<yx<yx<y if and only if bx<ayb_x<a_ybx​<ay​.

The reduction starts from a graph G=(V,E)G=(V,E)G=(V,E) with vertices v1,…,vNv_1,\dots,v_Nv1​,…,vN​ and a spanning tree T=(V,ET)T=(V,E_T)T=(V,ET​) rooted at v1v_1v1​, numbered so that each parent comes before its children. The paper uses a breadth-first search tree.

  • Stage 1. The graph G′G'G′ is built from TTT. Each viv_ivi​ gets a pendant path vi−u1i−u2iv_i - u^i_1 - u^i_2vi​−u1i​−u2i​. Each non-tree edge {vi,vj}∈E∖ET\{v_i,v_j\}\in E\setminus E_T{vi​,vj​}∈E∖ET​ with i<ji<ji<j gets the path vi−e1ij−e2ij−u2jv_i - e^{ij}_1 - e^{ij}_2 - u^j_2vi​−e1ij​−e2ij​−u2j​. The non-tree edges themselves are not edges of G′G'G′.
  • Stage 2. The scheduling instance SSS has jobs s0s_0s0​, s1,…,sNs_1,\dots,s_Ns1​,…,sN​, m1,…,mNm_1,\dots,m_Nm1​,…,mN​, e1,…,eNe_1,\dots,e_Ne1​,…,eN​, and bijb_{ij}bij​ for each non-tree edge. Their intervals, processing times and weights are given in a table on p. 662. For example, sjs_jsj​ has interval [i,j][i,j][i,j], processing time 1/kj1/k^j1/kj and weight kik^iki, where viv_ivi​ is the parent of vjv_jvj​. The precedence constraints III are the interval order of these intervals. With nnn the number of jobs, the parameter is k=n2+1k=n^2+1k=n2+1.
  • The set DDD. It is {(s0,s1)}∪{(si,sj):vi parent of vj}∪{(si,mi),(mi,ei)}∪{(si,bij),(bij,mj)}\{(s_0,s_1)\}\cup\{(s_i,s_j): v_i \text{ parent of } v_j\}\cup\{(s_i,m_i),(m_i,e_i)\}\cup\{(s_i,b_{ij}),(b_{ij},m_j)\}{(s0​,s1​)}∪{(si​,sj​):vi​ parent of vj​}∪{(si​,mi​),(mi​,ei​)}∪{(si​,bij​),(bij​,mj​)}. The graph GI′G'_IGI′​ is the subgraph of GISG^S_IGIS​ induced by DDD.

Formalization targets

Goal: Theorem 7.1 (p. 661)

For every connected graph GGG of maximum degree at most 333, every parent-first spanning tree TTT and every m∈Nm\in\mathbb Nm∈N, the precedence constraints III of SSS form an interval order, and

G has a vertex cover of size≤m  ⟺  ⌊w(CI)⌋≤m+∣V∣+∣E∖ET∣.G \text{ has a vertex cover of size} \le m \iff \lfloor w(C_I)\rfloor \le m + |V| + |E\setminus E_T|.G has a vertex cover of size≤m⟺⌊w(CI​)⌋≤m+∣V∣+∣E∖ET​∣.

Milestones, in the order the proof uses them

  • Claim 1 (p. 662): τ(G′)=τ(G)+∣V∣+∣E∖ET∣\tau(G') = \tau(G)+|V|+|E\setminus E_T|τ(G′)=τ(G)+∣V∣+∣E∖ET​∣, where τ\tauτ is the vertex cover number.
  • Remark 7.1 (p. 662): for jobs with intervals [a,b][a,b][a,b] and [c,d][c,d][c,d] and a≤da\le da≤d, pi≤1/k⌈b⌉p_i\le 1/k^{\lceil b\rceil}pi​≤1/k⌈b⌉ and wj≤k⌈c⌉w_j\le k^{\lceil c\rceil}wj​≤k⌈c⌉. On incomparable pairs piwj∈{1}∪[0,1/k]p_iw_j\in\{1\}\cup[0,1/k]pi​wj​∈{1}∪[0,1/k]. Moreover, piwj≥kp_iw_j\ge kpi​wj​≥k forces b<cb<cb<c, and piwj=1p_iw_j=1pi​wj​=1 forces ⌈b⌉=⌈c⌉\lceil b\rceil=\lceil c\rceil⌈b⌉=⌈c⌉.
  • Claim 2 (p. 663): an incomparable pair (i,j)(i,j)(i,j) has piwj=1p_iw_j=1pi​wj​=1 if it is in DDD, and piwj≤1/kp_iw_j\le 1/kpi​wj​≤1/k otherwise.
  • Claim 3 (p. 663): GI′≅G′G'_I\cong G'GI′​≅G′.
  • §7, p. 664: with k=n2+1k=n^2+1k=n2+1, ∑(i,j)∈inc⁡(I)∖Dpiwj<1\sum_{(i,j)\in\operatorname{inc}(I)\setminus D}p_iw_j<1∑(i,j)∈inc(I)∖D​pi​wj​<1, and hence w(CI′)=⌊w(CI)⌋w(C'_I)=\lfloor w(C_I)\rfloorw(CI′​)=⌊w(CI​)⌋.

Significance

The result. Interval orders are a standard tractable class: several scheduling and order-theoretic problems that are hard in general become polynomial on them (Papadimitriou and Yannakakis 1979). Theorem 7.1 puts 1∣prec∣∑wjCj1|\mathrm{prec}|\sum w_jC_j1∣prec∣∑wj​Cj​ outside this pattern. Section 6 of the same paper shows that the problem nonetheless has a 3/23/23/2-approximation on interval orders, so hardness and approximability are separated on this class. The paper also remarks that the proof makes weighted vertex cover NP-hard to approximate within some factor r>1r>1r>1 on the graphs GISG^S_IGIS​ arising from interval orders.

Formalizing it. The theorem is proved in the paper. Nothing in this mission is open, and none of it has been machine-checked before. The work splits into the following parts:

  • a gadget argument on unweighted vertex covers (Claim 1, after Alimonti and Kann);
  • an exact case analysis of incomparable pairs in a concrete interval order (Remark 7.1, Claim 2);
  • a graph isomorphism (Claim 3);
  • a rounding argument that links weighted and unweighted optima.

The definitions of GPSG^S_PGPS​ and of minimum-weight vertex covers are shared with the other missions of this series.

Difficulty

The construction is explicit, and each step is elementary. The work is in the bookkeeping. Claim 2 requires classifying every incomparable pair of jobs, including pairs of different kinds such as (bij,sℓ)(b_{ij}, s_\ell)(bij​,sℓ​), by comparing ceilings of interval endpoints. Half-integer endpoints (mim_imi​, bijb_{ij}bij​) are exactly what separates weight-one pairs from comparable ones. Claim 3 requires checking adjacency in GISG^S_IGIS​ for all pairs of nodes of DDD in both directions. The paper writes out two cases in each direction and calls the rest similar.

Claim 1 has a direction that is not simply local. A vertex cover of G′G'G′ that misses both endpoints of a non-tree edge has to be repaired by swapping gadget vertices, and the repair must be repeated without increasing the size.

A natural first idea is to treat the light nodes (weight at most 1/k1/k1/k) as negligible one at a time. This does not suffice: the argument needs their total weight to stay below 111, which is what forces kkk to grow with n2n^2n2.

Formalization scope

  • Graph and tree. GGG is a SimpleGraph (Fin N); vertex vi+1v_{i+1}vi+1​ is i, and the root is index 0. The tree is a TreeLayout: a parent function returning none exactly at the root, with each parent of smaller index and adjacent in GGG. The statements hold for every such layout. This is stronger than the paper's breadth-first tree, and the proof uses only "parent before child".
  • Hypotheses of the goal. Connectivity and the degree bound ((G.neighborSet v).ncard ≤ 3) are kept as in the paper. They matter only for the NP-completeness of the source problem.
  • Jobs. The jobs form an inductive type with one constructor per row of the table. Their order is a PartialOrder instance: x≤yx\le yx≤y iff x=yx=yx=y or bx<ayb_x<a_ybx​<ay​. Processing times and weights are real numbers. Section 1 of the paper asks for nonnegative integers, but the instance uses 1/kj1/k^j1/kj and the formalization follows the instance as printed.
  • Constants. The constants are explicit: k=n2+1k=n^2+1k=n2+1 with nnn the cardinality of the job type, and c=∣V∣+∣E∖ET∣c=|V|+|E\setminus E_T|c=∣V∣+∣E∖ET​∣. Remark 7.1 and Claim 2 are stated for every real k>1k>1k>1.
  • Optimum values. w(CI)w(C_I)w(CI​) is a minimum over the finite family of vertex covers. Unweighted cover numbers are Mathlib's SimpleGraph.vertexCoverNum. The floor is Nat.floor, which agrees with the integer floor because w(CI)≥0w(C_I)\ge 0w(CI​)≥0.
  • Not formalized. The goal's wording ("NP-hard") is not formalized. Neither are the NP-completeness of degree-3 vertex cover (Garey, Johnson and Stockmeyer), the polynomial size of the construction, or Theorem 2.1 (cited), which turns a vertex cover of GISG^S_IGIS​ into a schedule. What is stated is the correctness of the reduction: the instance has interval-order constraints, and its optimum decides the vertex cover question.
  • No trivialization. The instance SSS is built from GGG and TTT exactly as in the table. The goal quantifies over all graphs and layouts, never over an instance SSS assumed to have the properties.
  • Contributions. Contributions are welcome on any milestone. Claims 1 and 3 are independent of the weights, and Claim 2 is independent of the graph theory.

Selected references

  • C. Ambühl, M. Mastrolilli, N. Mutsanas, O. Svensson, On the Approximability of Single-Machine Scheduling with Precedence Constraints, Math. Oper. Res. 36(4):653–669, 2011. https://doi.org/10.1287/moor.1110.0512
  • C. Ambühl, M. Mastrolilli, Single machine precedence constrained scheduling is a vertex cover problem, Algorithmica 53(4):488–503, 2009. https://doi.org/10.1007/s00453-008-9251-1
  • J. R. Correa, A. S. Schulz, Single machine scheduling with precedence constraints, Math. Oper. Res. 30(4):1005–1021, 2005. https://doi.org/10.1287/moor.1050.0158
  • P. Alimonti, V. Kann, Some APX-completeness results for cubic graphs, Theoret. Comput. Sci. 237(1–2):123–134, 2000. https://doi.org/10.1016/S0304-3975(98)00158-3
  • M. R. Garey, D. S. Johnson, L. Stockmeyer, Some simplified NP-complete graph problems, Theoret. Comput. Sci. 1(3):237–267, 1976. https://doi.org/10.1016/0304-3975(76)90059-1
  • C. H. Papadimitriou, M. Yannakakis, Scheduling interval-ordered tasks, SIAM J. Comput. 8(3):405–409, 1979. https://doi.org/10.1137/0208031
10 thms2 active usersReviewed
🏆Completed
Graph TheoryOperations Research·Captain: mikedeng1

On the Approximability of Single-Machine Scheduling with Precedence Constraints 5: An r-Approximate Vertex Cover of the Variable-Cost Graph Yields an (r + ε)-Approximate Vertex Cover of GResearch Paper

Why the variable cost matters

The problem 1∣prec∣∑wjCj1|\mathrm{prec}|\sum w_jC_j1∣prec∣∑wj​Cj​ asks for an order in which to process jobs on one machine, respecting precedence constraints, so as to minimize the weighted sum of completion times. It is strongly NP-hard, and for decades the best approximation ratio known has been 222, achieved by several unrelated algorithms (LP relaxations, Sidney decompositions, primal–dual methods).

Correa and Schulz (2005) and Ambühl and Mastrolilli (2009) showed that the problem is a special case of weighted vertex cover: its objective splits into a fixed cost, the same for every feasible solution, and a variable cost, which equals the weight of a vertex cover in an auxiliary graph GPSG^S_{\mathbf P}GPS​. Approximating vertex cover in GPSG^S_{\mathbf P}GPS​ within a factor α\alphaα therefore approximates the scheduling problem within α\alphaα. Uhan observed that the classical 2-approximations owe their guarantee to the fixed cost and can be arbitrarily bad on the variable cost alone.

Section 8 of Ambühl, Mastrolilli, Mutsanas and Svensson, Math. Oper. Res. 36(4) (2011) (DOI), proves the converse: approximating the variable cost is as hard as approximating vertex cover itself. A better-than-2 algorithm for 1∣prec∣∑wjCj1|\mathrm{prec}|\sum w_jC_j1∣prec∣∑wj​Cj​ must therefore either exploit the fixed cost or improve on the best known approximation for vertex cover, a long-standing open question.

Setting

Scheduling instance. A finite set NNN of jobs, a partial order P=(N,P)\mathbf P = (N,P)P=(N,P) (reflexive; (i,j)∈P(i,j) \in P(i,j)∈P, i≠ji \ne ji=j, means iii precedes jjj), processing times pj≥0p_j \ge 0pj​≥0 and weights wj≥0w_j \ge 0wj​≥0.

Incomparable pairs. Jobs x,yx,yx,y are incomparable, x∥yx \parallel yx∥y, if neither (x,y)(x,y)(x,y) nor (y,x)(y,x)(y,x) lies in PPP. The set inc⁡(P)\operatorname{inc}(\mathbf P)inc(P) consists of the ordered pairs (x,y)(x,y)(x,y) with x∥yx \parallel yx∥y.

The vertex cover graph GPSG^S_{\mathbf P}GPS​. One node per incomparable pair (i,j)(i,j)(i,j), of weight w(i,j)=piwjw_{(i,j)} = p_i w_jw(i,j)​=pi​wj​. Distinct nodes (i,j)(i,j)(i,j) and (k,ℓ)(k,\ell)(k,ℓ) are adjacent when, in one of the two orders, j=kj=kj=k and i=ℓi=\elli=ℓ, or j=kj=kj=k and (i,ℓ)∈P(i,\ell)\in P(i,ℓ)∈P, or (i,ℓ),(k,j)∈P(i,\ell),(k,j) \in P(i,ℓ),(k,j)∈P. For a set CCC of nodes, w(C)=∑u∈Cwuw(C) = \sum_{u\in C} w_uw(C)=∑u∈C​wu​; for a vertex cover CCC this is the variable cost, and τw(GPS)\tau_w(G^S_{\mathbf P})τw​(GPS​) is its minimum over all vertex covers.

The instance S(G,k)S(G,k)S(G,k). Given a graph G=(V,E)G=(V,E)G=(V,E) with V={v1,…,vn}V = \{v_1,\dots,v_n\}V={v1​,…,vn​} and k>0k > 0k>0, the instance has jobs vi′v'_ivi′​ (processing time k−ik^{-i}k−i, weight 000) and vi′′v''_ivi′′​ (processing time 000, weight kik^{i}ki), and precedence constraints vi′<vj′′v'_i < v''_jvi′​<vj′′​ and vj′<vi′′v'_j < v''_ivj′​<vi′′​ for each edge {vi,vj}∈E\{v_i,v_j\} \in E{vi​,vj​}∈E, plus vi′<vj′′v'_i < v''_jvi′​<vj′′​ for all i<ji<ji<j. The nodes (vi′,vi′′)(v'_i, v''_i)(vi′​,vi′′​) of GPSG^S_{\mathbf P}GPS​ have weight 111 and are called heavy; all others are light. For a set CCC of nodes, CG={vi:(vi′,vi′′)∈C}C_G = \{v_i : (v'_i,v''_i)\in C\}CG​={vi​:(vi′​,vi′′​)∈C}. The vertex cover number of GGG is τ(G)\tau(G)τ(G).

Formalization targets

Goal: Theorem 8.1

For every graph GGG on nnn vertices, every r≥1r \ge 1r≥1, ε>0\varepsilon>0ε>0 and every k≥1k \ge 1k≥1 with k>n2r/εk > n^2r/\varepsilonk>n2r/ε: if CCC is a vertex cover of GPSG^S_{\mathbf P}GPS​ for S=S(G,k)S = S(G,k)S=S(G,k) with w(C)≤r τw(GPS)w(C) \le r\,\tau_w(G^S_{\mathbf P})w(C)≤rτw​(GPS​), then CGC_GCG​ is a vertex cover of GGG,

∣CG∣≤r(τ(G)+n2k),|C_G| \le r\Bigl(\tau(G) + \frac{n^2}{k}\Bigr),∣CG​∣≤r(τ(G)+kn2​),

and, when E≠∅E \ne \emptysetE=∅,

∣CG∣≤r(1+n2k)τ(G)<(r+ε) τ(G).|C_G| \le r\Bigl(1+\frac{n^2}{k}\Bigr)\tau(G) < (r+\varepsilon)\,\tau(G).∣CG​∣≤r(1+kn2​)τ(G)<(r+ε)τ(G).

The paper words the theorem as "approximating the variable cost of 1∣prec∣∑wjCj1|\mathrm{prec}|\sum w_jC_j1∣prec∣∑wj​Cj​ is as hard as approximating vertex cover"; the statement above is the mathematical content its proof establishes.

Milestones (§8, p. 664)

  1. In GPSG^S_{\mathbf P}GPS​, every heavy node has weight 111, every light node has weight at most 1/k1/k1/k, and the light nodes have total weight at most n2/kn^2/kn2/k (for k≥1k \ge 1k≥1).
  2. Heavy nodes (vi′,vi′′)(v'_i,v''_i)(vi′​,vi′′​) and (vj′,vj′′)(v'_j,v''_j)(vj′​,vj′′​) are adjacent if and only if {vi,vj}∈E\{v_i,v_j\}\in E{vi​,vj​}∈E; for k>1k>1k>1 the subgraph induced by the weight-1 nodes is isomorphic to GGG via (vi′,vi′′)↦vi(v'_i,v''_i) \mapsto v_i(vi′​,vi′′​)↦vi​.

Significance

The result. Theorem 8.1 is one half of an equivalence: by Theorem 2.1 (Correa–Schulz, Ambühl–Mastrolilli), minimizing the variable cost is a special case of weighted vertex cover; by Theorem 8.1, it is also as hard to approximate. Any hardness of approximation for vertex cover (NP-hardness of factor 1.361.361.36 by Dinur and Safra; factor 2−δ2-\delta2−δ under the unique games conjecture by Khot and Regev) transfers to the variable cost. It also explains why the known 2-approximations must rely on the fixed cost, and it frames the later result of Bansal and Khot that the full objective is hard to approximate within 2−δ2-\delta2−δ under a variant of the unique games conjecture.

Formalizing it. The theorem is proved in the paper; no machine-checked version exists. The mission produces a checked account of the reduction: the vertex cover graph of an arbitrary precedence-constrained instance, the adjacency-poset instance built from a graph, and the quantitative transfer of approximation ratios. The definition of GPSG^S_{\mathbf P}GPS​ is shared with the other missions of this series.

Difficulty

The construction is short; the care is in the bookkeeping. One must check that the precedence relation is a partial order, determine exactly which ordered pairs are incomparable, verify that two heavy nodes are adjacent only through the third clause of the adjacency rule and only when the corresponding vertices are adjacent in GGG, and bound the weights of all remaining nodes, including the many nodes of weight 000. The transfer then compares an approximate cover of GPSG^S_{\mathbf P}GPS​ with an optimal one whose heavy part comes from an optimal cover of GGG; the additive error n2/kn^2/kn2/k must be converted into a multiplicative one, which requires τ(G)≥1\tau(G)\ge 1τ(G)≥1.

A first reading of the page suggests that GPSG^S_{\mathbf P}GPS​ has at most n2n^2n2 nodes; it does not. The pairs (vi′,vj′)(v'_i,v'_j)(vi′​,vj′​) and (vi′′,vj′′)(v''_i,v''_j)(vi′′​,vj′′​) with i≠ji\ne ji=j are incomparable nodes of weight 000, so there can be up to 4n2−2n4n^2-2n4n2−2n nodes. Only nodes of positive weight are few.

Formalization scope

  • Model. Jobs form a finite type; precedence constraints are an explicit reflexive partial-order relation P : N → N → Prop. Processing times and weights are nonnegative reals. The vertex cover graph is a SimpleGraph on the subtype of incomparable ordered pairs, using the symmetric closure of the printed adjacency rule without loops. Vertex covers are Mathlib's SimpleGraph.IsVertexCover; τ(G)\tau(G)τ(G) is Mathlib's vertexCoverNum, finite for a finite graph and converted with toNat; τw(GPS)\tau_w(G^S_{\mathbf P})τw​(GPS​) is a minimum over finite vertex covers.
  • The instance. The graph is a SimpleGraph (Fin n); i : Fin n stands for vi+1v_{i+1}vi+1​, so exponents are i+1i+1i+1 and the order i<ji<ji<j is that of Fin n. Jobs are Fin n ⊕ Fin n (v′v'v′ left, v′′v''v′′ right). The parameter kkk is in R≥0\mathbb R_{\ge 0}R≥0​.
  • Added hypotheses. k≥1k \ge 1k≥1, implicit in the page ("k>n2r/εk > n^2r/\varepsilonk>n2r/ε" does not imply it when ε\varepsilonε is large, and for k<1k<1k<1 the light nodes outweigh the heavy ones). The isomorphism with GGG is stated for k>1k > 1k>1, since at k=1k=1k=1 some light nodes also have weight 111. The multiplicative bound requires E≠∅E \ne \emptysetE=∅; the additive bound holds for every graph.
  • Not formalized. The phrases "approximation algorithm", "polynomial time" and "as hard as"; the passage from vertex covers of GPSG^S_{\mathbf P}GPS​ to schedules (Theorem 2.1, cited from Correa–Schulz and Ambühl–Mastrolilli); the fixed cost. What is stated instead is the explicit map C↦CGC \mapsto C_GC↦CG​ and the ratio it achieves, r(1+n2/k)<r+εr(1+n^2/k) < r+\varepsilonr(1+n2/k)<r+ε. The false count "at most n2n^2n2 vertices" is not stated.
  • Ruled out. The goal is not a statement about an arbitrary graph or an assumed cover of GGG: it concerns the specific instance S(G,k)S(G,k)S(G,k) and every CCC that is an rrr-approximate vertex cover of its graph, and the fact that CGC_GCG​ covers GGG is a conclusion, not a hypothesis.
  • Welcome contributions. Proofs of the two milestones and of the goal; general lemmas on GPSG^S_{\mathbf P}GPS​ (weights of vertex covers, behaviour under induced subgraphs) are reusable across the series.

Selected references

  • C. Ambühl, M. Mastrolilli, N. Mutsanas, O. Svensson, On the Approximability of Single-Machine Scheduling with Precedence Constraints, Mathematics of Operations Research 36(4):653–669, 2011. https://doi.org/10.1287/moor.1110.0512
  • J. R. Correa, A. S. Schulz, Single-Machine Scheduling with Precedence Constraints, Mathematics of Operations Research 30(4):1005–1021, 2005. https://doi.org/10.1287/moor.1050.0158
  • C. Ambühl, M. Mastrolilli, Single Machine Precedence Constrained Scheduling Is a Vertex Cover Problem, Algorithmica 53(4):488–503, 2009. https://doi.org/10.1007/s00453-008-9251-6
  • I. Dinur, S. Safra, On the Hardness of Approximating Minimum Vertex Cover, Annals of Mathematics 162(1):439–485, 2005. https://doi.org/10.4007/annals.2005.162.439
  • S. Khot, O. Regev, Vertex Cover Might Be Hard to Approximate to within 2 − ε, Journal of Computer and System Sciences 74(3):335–349, 2008. https://doi.org/10.1016/j.jcss.2007.06.019
  • N. Bansal, S. Khot, Optimal Long Code Test with One Free Bit, FOCS 2009, 453–462. https://doi.org/10.1109/FOCS.2009.23
5 thms2 active usersReviewed
🏆Completed
Operations ResearchOptimization·Captain: mikedeng1

Assortment Optimisation Under a General Discrete Choice Model: A Tight Analysis of Revenue-Ordered Assortments I: Revenue-Ordered Assortments Earn OPT/(1 + ln(r_k/r_1)) Under Any Regular Choice ModelResearch Paper

Motivation

A retailer, an airline or an online platform decides which products to show a customer. Showing more is not always better: a customer who would have bought an expensive product may switch to a cheap one once it is offered. The assortment problem asks for the set of products that maximises expected revenue, given a model of how customers choose. It is a central problem of revenue management (Talluri and van Ryzin, 2004), and it is NP-hard even for mixtures of two multinomial logit models (Rusmevichientong, Shmoys, Tong and Topaloglu, 2014).

The standard heuristic in practice is revenue-ordered assortments: sort the products by price and only consider the sets consisting of the most expensive products down to some threshold. It is optimal under the multinomial logit model (Talluri and van Ryzin, 2004), but not in general. Berbeglia and Joret (arXiv:1606.01371) ask how much revenue the heuristic can lose under every reasonable choice model, and answer with guarantees that depend only on the prices.

Timeline:

  • 2004: Talluri and van Ryzin prove revenue-ordered assortments optimal under the multinomial logit model.
  • 2014: Rusmevichientong et al. show NP-hardness of the assortment problem for mixtures of logits, and prove that revenue-ordered assortments earn at least OPT/(e(1+ln⁡(rk/r1)))\mathrm{OPT}/(e(1+\ln(r_k/r_1)))OPT/(e(1+ln(rk​/r1​))) under mixed logit models.
  • 2016–2019: Berbeglia and Joret prove the guarantees 1/k1/k1/k and 1/(1+ln⁡(rk/r1))1/(1+\ln(r_k/r_1))1/(1+ln(rk​/r1​)) under any regular choice model and show them tight (arXiv v1 2016, v3 2019; Algorithmica 2020). Aouad, Farias, Levi and Segev (2018) show that under random utility models no efficient algorithm does essentially better than these ratios.

Setting

There is a finite nonempty set C\mathcal CC of products. For a choice set S⊆CS\subseteq\mathcal CS⊆C, P(x,S)\mathcal P(x,S)P(x,S) is the probability that a customer offered SSS buys product xxx, and P(0,S)=1−∑x∈SP(x,S)\mathcal P(0,S)=1-\sum_{x\in S}\mathcal P(x,S)P(0,S)=1−∑x∈S​P(x,S) is the probability that the customer buys nothing. The system P\mathcal PP is a regular discrete choice model if

  1. P(x,S)≥0\mathcal P(x,S)\ge0P(x,S)≥0 for every x∈C∪{0}x\in\mathcal C\cup\{0\}x∈C∪{0};
  2. P(x,S)=0\mathcal P(x,S)=0P(x,S)=0 whenever x∉Sx\notin Sx∈/S;
  3. ∑x∈SP(x,S)≤1\sum_{x\in S}\mathcal P(x,S)\le1∑x∈S​P(x,S)≤1;
  4. P(x,S)≥P(x,S′)\mathcal P(x,S)\ge\mathcal P(x,S')P(x,S)≥P(x,S′) whenever S⊆S′S\subseteq S'S⊆S′ and x∈S∪{0}x\in S\cup\{0\}x∈S∪{0}.

Axiom 4, regularity, says that adding products never makes a given product, or leaving without buying, more likely. Every random utility model is regular.

Each product has a positive price r(x)>0r(x)>0r(x)>0. The revenue of SSS is rev⁡(S)=∑x∈SP(x,S) r(x)\operatorname{rev}(S)=\sum_{x\in S}\mathcal P(x,S)\,r(x)rev(S)=∑x∈S​P(x,S)r(x), and OPT=max⁡S⊆Crev⁡(S)\mathrm{OPT}=\max_{S\subseteq\mathcal C}\operatorname{rev}(S)OPT=maxS⊆C​rev(S). Let 0<r1<⋯<rk0<r_1<\cdots<r_k0<r1​<⋯<rk​ be the distinct prices, so kkk counts price levels and not products, and set r0=0r_0=0r0​=0. The revenue-ordered assortments are Si={x∈C:r(x)≥ri}S_i=\{x\in\mathcal C : r(x)\ge r_i\}Si​={x∈C:r(x)≥ri​}, i=1,…,ki=1,\dots,ki=1,…,k, and the heuristic earns

RO=max⁡1≤i≤krev⁡(Si).\mathrm{RO}=\max_{1\le i\le k}\operatorname{rev}(S_i).RO=1≤i≤kmax​rev(Si​).

Formalization targets

Goal: Theorem 3.2

OPT  ≤  (∑i=1kri−ri−1ri) ROand∑i=1kri−ri−1ri  ≤  1+ln⁡rkr1.\mathrm{OPT}\;\le\;\Big(\sum_{i=1}^{k}\frac{r_i-r_{i-1}}{r_i}\Big)\,\mathrm{RO} \qquad\text{and}\qquad \sum_{i=1}^{k}\frac{r_i-r_{i-1}}{r_i}\;\le\;1+\ln\frac{r_k}{r_1}.OPT≤(i=1∑k​ri​ri​−ri−1​​)ROandi=1∑k​ri​ri​−ri−1​​≤1+lnr1​rk​​.

The goal fixes no constant beyond the paper's own quantities. Both parts are required: the sum form is the sharper bound, and the paper shows it is attained (Theorem 3.4, a later mission of this series).

Milestones

  • Lemma 2.1: ∑x∈SP(x,S)≤∑x∈S′P(x,S′)\sum_{x\in S}\mathcal P(x,S)\le\sum_{x\in S'}\mathcal P(x,S')∑x∈S​P(x,S)≤∑x∈S′​P(x,S′) for S⊆S′S\subseteq S'S⊆S′.
  • Inequality (5): rev⁡(Si)≥ri∑x∈S∗∩SiP(x,S∗)\operatorname{rev}(S_i)\ge r_i\sum_{x\in S^*\cap S_i}\mathcal P(x,S^*)rev(Si​)≥ri​∑x∈S∗∩Si​​P(x,S∗) for every S∗S^*S∗ and i∈[k]i\in[k]i∈[k].
  • Theorem 3.1: OPT≤k⋅RO\mathrm{OPT}\le k\cdot\mathrm{RO}OPT≤k⋅RO.
  • Rearrangement (proof of Theorem 3.2): rev⁡(S∗)=∑ℓ(rℓ−rℓ−1)∑x∈S∗∩SℓP(x,S∗)\operatorname{rev}(S^*)=\sum_{\ell}(r_\ell-r_{\ell-1})\sum_{x\in S^*\cap S_\ell}\mathcal P(x,S^*)rev(S∗)=∑ℓ​(rℓ​−rℓ−1​)∑x∈S∗∩Sℓ​​P(x,S∗), and rev⁡(S∗)≤∑ℓrℓ−rℓ−1rℓrev⁡(Sℓ)\operatorname{rev}(S^*)\le\sum_\ell\frac{r_\ell-r_{\ell-1}}{r_\ell}\operatorname{rev}(S_\ell)rev(S∗)≤∑ℓ​rℓ​rℓ​−rℓ−1​​rev(Sℓ​).
  • Logarithmic bound: ∑ℓ=1kaℓ−aℓ−1aℓ≤1+ln⁡(ak/a1)\sum_{\ell=1}^k\frac{a_\ell-a_{\ell-1}}{a_\ell}\le1+\ln(a_k/a_1)∑ℓ=1k​aℓ​aℓ​−aℓ−1​​≤1+ln(ak​/a1​) for 0=a0<a1<⋯<ak0=a_0<a_1<\cdots<a_k0=a0​<a1​<⋯<ak​.

Significance

The theorem shows that a pricing-only quantity controls the loss of the most common heuristic in revenue management, uniformly over all regular choice models, including every random utility model, mixtures of logits and Markov chain models. Combined with the hardness result of Aouad et al., it shows that revenue-ordered assortments achieve essentially the best ratio, as a function of kkk or of rk/r1r_k/r_1rk​/r1​, that an efficient algorithm can achieve. The same analysis transfers to the envy-free pricing and Stackelberg problems studied in the later sections of the paper.

The result is proved in the paper; to our knowledge it has no machine-checked proof. This mission produces a Lean formalization of regular choice models, the revenue-ordered heuristic and its two guarantees, on which the paper's tightness examples, the purchase-probability bound (Theorem 3.3) and the applications to pricing can build.

Difficulty

The argument is short, but two points are easy to get wrong. First, revenues of SiS_iSi​ and of an optimal S∗S^*S∗ involve choice probabilities evaluated at different sets, so the comparison must pass through S∗∩SiS^*\cap S_iS∗∩Si​, using regularity once for products and once for the no-purchase option. A model that only assumes regularity for products does not satisfy the theorem. Second, the bound runs over distinct price levels, not products, and the first summand uses the convention r0=0r_0=0r0​=0; indexing by products or dropping r0r_0r0​ gives a different quantity. The comparison of the sum with ln⁡(rk/r1)\ln(r_k/r_1)ln(rk​/r1​) is a Riemann-sum estimate for ∫dt/t\int dt/t∫dt/t and needs a real-analysis lemma not phrased this way in Mathlib.

Formalization scope

  • Products are a finite nonempty type C with decidable equality; choice sets are Finset C. The choice probabilities are P : C → Finset C → ℝ, defined on all pairs. The no-purchase option is not a product: P(0,S)\mathcal P(0,S)P(0,S) is the derived quantity noPurchase P S = 1 - ∑ x ∈ S, P x S.
  • IsRegular P carries axioms (i)–(iv), with (i) and (iv) each split into a product case and a no-purchase case. The no-purchase case of (i) is redundant with (iii) and is kept to match the page.
  • r : C → ℝ with the hypothesis ∀ x, 0 < r x. revenue P r S is rev⁡(S)\operatorname{rev}(S)rev(S) and opt P r is the maximum over all Finset C (Finset.sup'), including the empty set.
  • Price levels are 1-based: level r i is rir_iri​ for 1≤i≤k1\le i\le k1≤i≤k and level r 0 = 0; numVals r is kkk, the number of distinct values. roSet r i is SiS_iSi​; roValue P r is the maximum over i∈{1,…,k}i\in\{1,\dots,k\}i∈{1,…,k} only.
  • Approximation guarantees are stated in product form, OPT≤D⋅RO\mathrm{OPT}\le D\cdot\mathrm{RO}OPT≤D⋅RO, never as a ratio. ln⁡\lnln is Real.log, applied to rk/r1≥1r_k/r_1\ge1rk​/r1​≥1.
  • Ruled out: a maximum over all subsets in place of RO\mathrm{RO}RO (which makes the bound trivial), a regularity axiom without its no-purchase case, the logarithmic form alone in place of the sum form, and any specific choice model (logit, Markov chain, random utility) in place of an arbitrary regular P\mathcal PP.

Needed infrastructure: finite sums over price levels and summation by parts, the comparison of (b−a)/b(b-a)/b(b−a)/b with ln⁡(b/a)\ln(b/a)ln(b/a), and the sorted enumeration of a finite set of reals (Finset.orderEmbOfFin). The regular model and the revenue-ordered sets are shared with the other missions of this series. Contributions of any milestone, alternative proofs of the logarithmic bound, and proofs that specific choice models are regular are welcome.

Selected references

  • G. Berbeglia and G. Joret, Assortment Optimisation Under a General Discrete Choice Model: A Tight Analysis of Revenue-Ordered Assortments, arXiv:1606.01371v3, 2019; Algorithmica 82, 2020. https://arxiv.org/abs/1606.01371
  • K. Talluri and G. van Ryzin, Revenue Management Under a General Discrete Choice Model of Consumer Behavior, Management Science 50(1), 2004. https://doi.org/10.1287/mnsc.1030.0147
  • A. Aouad, V. Farias, R. Levi and D. Segev, The Approximability of Assortment Optimization Under Ranking Preferences, Operations Research 66(6), 2018. https://doi.org/10.1287/opre.2018.1724
  • P. Rusmevichientong, D. Shmoys, C. Tong and H. Topaloglu, Assortment Optimization under the Multinomial Logit Model with Random Choice Parameters, Production and Operations Management 23(11), 2014. https://doi.org/10.1111/poms.12191
9 thms2 active usersReviewed
CombinatoricsGraph TheoryLinear algebra·Captain: mikedeng1

Explicit Expanders of Every Degree and Size 3: Deleting Far-Apart Tree-Like Vertices of a Near-Ramanujan Graph and Matching Their Neighbours Keeps λ ≤ 2√(d−1) + εResearch Paper

Motivation

Sparse graphs with small nontrivial eigenvalues, expanders, are basic objects in combinatorics and theoretical computer science. They are used in error-correcting codes, derandomization, sorting networks, and the analysis of random walks. The Alon–Boppana bound says that a ddd-regular graph on nnn vertices has a nontrivial eigenvalue of absolute value at least 2d−1−o(1)2\sqrt{d-1}-o(1)2d−1​−o(1) (Alon 1986; Nilli 1991). Graphs that reach 2d−12\sqrt{d-1}2d−1​ are Ramanujan graphs.

The classical explicit Ramanujan graphs of Lubotzky, Phillips and Sarnak (1988) and Margulis exist only for degrees d=p+1d = p+1d=p+1 with ppp prime, and only for very sparse sequences of vertex counts. Constructions with λ≤2d−1+ε\lambda\le 2\sqrt{d-1}+\varepsilonλ≤2d−1​+ε for every degree came from Mohanty, O'Donnell and Paredes (STOC 2020, arXiv:1909.06988), but their graphs also do not have every number of vertices. Alon (arXiv:2003.11673, Combinatorica 41, 2021) asked for near-Ramanujan graphs of every degree and every large size. Theorem 1.3 of that paper answers this up to ε\varepsilonε: for every ddd, every ε>0\varepsilon>0ε>0 and every large nnn with ndndnd even there is an explicit (n,d,λ)(n,d,\lambda)(n,d,λ)-graph with λ≤2d−1+ε\lambda\le 2\sqrt{d-1}+\varepsilonλ≤2d−1​+ε.

Setting

A (n,d,λ)(n,d,\lambda)(n,d,λ)-graph is a ddd-regular simple graph on nnn vertices in which every nontrivial eigenvalue of the adjacency matrix AAA has absolute value at most λ\lambdaλ. The trivial eigenvalue is ddd, with the constant eigenvector 1\mathbf 11. Equivalently, every eigenvalue μ\muμ of AAA with an eigenvector f≠0f\ne0f=0, ∑vf(v)=0\sum_v f(v)=0∑v​f(v)=0, satisfies ∣μ∣≤λ|\mu|\le\lambda∣μ∣≤λ.

Distances dist⁡(v,w)\operatorname{dist}(v,w)dist(v,w) are graph distances, and they are ∞\infty∞ between components. The kkk-neighbourhood of a vertex vvv is B(v,k)={w:dist⁡(v,w)≤k}B(v,k)=\{w:\operatorname{dist}(v,w)\le k\}B(v,k)={w:dist(v,w)≤k}. The kkk-neighbourhood of an edge uvuvuv is B(u,k)∪B(v,k)B(u,k)\cup B(v,k)B(u,k)∪B(v,k), and NiN_iNi​ is the set of vertices at distance exactly iii from {u,v}\{u,v\}{u,v}. A set contains no cycle if the subgraph induced on it is a forest. A ball contains at most one cycle if its induced subgraph has at most as many edges as vertices.

The construction starts from a ddd-regular graph HHH on a vertex set VVV and a set U⊆VU\subseteq VU⊆V. Write N(U)N(U)N(U) for the set of neighbours of UUU, and let mmm be a perfect matching on N(U)N(U)N(U). Then H′H'H′ is the subgraph induced on V∖UV\setminus UV∖U, MMM is the graph of matching edges {x,m(x)}\{x,m(x)\}{x,m(x)}, and G=H′∪MG=H'\cup MG=H′∪M.

Formalization targets

Goal: Theorem 1.3, relative to the input graph

Let d≥3d\ge3d≥3, ε>0\varepsilon>0ε>0, r=⌈2/ε⌉r=\lceil 2/\varepsilon\rceilr=⌈2/ε⌉. Suppose HHH is an (N,d,2d−1+ε/2)(N,d,2\sqrt{d-1}+\varepsilon/2)(N,d,2d−1​+ε/2)-graph in which the (2r+4)(2r+4)(2r+4)-neighbourhood of every vertex contains at most one cycle, and r≤log⁡d−1Nr\le\log_{d-1}Nr≤logd−1​N. Then for every uuu with ududud even and u≤N/(2d2r+3)u\le N/(2d^{2r+3})u≤N/(2d2r+3),

∃ G on N−u vertices:G is an (N−u, d, 2d−1+ε)-graph.\exists\, G \text{ on } N-u \text{ vertices}:\quad G \text{ is an } \bigl(N-u,\ d,\ 2\sqrt{d-1}+\varepsilon\bigr)\text{-graph}.∃G on N−u vertices:G is an (N−u, d, 2d−1​+ε)-graph.

The hypotheses on HHH are what Theorem 3.3 (Mohanty–O'Donnell–Paredes) supplies, and that theorem is not formalized.

Milestones

  • Lemma 3.1 (p. 10). A ddd-regular graph whose (2r+4)(2r+4)(2r+4)-balls contain at most one cycle has a set UUU with ∣U∣≥n/(2d2r+3)|U|\ge n/(2d^{2r+3})∣U∣≥n/(2d2r+3), cycle-free (r+1)(r+1)(r+1)-balls, and pairwise distances ≥2r+3\ge 2r+3≥2r+3.
  • Lemma 3.2 (p. 11). If the rrr-neighbourhood of an edge uvuvuv contains no cycle and Af=μfA f=\mu fAf=μf with μ≥2d−1\mu\ge2\sqrt{d-1}μ≥2d−1​, then
∑w∈Nif2(w) ≥ ∑w∈Ni−1f2(w),1≤i≤r.\sum_{w\in N_i}f^2(w)\ \ge\ \sum_{w\in N_{i-1}}f^2(w),\qquad 1\le i\le r .w∈Ni​∑​f2(w) ≥ w∈Ni−1​∑​f2(w),1≤i≤r.
  • The variational characterization of nontrivial eigenvalues (§2.4, p. 8).
  • In G=H′∪MG=H'\cup MG=H′∪M: GGG is ddd-regular on ∣V∣−∣U∣|V|-|U|∣V∣−∣U∣ vertices and AG=AH′+AMA_G=A_{H'}+A_MAG​=AH′​+AM​. Matching edges have cycle-free (r−1)(r-1)(r−1)-neighbourhoods and pairwise disjoint rrr-neighbourhoods.
  • Inequalities (9), (10), (11) (p. 13), and the spectral step: for every admissible UUU and mmm, GGG is an (N−∣U∣,d,2d−1+ε)(N-|U|,d,2\sqrt{d-1}+\varepsilon)(N−∣U∣,d,2d−1​+ε)-graph.

Significance

Theorem 1.3 shows that the size restrictions of algebraic Ramanujan constructions cost nothing spectrally: up to an arbitrarily small ε\varepsilonε, the Alon–Boppana bound is attained by explicit graphs on every admissible vertex count. The deletion method is local. It turns any near-Ramanujan graph whose short cycles are sparse into graphs of all nearby sizes, so it applies to future constructions as well. Lemma 3.2 is a self-contained delocalization statement in the tradition of Kahale 1995: eigenvectors of eigenvalues at least 2d−12\sqrt{d-1}2d−1​ in absolute value cannot concentrate near tree-like edges.

The result is proved on paper. To our knowledge none of it is formalized; Mathlib has adjacency matrices, extended graph distance and acyclicity, but no theory of expanders. A complete development would give machine-checked versions of a delocalization lemma, of the greedy selection of far-apart vertices away from short cycles, and of the variational eigenvalue bound for induced subgraphs. It would also check two points the paper passes over. The proof of Theorem 1.3 treats only positive eigenvalues λ≥2d−1\lambda\ge2\sqrt{d-1}λ≥2d−1​. And its claim that the rrr-neighbourhood of a matching edge is cycle-free fails when two deleted vertices are at distance exactly 2r+32r+32r+3. This mission states the corrected forms (see Formalization scope).

Difficulty

The spectral bound for GGG does not follow from interlacing alone. Deleting vertices is harmless, since by (9) the quadratic form of H′H'H′ is controlled by HHH. But the added matching contributes up to ∑x∈N(U)f(x)2\sum_{x\in N(U)}f(x)^2∑x∈N(U)​f(x)2 to ftAGff^tA_GfftAG​f, which can be as large as ∥f∥2\|f\|^2∥f∥2 for an eigenvector concentrated on N(U)N(U)N(U). The obvious estimate therefore gives only λ≤2d−1+1+ε/2\lambda\le 2\sqrt{d-1}+1+\varepsilon/2λ≤2d−1​+1+ε/2. Closing the gap requires showing that an eigenvector of a large eigenvalue spreads its mass over the rrr layers around each matching edge (Lemma 3.2). That in turn needs those neighbourhoods to be trees in GGG and pairwise disjoint, which is where Lemma 3.1's choice of UUU is used. The combinatorial part, tracking distances and cycles in GGG when GGG mixes edges of HHH with matching edges, is the main formalization burden.

Formalization scope

  • Representation. Vertex sets are finite types. Graphs are Mathlib SimpleGraphs with real adjacency matrices adjMatrix ℝ. The (n, d, λ) predicate requires IsRegularOfDegree d, symmetry, row sums ddd, and ∣μ∣≤λ|\mu|\le\lambda∣μ∣≤λ for every eigenpair (μ,f)(\mu,f)(μ,f) with f≠0f\ne0f=0, ∑f=0\sum f=0∑f=0. Distances use the extended SimpleGraph.edist, never dist (which is 000 across components). Cycle conditions are on induced subgraphs, and "at most one cycle" on a ball is ∣E∣≤∣V∣|E|\le|V|∣E∣≤∣V∣. Deleted vertices are a Finset U; the new graph lives on the subtype {v // v ∉ U}. The matching is a fixed-point-free involution of N(U)N(U)N(U).
  • Explicit quantities replacing the paper's asymptotics. The paper writes "sufficiently large nnn" and u=o(n)u=o(n)u=o(n). The goal instead takes any u≤N/(2d2r+3)u\le N/(2d^{2r+3})u≤N/(2d2r+3) (the size Lemma 3.1 guarantees) with ududud even, plus Lemma 3.1's side condition r≤log⁡d−1Nr\le\log_{d-1}Nr≤logd−1​N. The equality r=⌈2/ε⌉r=\lceil2/\varepsilon\rceilr=⌈2/ε⌉ is used as ⌈2/ε⌉+∈N\lceil2/\varepsilon\rceil_+\in\mathbb N⌈2/ε⌉+​∈N. The paper's "every degree ddd" becomes d≥3d\ge3d≥3, the range of its proof.
  • Corrections. (11) and Lemma 3.2's companion are stated for ∣μ∣≥2d−1|\mu|\ge2\sqrt{d-1}∣μ∣≥2d−1​, both signs. The matching-edge note is stated for the (r−1)(r-1)(r−1)-neighbourhood, which still yields the factor 1/r1/r1/r in (11). Lemma 3.2 itself is stated as printed.
  • Out of scope. Theorem 3.3 ([18]) is a cited input: its graph is the hypothesis HHH. All claims of explicitness and polynomial running time are out of scope, as is §4's remark on applying the method to LPS graphs directly.
  • No trivialization. The input hypotheses are exactly Theorem 3.3's conclusions plus Lemma 3.1's side condition, and they are met by high-girth Ramanujan graphs. No hypothesis mentions the spectrum or Rayleigh quotients of the constructed graph, and the goal's graph must be ddd-regular on exactly N−uN-uN−u vertices.
  • Reusable infrastructure. Welcome contributions include the variational characterization for symmetric matrices with constant row sums, a forest edge-count lemma for balls, BFS-layer structure of cycle-free balls in regular graphs, and the edge-disjoint decomposition AG=AH′+AMA_{G}=A_{H'}+A_MAG​=AH′​+AM​. Each is useful beyond this mission.

Selected references

  • N. Alon, Explicit expanders of every degree and size, arXiv:2003.11673v1, 2020; Combinatorica 41 (2021). https://arxiv.org/abs/2003.11673
  • S. Mohanty, R. O'Donnell, P. Paredes, Explicit near-Ramanujan graphs of every degree, STOC 2020. https://arxiv.org/abs/1909.06988
  • A. Lubotzky, R. Phillips, P. Sarnak, Ramanujan graphs, Combinatorica 8 (1988). https://doi.org/10.1007/BF02126799
  • N. Alon, Eigenvalues and expanders, Combinatorica 6 (1986). https://doi.org/10.1007/BF02579166
  • A. Nilli, On the second eigenvalue of a graph, Discrete Mathematics 91 (1991). https://doi.org/10.1016/0012-365X(91)90112-F
  • N. Kahale, Eigenvalues and expansion of regular graphs, J. ACM 42 (1995). https://doi.org/10.1145/210118.210136
13 thms2 active usersReviewed
🏆Completed
CombinatoricsGraph TheoryLinear algebra·Captain: mikedeng1

Explicit Expanders of Every Degree and Size 2: Attaching New Vertices to a (p+1)-Regular Ramanujan Graph and Adding Loops Keeps Every Nontrivial Eigenvalue at Most √(2(p+1)) + √p + o(1)Research Paper

Motivation

Sparse graphs whose adjacency spectrum is concentrated near zero, expanders, are used throughout theoretical computer science: in error-correcting codes, derandomization, sorting and routing networks, and the construction of pseudorandom objects (Hoory, Linial and Wigderson, survey). The best possible spectral expansion for a ddd-regular graph is governed by the Alon–Boppana bound 2d−12\sqrt{d-1}2d−1​, and graphs attaining it, Ramanujan graphs, were constructed explicitly by Lubotzky, Phillips and Sarnak (LPS 1988) and by Margulis. These constructions exist only for special degrees (d=p+1d = p+1d=p+1 with ppp prime) and special numbers of vertices (orders of PSL(2,Fq)PSL(2,\mathbb F_q)PSL(2,Fq​) or SL(2,Fq)SL(2,\mathbb F_q)SL(2,Fq​)). Applications often need a graph of a prescribed size nnn.

N. Alon's paper Explicit expanders of every degree and size (arXiv:2003.11673v1; Combinatorica 41, 2021) shows how to obtain explicit near-Ramanujan graphs on exactly nnn vertices. This mission formalizes the spectral core of its Theorem 1.2: a Ramanujan graph on mmm vertices can be enlarged to n=m+rn = m + rn=m+r vertices, with degree raised by one, while the nontrivial eigenvalues stay within a constant factor of optimal.

Setting

Let VVV be a finite set of m≥1m \ge 1m≥1 vertices. A (n,d,λ)(n,d,\lambda)(n,d,λ)-graph is a ddd-regular graph on nnn vertices whose adjacency matrix AAA satisfies ∣μ∣≤λ|\mu| \le \lambda∣μ∣≤λ for every nontrivial eigenvalue μ\muμ, that is, every eigenvalue other than the top eigenvalue ddd of the constant vector 1\mathbf 11. For a symmetric AAA with A1=d 1A\mathbf 1 = d\,\mathbf 1A1=d1, the nontrivial eigenvalues are those with an eigenvector f≠0f \ne 0f=0 satisfying ∑vf(v)=0\sum_v f(v) = 0∑v​f(v)=0. Graphs may carry loops, at most one per vertex, and a loop adds one to the degree: it is a diagonal entry 111 of AAA.

Fix an integer p≥0p \ge 0p≥0 and let HHH be an (m,p+1,2p)(m, p+1, 2\sqrt p)(m,p+1,2p​)-graph on VVV, a (p+1)(p+1)(p+1)-regular Ramanujan graph. Let R={u1,…,ur}R = \{u_1, \dots, u_r\}R={u1​,…,ur​} be rrr new vertices and let W1,…,Wr⊆VW_1, \dots, W_r \subseteq VW1​,…,Wr​⊆V be pairwise disjoint sets of p+2p+2p+2 vertices each. Put W=⋃iWiW = \bigcup_i W_iW=⋃i​Wi​ and L=V∖WL = V \setminus WL=V∖W. The graph GGG on U=V∪RU = V \cup RU=V∪R is obtained from HHH by joining each uiu_iui​ to every vertex of WiW_iWi​ and adding one loop at each vertex of LLL. Its adjacency matrix is

AG=AH+AR+AL,A_G = A_H + A_R + A_L,AG​=AH​+AR​+AL​,

where AHA_HAH​ is the adjacency matrix of HHH (zero on RRR), ARA_RAR​ that of the stars joining uiu_iui​ to WiW_iWi​, and ALA_LAL​ the diagonal matrix of the loops. Every vertex of GGG has degree p+2p+2p+2.

Formalization targets

Goal: Theorem 1.2, spectral core

AG is an (m+r,  p+2,  2(p+1)+p+(p+1) rm) matrix.A_G \text{ is an } \Big(m+r,\; p+2,\; \sqrt{2(p+1)} + \sqrt p + \frac{(p+1)\,r}{m}\Big)\text{ matrix.}AG​ is an (m+r,p+2,2(p+1)​+p​+m(p+1)r​) matrix.

The paper states λ≤2(d−1)+d−1+o(1)\lambda \le \sqrt{2(d-1)} + \sqrt{d-1} + o(1)λ≤2(d−1)​+d−1​+o(1) for d=p+2d = p+2d=p+2; its proof gives 2(p+1)+p+o(1)\sqrt{2(p+1)} + \sqrt p + o(1)2(p+1)​+p​+o(1), which is stronger, and the error term it produces is (p+1)r/m(p+1)r/m(p+1)r/m. The goal is parametrised by HHH, rrr and the sets WiW_iWi​, so it does not depend on how mmm and rrr are chosen.

Milestones

  1. The variational characterization of the nontrivial eigenvalues: for a symmetric matrix with constant row sums and λ≥0\lambda \ge 0λ≥0, ∣μ∣≤λ|\mu| \le \lambda∣μ∣≤λ for every nontrivial eigenvalue if and only if ∣ftAf∣≤λ∥f∥2|f^tAf| \le \lambda\|f\|^2∣ftAf∣≤λ∥f∥2 whenever ∑f=0\sum f = 0∑f=0.
  2. The Cauchy–Schwarz display: ∑Uf=0\sum_U f = 0∑U​f=0 implies ∣∑Vf∣2=∣∑Rf∣2≤∣R∣∑Rf2|\sum_V f|^2 = |\sum_R f|^2 \le |R| \sum_R f^2∣∑V​f∣2=∣∑R​f∣2≤∣R∣∑R​f2.
  3. Inequality (3): ∣ftAHf∣≤b2(p+1)+c2 2p|f^tA_Hf| \le b^2(p+1) + c^2\, 2\sqrt p∣ftAH​f∣≤b2(p+1)+c22p​ with b2=(∑Vf)2/mb^2 = (\sum_V f)^2/mb2=(∑V​f)2/m and c2=∑Vf2−b2c^2 = \sum_V f^2 - b^2c2=∑V​f2−b2.
  4. Display (4): ftALf=∑v∈Lf2(v)f^tA_Lf = \sum_{v\in L} f^2(v)ftAL​f=∑v∈L​f2(v).
  5. Inequality (5): ∣ftARf∣≤p+2x∑Rf2+x∑Wf2|f^tA_Rf| \le \frac{p+2}{x}\sum_R f^2 + x\sum_W f^2∣ftAR​f∣≤xp+2​∑R​f2+x∑W​f2 for every x>0x > 0x>0.
  6. Inequality (6): for ∑Uf=0\sum_U f = 0∑U​f=0 and x>0x > 0x>0,
∣ftAGf∣≤(2p+1)∑Lf2+(2p+x)∑Wf2+p+2x∑Rf2+(p+1)rm∑Rf2.|f^tA_Gf| \le (2\sqrt p+1)\sum_L f^2 + (2\sqrt p+x)\sum_W f^2 + \frac{p+2}{x}\sum_R f^2 + (p+1)\frac rm \sum_R f^2.∣ftAG​f∣≤(2p​+1)L∑​f2+(2p​+x)W∑​f2+xp+2​R∑​f2+(p+1)mr​R∑​f2.

Significance

With HHH the Lubotzky–Phillips–Sarnak graph on m=∣SL(2,Fq)∣m = |SL(2,\mathbb F_q)|m=∣SL(2,Fq​)∣ vertices for the largest suitable prime qqq with m≤nm \le nm≤n, and r=n−mr = n - mr=n−m, the distribution of primes in arithmetic progressions gives r=o(m)r = o(m)r=o(m), and the goal yields an explicit (n,p+2,λ)(n, p+2, \lambda)(n,p+2,λ)-graph with λ≤(1+2)d−1+o(1)\lambda \le (1+\sqrt2)\sqrt{d-1} + o(1)λ≤(1+2​)d−1​+o(1) for every sufficiently large nnn. This is within a factor of about 1.211.211.21 of the Ramanujan bound 2d−12\sqrt{d-1}2d−1​, for every number of vertices, by an elementary modification of an existing graph. The statement is useful independently of LPS: any Ramanujan graph, or any graph with a bound on its nontrivial eigenvalues, can be padded to a nearby size in the same way.

The result is proved in the paper. No formalization of it, of the (n,d,λ)(n,d,\lambda)(n,d,λ) notion, or of the variational characterization of nontrivial eigenvalues for regular graphs exists on the platform. The mission produces a checked version of the spectral argument, and the variational characterization (milestone 1) is a general fact about symmetric matrices with constant row sums that applies to any spectral expander argument.

Difficulty

The vertices of WWW and LLL lie in the old graph HHH, whose spectrum is controlled, but the new vertices of RRR are not; and a vector orthogonal to 1\mathbf 11 on UUU need not be orthogonal to the constant vector on VVV. Bounding ftAGff^tA_GfftAG​f by applying the Ramanujan bound for HHH to fff restricted to VVV therefore fails: the restriction has a component along the trivial eigenvector of HHH, whose eigenvalue p+1p+1p+1 is large. The argument must show that this component is small, of order r/mr/mr/m, and must balance the star edges between RRR and WWW against the loops on LLL so that every vertex class gets the same coefficient. The naive bound ∣ftARf∣≤∥AR∥ ∥f∥2=p+2 ∥f∥2|f^tA_Rf| \le \|A_R\|\,\|f\|^2 = \sqrt{p+2}\,\|f\|^2∣ftAR​f∣≤∥AR​∥∥f∥2=p+2​∥f∥2 added to 2p2\sqrt p2p​ for HHH and 111 for LLL gives a constant larger than 2(p+1)+p\sqrt{2(p+1)}+\sqrt p2(p+1)​+p​; the stated constant needs the weighted estimate.

On the Lean side, milestone 1 concerns the spectrum of a symmetric matrix on the invariant subspace 1⊥\mathbf 1^\perp1⊥, while Mathlib states the spectral theorem for the whole space.

Formalization scope

  • Vertices of GGG are the disjoint union V⊕Fin rV \oplus \mathrm{Fin}\, rV⊕Finr. GGG is represented by its real adjacency matrix, since it has loops; HHH is a Mathlib SimpleGraph with adjMatrix.
  • The (n,d,λ)(n,d,\lambda)(n,d,λ) predicate is stated for matrices: ∣V∣=n|V| = n∣V∣=n, symmetry, A1=d 1A\mathbf 1 = d\,\mathbf 1A1=d1, and ∣μ∣≤λ|\mu| \le \lambda∣μ∣≤λ for every eigenpair (μ,f)(\mu, f)(μ,f) with f≠0f \ne 0f=0 and ∑f=0\sum f = 0∑f=0. For simple graphs, ddd-regularity is added.
  • The paper's o(1)o(1)o(1) terms are replaced by the explicit quantities its proof produces: (p+1)r/m(p+1)r/m(p+1)r/m in the goal, and (p+1)rm∑Rf2(p+1)\frac rm\sum_R f^2(p+1)mr​∑R​f2 in (6). Inequality (3) is stated with the corrected relation b2+c2=∑Vf2b^2 + c^2 = \sum_V f^2b2+c2=∑V​f2; the paper's "b2+c2=1b^2 + c^2 = 1b2+c2=1" holds only for unit restrictions.
  • The bound uses p=d−2\sqrt p = \sqrt{d-2}p​=d−2​, as in the proof and the abstract, which implies the printed d−1\sqrt{d-1}d−1​.
  • ppp is any natural number. The hypothesis "ppp prime, p≡1(mod4)p \equiv 1 \pmod 4p≡1(mod4)" serves only to obtain HHH from LPS, and HHH is a hypothesis here. The sets WiW_iWi​ are arbitrary pairwise disjoint sets of size p+2p+2p+2, not the paper's consecutive blocks of a numbering of SL(2,Fq)SL(2,\mathbb F_q)SL(2,Fq​).
  • Out of scope: the existence of the prime qqq and the estimate n−m=o(m)n - m = o(m)n−m=o(m); the numbering of SL(2,Fq)SL(2,\mathbb F_q)SL(2,Fq​); the "strongly explicit" and polynomial-time claims; the LPS construction (Theorem 2.1, cited); the variant that replaces loops by a matching for even nnn.
  • The goal cannot be satisfied trivially: dropping the condition ∑f=0\sum f = 0∑f=0 makes it false, since p+2p+2p+2 is always an eigenvalue, and for p≥2p \ge 2p≥2 and small r/mr/mr/m the bound is below p+2p + 2p+2 (for p=5p = 5p=5 it is about 5.70+6r/m5.70 + 6r/m5.70+6r/m). At p=1p = 1p=1 the bound 3+2r/m3 + 2r/m3+2r/m is at least the degree 333, so that case holds trivially; it is the paper's statement there as well.
  • Contributions welcome: proofs of each milestone, especially the variational characterization, which is reusable for mission 3 of this series and for any regular-graph spectral argument.

Selected references

  • N. Alon, Explicit expanders of every degree and size, arXiv:2003.11673v1, 2020; Combinatorica 41 (2021). https://arxiv.org/abs/2003.11673
  • A. Lubotzky, R. Phillips, P. Sarnak, Ramanujan graphs, Combinatorica 8 (1988) 261–277. https://doi.org/10.1007/BF02126799
  • S. Hoory, N. Linial, A. Wigderson, Expander graphs and their applications, Bull. AMS 43 (2006) 439–561. https://doi.org/10.1090/S0273-0979-06-01126-8
9 thms2 active usersReviewed
🏆Completed
Linear OptimizationOperations ResearchOptimization+1·Captain: mikedeng1

Solving Linear Programs in the Current Matrix Multiplication Time: The Stochastic Central Path Falls Back to a Classical Step with Probability at Most 10/n² per IterationResearch Paper

Motivation

Linear programming, min⁡{c⊤x:Ax=b, x≥0}\min\{c^\top x : Ax=b,\ x\ge0\}min{c⊤x:Ax=b, x≥0} with A∈Rd×nA\in\mathbb R^{d\times n}A∈Rd×n, is the basic model of operations research, and the complexity of solving it is a central question of algorithm theory. Interior-point methods follow the central path: primal–dual pairs (x,s)(x,s)(x,s) with x,s>0x,s>0x,s>0 and xisi=tx_is_i=txi​si​=t for every iii, as the path parameter ttt decreases to 000. A classical short-step method needs O(nlog⁡(n/δ))O(\sqrt n\log(n/\delta))O(n​log(n/δ)) iterations, each solving a linear system with the matrix AXSA⊤A\frac XSA^\topASX​A⊤, for a total of roughly n2.5n^{2.5}n2.5 operations or more.

Cohen, Lee and Song (J. ACM 68(1), 2021; arXiv:1810.07896) showed that linear programs can be solved in time nω+o(1)log⁡(n/δ)n^{\omega+o(1)}\log(n/\delta)nω+o(1)log(n/δ) (for the current values of the matrix multiplication exponent ω\omegaω and its dual α\alphaα), matching the cost of multiplying two n×nn\times nn×n matrices. The analysis has two halves: a data structure that maintains the projection matrix lazily, and the stochastic central path method, which replaces each Newton step by a sparse random step and proves that the iterates still stay close to the central path. This mission formalizes the second half.

Timeline: Karmarkar's projective method (1984) gave the first polynomial interior-point method; Renegar (1988) gave the O(nlog⁡(1/δ))O(\sqrt n\log(1/\delta))O(n​log(1/δ)) path-following bound; Vaidya (1989) reduced the per-iteration cost with low-rank updates; Lee and Sidford (2014–2015) reduced the iteration count to O~(d)\widetilde O(\sqrt d)O(d​); Cohen, Lee and Song (STOC 2019, J. ACM 2021) reached nωn^\omeganω; van den Brand (2020) derandomized the result.

Setting

Vectors are in Rn\mathbb R^nRn and products, quotients and roots of vectors are coordinatewise. For ϵ\epsilonϵ and vectors a,ba,ba,b, a≈ϵba\approx_\epsilon ba≈ϵ​b means (1−ϵ)bi≤ai≤(1+ϵ)bi(1-\epsilon)b_i\le a_i\le(1+\epsilon)b_i(1−ϵ)bi​≤ai​≤(1+ϵ)bi​ for all iii; a≈ϵta\approx_\epsilon ta≈ϵ​t for a scalar ttt is defined likewise. The number of variables is n≥10n\ge10n≥10 and AAA has full row rank d≤nd\le nd≤n.

The potential is Φλ(r)=∑i=1ncosh⁡(λri)\Phi_\lambda(r)=\sum_{i=1}^n\cosh(\lambda r_i)Φλ​(r)=∑i=1n​cosh(λri​), evaluated at r=μ/t−1r=\mu/t-1r=μ/t−1 with μ=xs\mu=xsμ=xs; it is small exactly when every xisix_is_ixi​si​ is close to ttt.

StochasticStep (Algorithm 1) takes positive x,sx,sx,s, a direction δμ\delta_\muδμ​, a sampling parameter kkk and the output v~\widetilde vv of a data structure with x/s≈ϵmpv~x/s\approx_{\epsilon_{\mathrm{mp}}}\widetilde vx/s≈ϵmp​​v. It rescales to x‾=xv~/w\overline x=x\sqrt{\widetilde v/w}x=xv/w​, s‾=sw/v~\overline s=s\sqrt{w/\widetilde v}s=sw/v​ (w=x/sw=x/sw=x/s), draws a sparse vector δ~μ\widetilde\delta_\muδμ​ with independent coordinates, δ~μ,i=δμ,i/pi\widetilde\delta_{\mu,i}=\delta_{\mu,i}/p_iδμ,i​=δμ,i​/pi​ with probability pi=min⁡(1,k(δμ,i2/∥δμ∥22+1/n))p_i=\min(1,k(\delta_{\mu,i}^2/\|\delta_\mu\|_2^2+1/n))pi​=min(1,k(δμ,i2​/∥δμ​∥22​+1/n)) and 000 otherwise, and computes the step (δ~x,δ~s)(\widetilde\delta_x,\widetilde\delta_s)(δx​,δs​) through the projection P‾=X‾/S‾A⊤(AX‾S‾A⊤)−1AX‾/S‾\overline P=\sqrt{\overline X/\overline S}A^\top(A\frac{\overline X}{\overline S}A^\top)^{-1}A\sqrt{\overline X/\overline S}P=X/S​A⊤(ASX​A⊤)−1AX/S​. The draw is repeated until ∥s‾−1δ~s∥∞\|\overline s^{-1}\widetilde\delta_s\|_\infty∥s−1δs​∥∞​ and ∥x‾−1δ~x∥∞\|\overline x^{-1}\widetilde\delta_x\|_\infty∥x−1δx​∥∞​ are at most 1/(100log⁡n)1/(100\log n)1/(100logn); the output is (x+δ~x,s+δ~s)(x+\widetilde\delta_x,s+\widetilde\delta_s)(x+δx​,s+δs​).

Main (Algorithm 2) sets ϵ=140000log⁡n\epsilon=\frac1{40000\log n}ϵ=40000logn1​, ϵmp=140000\epsilon_{\mathrm{mp}}=\frac1{40000}ϵmp​=400001​, k=1000ϵnlog⁡2n/ϵmpk=1000\epsilon\sqrt n\log^2n/\epsilon_{\mathrm{mp}}k=1000ϵn​log2n/ϵmp​, λ=40log⁡n\lambda=40\log nλ=40logn, starts at t=1t=1t=1, and in each iteration sets tnew=(1−ϵ3n)tt^{\mathrm{new}}=(1-\frac{\epsilon}{3\sqrt n})ttnew=(1−3n​ϵ​)t, takes the direction

δμ=(tnewt−1)xs−ϵ2tnew∇Φλ(μ/t−1)∥∇Φλ(μ/t−1)∥2,\delta_\mu=\Big(\frac{t^{\mathrm{new}}}{t}-1\Big)xs-\frac\epsilon2t^{\mathrm{new}}\frac{\nabla\Phi_\lambda(\mu/t-1)}{\|\nabla\Phi_\lambda(\mu/t-1)\|_2},δμ​=(ttnew​−1)xs−2ϵ​tnew∥∇Φλ​(μ/t−1)∥2​∇Φλ​(μ/t−1)​,

runs StochasticStep, and falls back to a deterministic ClassicalStep whenever Φλ(μnew/tnew−1)>n3\Phi_\lambda(\mu^{\mathrm{new}}/t^{\mathrm{new}}-1)>n^3Φλ​(μnew/tnew−1)>n3.

Formalization targets

Goal: Lemma 4.14

For every iteration jjj, almost surely Assumption 4.1 holds for the input of iteration jjj (in particular xjsj≈0.1tjx^js^j\approx_{0.1}t_jxjsj≈0.1​tj​ and ∥δμ∥2≤ϵtj\|\delta_\mu\|_2\le\epsilon t_j∥δμ​∥2​≤ϵtj​), almost surely the resampling loop of iteration jjj succeeds with positive probability, and

P(ClassicalStep is used in iteration j)≤10n2.\mathbb P(\text{ClassicalStep is used in iteration }j)\le\frac{10}{n^2}.P(ClassicalStep is used in iteration j)≤n210​.

The paper writes O(1/n2)O(1/n^2)O(1/n2); its proof gives the constant 101010.

Milestones

Lemma A.1 (variance of a product), Lemma 4.12 (properties of Φλ\Phi_\lambdaΦλ​), Lemma 4.2 (explicit step), Lemma 4.3 and Claim 4.7 (moments and success probability of the sampled step), Lemma 4.8 (moments of μnew\mu^{\mathrm{new}}μnew), and Lemma 4.13:

E[Φλ(μnewtnew−1)]≤Φλ(μt−1)−λϵ15n(Φλ(μt−1)−10n).\mathbf E\Big[\Phi_\lambda\Big(\frac{\mu^{\mathrm{new}}}{t^{\mathrm{new}}}-1\Big)\Big]\le\Phi_\lambda\Big(\frac\mu t-1\Big)-\frac{\lambda\epsilon}{15\sqrt n}\Big(\Phi_\lambda\Big(\frac\mu t-1\Big)-10n\Big).E[Φλ​(tnewμnew​−1)]≤Φλ​(tμ​−1)−15n​λϵ​(Φλ​(tμ​−1)−10n).

Significance

Lemma 4.14 is what makes the randomized method usable: the iterates stay in the 0.10.10.1-neighbourhood of the central path along the whole run, and the expensive fallback is rare enough that its expected cost, O~(n2.5)⋅10/n2\widetilde O(n^{2.5})\cdot 10/n^2O(n2.5)⋅10/n2, is negligible. The paper's cost bound (Lemma 4.16) and its main theorem rest on it. The same potential-based "stochastic central path" analysis was reused in later solvers, for instance for empirical risk minimization (Lee, Song and Zhang, COLT 2019).

The result is proved in the paper; no machine-checked version exists. A formalization pins down the probabilistic model that the paper leaves implicit (independence of the sampled coordinates, the law of the resampling loop, a data structure and fallback that see only the past) and checks the constants, several of which are tight against printed slack (Remark 4.4).

The running-time claims of the paper (Theorem 2.1's expected time nω+o(1)n^{\omega+o(1)}nω+o(1), Lemma 4.16, Section 5) are not part of this mission: they live in an arithmetic cost model that Lean does not have. The accuracy guarantee of Theorem 2.1 (Lemma A.6, ClassicalStep from [57]) is also outside the mission.

Difficulty

The obvious argument would bound each quantity under the product law of the sparse direction. But StochasticStep resamples, so the step actually taken is distributed according to that law conditioned on a success event, and expectations and variances shift. A second difficulty is that Φλ\Phi_\lambdaΦλ​ is controlled only in expectation, while Assumption 4.1 must hold surely at every iteration; this is reconciled by the deterministic ClassicalStep fallback, which caps Φλ\Phi_\lambdaΦλ​ at n3n^3n3, and by an induction over iterations of E[Φ]≤10n\mathbf E[\Phi]\le10nE[Φ]≤10n under the trajectory law. Claim 4.7 needs a Bernstein inequality, which Mathlib does not yet provide.

Formalization scope

Coordinates are Fin n, vectors Fin n → ℝ, AAA a Matrix (Fin d) (Fin n) ℝ with A.rank = d, and log⁡\loglog the natural logarithm. ∥⋅∥2\|\cdot\|_2∥⋅∥2​ is written out as ∑ivi2\sqrt{\sum_iv_i^2}∑i​vi2​​; ∥⋅∥∞≤c\|\cdot\|_\infty\le c∥⋅∥∞​≤c is stated coordinatewise. The sampled direction has law Measure.pi of two-point laws; the step taken by StochasticStep has that law conditioned (ProbabilityTheory.cond) on the success event, and every E\mathbf EE, Var\mathbf{Var}Var of Lemmas 4.3, 4.8 and 4.13 is under this conditioned law. mp.Query is replaced by its value P‾(X‾S‾)−1/2δ~μ\overline P(\overline X\overline S)^{-1/2}\widetilde\delta_\muP(XS)−1/2δμ​; the data structure and ClassicalStep are arbitrary measurable functions UjU_jUj​, CjC_jCj​ of the history with the only properties the paper uses. The trajectory is Mathlib's Ionescu-Tulcea measure, with kernels equal to the step law of Main. nnn is the number of variables of the program the loop runs on.

Deviations from the page, all recorded in the items: Assumption 4.1 is used with ϵ≤1/(40000log⁡n)\epsilon\le1/(40000\log n)ϵ≤1/(40000logn) instead of the printed <<<, because Main sets ϵ\epsilonϵ to exactly that value; O(1/n2)O(1/n^2)O(1/n2) is instantiated as 10/n210/n^210/n2, the constant of the paper's proof; the conclusions of Lemma 4.14 are stated for every iteration index rather than while t>δ2/(32n3)t>\delta^2/(32n^3)t>δ2/(32n3); at ∇Φλ=0\nabla\Phi_\lambda=0∇Φλ​=0 the second term of δμ\delta_\muδμ​ is 000. No hypothesis k≤nk\le nk≤n is imposed.

A trivializing formalization is ruled out: every statement that integrates against the conditioned law also concludes that this law is a probability measure (so it cannot be the zero measure), the goal concludes that each resampling loop succeeds with positive probability, the oracles UjU_jUj​, CjC_jCj​ cannot see the coins of the current iteration, and the goal is about the whole iterated process from the initial point, not one step from an arbitrary law.

Contributions welcome: a Bernstein inequality for bounded independent sums, conditional-law lemmas for cond of Measure.pi, and Markov-kernel measurability for the step law; these are reusable beyond this mission.

Selected references

  • M. B. Cohen, Y. T. Lee, Z. Song, Solving Linear Programs in the Current Matrix Multiplication Time, J. ACM 68(1), Article 3, 2021. https://doi.org/10.1145/3424305 (arXiv:1810.07896, https://arxiv.org/abs/1810.07896)
  • N. Karmarkar, A new polynomial-time algorithm for linear programming, Combinatorica 4, 1984. https://doi.org/10.1007/BF02579150
  • J. Renegar, A polynomial-time algorithm, based on Newton's method, for linear programming, Math. Programming 40, 1988. https://doi.org/10.1007/BF01580724
  • P. M. Vaidya, Speeding-up linear programming using fast matrix multiplication, Proc. 30th FOCS, 1989.
  • Y. T. Lee, A. Sidford, Path finding methods for linear programming, FOCS 2014. https://doi.org/10.1109/FOCS.2014.52
  • Y. T. Lee, Z. Song, Q. Zhang, Solving Empirical Risk Minimization in the Current Matrix Multiplication Time, COLT 2019. https://arxiv.org/abs/1905.04447
  • J. van den Brand, A deterministic linear program solver in current matrix multiplication time, SODA 2020. https://doi.org/10.1137/1.9781611975994.16
11 thms2 active usersReviewed
🏆Completed
Operations ResearchProbabilityStochastic Systems·Captain: mikedeng1

Approximation Algorithms for Stochastic Inventory Control Models 1: The Dual-Balancing Policy Costs at Most Twice the OptimumResearch Paper

Motivation

Periodic-review inventory control with backorders is one of the basic models of operations research: in each period a manager decides how much to order, orders arrive after a lead time, unmet demand is backlogged at a penalty, and stock left over is charged a holding cost. When demands in different periods are independent, dynamic programming yields an optimal base-stock policy and computing it is tractable. In practice demands are correlated and forecasts evolve over time, for example under the martingale model of forecast evolution (Heath and Jackson, 1994, doi:10.1080/07408179408966604). The dynamic program then has to range over all possible information states, whose number is typically exponential in the input (Zipkin, 2000), so optimal policies are out of reach and the heuristics in use came without performance guarantees.

Levi, Pál, Roundy and Shmoys (Math. Oper. Res. 32(2):284–302, 2007) gave the first policy for this model with a worst-case guarantee that holds for arbitrary correlated, nonstationary demand distributions: the dual-balancing policy costs at most twice the optimum in expectation. The analysis rests on a marginal cost accounting that charges each order, at the time it is placed, all the holding cost its units will ever incur. This mission formalizes that guarantee.

Setting

There are TTT periods t=1,…,Tt = 1, \dots, Tt=1,…,T and a known lead time L≥0L \ge 0L≥0: an order placed in period ttt arrives in period t+Lt + Lt+L. Period ttt has a per-unit holding cost ht≥0h_t \ge 0ht​≥0 and a per-unit backlogging penalty pt≥0p_t \ge 0pt​≥0. Ordering costs are zero (ct=0c_t = 0ct​=0), which is the standing assumption of the paper's §4. The initial data are the net inventory ni0ni_0ni0​ and the pipeline orders q1−L,…,q0≥0q_{1-L}, \dots, q_0 \ge 0q1−L​,…,q0​≥0.

Demands D1,…,DTD_1, \dots, D_TD1​,…,DT​ are nonnegative random variables on a probability space with a filtration (Ft)(\mathcal F_t)(Ft​); Ft\mathcal F_tFt​ is the information at the beginning of period ttt, and DtD_tDt​ is Ft+1\mathcal F_{t+1}Ft+1​-measurable. A feasible policy PPP places orders QtP≥0Q^P_t \ge 0QtP​≥0 that are Ft\mathcal F_tFt​-measurable. Write D[s,t]=∑j=stDjD_{[s,t]} = \sum_{j=s}^t D_jD[s,t]​=∑j=st​Dj​ (with Dj=0D_j = 0Dj​=0 for j≤0j \le 0j≤0), Xt=ni0+∑j=1−Lt−1Qj−D[1,t−1]X_t = ni_0 + \sum_{j=1-L}^{t-1} Q_j - D_{[1,t-1]}Xt​=ni0​+∑j=1−Lt−1​Qj​−D[1,t−1]​ for the inventory position before ordering and Yt=Xt+QtY_t = X_t + Q_tYt​=Xt​+Qt​ after ordering.

The marginal holding cost of period ttt is the holding cost that the units ordered in ttt incur until the end of the horizon, and the marginal backlogging cost is the penalty incurred one lead time later:

HtP=∑j=t+LThj (QtP−(D[t,j]−XtP)+)+,ΠtP=pt+L (D[t,t+L]−YtP)+.H^P_t = \sum_{j=t+L}^{T} h_j\,\bigl(Q^P_t - (D_{[t,j]} - X^P_t)^+\bigr)^+, \qquad \Pi^P_t = p_{t+L}\,\bigl(D_{[t,t+L]} - Y^P_t\bigr)^+ .HtP​=j=t+L∑T​hj​(QtP​−(D[t,j]​−XtP​)+)+,ΠtP​=pt+L​(D[t,t+L]​−YtP​)+.

The cost of PPP is C(P)=∑t=1T−L(HtP+ΠtP)\mathcal C(P) = \sum_{t=1}^{T-L}(H^P_t + \Pi^P_t)C(P)=∑t=1T−L​(HtP​+ΠtP​); by Eq. (3) it differs from the total holding and backlogging cost only by a policy-independent nonnegative term.

A dual-balancing policy BBB orders nothing after period T−LT - LT−L, and in each period t≤T−Lt \le T - Lt≤T−L orders the quantity that balances the two conditional expected marginal costs:

E[HtB∣Ft]=E[ΠtB∣Ft]almost surely.E\bigl[H^B_t \mid \mathcal F_t\bigr] = E\bigl[\Pi^B_t \mid \mathcal F_t\bigr] \quad\text{almost surely.}E[HtB​∣Ft​]=E[ΠtB​∣Ft​]almost surely.

Formalization targets

Goal: Theorem 4.1

For every dual-balancing policy BBB and every feasible policy PPP,

E[C(B)]  ≤  2 E[C(P)].E[\mathcal C(B)] \;\le\; 2\,E[\mathcal C(P)] .E[C(B)]≤2E[C(P)].

The paper writes P=OPTP = OPTP=OPT; quantifying over all feasible PPP is the same statement whenever an optimum exists and needs no existence assumption.

Milestones

  1. Lemma 4.1. E[C(B)]=2∑t=1T−LE[Zt]E[\mathcal C(B)] = 2\sum_{t=1}^{T-L}E[Z_t]E[C(B)]=2∑t=1T−L​E[Zt​] with Zt=E[HtB∣Ft]Z_t = E[H^B_t \mid \mathcal F_t]Zt​=E[HtB​∣Ft​].
  2. Lemma 4.2. With TH={t:YtB<YtP}\mathcal T_H = \{t : Y^B_t < Y^P_t\}TH​={t:YtB​<YtP​}, ∑t∈THHtB≤∑t=1T−LHtP\sum_{t\in\mathcal T_H} H^B_t \le \sum_{t=1}^{T-L} H^P_t∑t∈TH​​HtB​≤∑t=1T−L​HtP​ on every realization.
  3. Lemma 4.3. With TΠ={t:YtB≥YtP}\mathcal T_\Pi = \{t : Y^B_t \ge Y^P_t\}TΠ​={t:YtB​≥YtP​}, ∑t∈TΠΠtB≤∑t=1T−LΠtP\sum_{t\in\mathcal T_\Pi} \Pi^B_t \le \sum_{t=1}^{T-L} \Pi^P_t∑t∈TΠ​​ΠtB​≤∑t=1T−L​ΠtP​ on every realization.

Two further items are not milestones. Eq. (3) states that, along every realization, the period-by-period holding and backlogging cost equals ∑t=1−L0Πt+H(−∞,0]+∑t=1T−L(Ht+Πt)\sum_{t=1-L}^{0}\Pi_t + H_{(-\infty,0]} + \sum_{t=1}^{T-L}(H_t + \Pi_t)∑t=1−L0​Πt​+H(−∞,0]​+∑t=1T−L​(Ht​+Πt​), which is why the cost of Eq. (4) is the right objective. The other states that a dual-balancing policy exists when hT>0h_T > 0hT​>0 and the demands are integrable, so the goal is not about an empty class.

Significance

The theorem gives a policy that is computable period by period, by a one-dimensional search, with a factor-two guarantee that holds for every joint demand distribution, including correlated, nonstationary and forecast-driven ones, where the optimal policy cannot be computed. The constant is tight: the paper exhibits instances where the ratio tends to two. The second mission of this series treats the stochastic lot-sizing problem of the same paper, which uses the same marginal cost accounting.

The result is proved in the paper; no machine-checked proof of it is known. Formalizing it produces a reusable model of the periodic-review backlogging system with lead times and adapted policies, a verified marginal cost identity, and a formal approximation guarantee for a stochastic inventory policy. The pathwise comparison lemmas are stated for arbitrary pairs of order sequences and so apply to other balancing-type policies.

Difficulty

The obvious attempt compares the two policies period by period. That fails: in a given period the dual-balancing policy may hold far more or far less inventory than the comparison policy, and neither the holding nor the backlogging cost of one period is bounded by the comparator's cost in that period. The comparison only works after re-charging holding costs to the period in which the units were ordered, which requires the identity Eq. (3) to be established exactly, including the pipeline units, the initial stock and the lead-time shift. The probabilistic step then needs the random index sets TH\mathcal T_HTH​ and TΠ\mathcal T_\PiTΠ​ to be determined by the information of period ttt, so that conditioning on Ft\mathcal F_tFt​ commutes with the indicators; this is where the nonanticipativity of both policies enters. The existence of a balancing quantity needs a measurable selection from conditional laws, and it fails without a positive late holding cost.

Formalization scope

  • Periods are integers (ℤ). Orders and demands are functions ℤ → Ω → ℝ; only periods 1,…,T1, \dots, T1,…,T are read, and the pipeline qtq_tqt​ is substituted for t≤0t \le 0t≤0.
  • Ordering costs are ct=0c_t = 0ct​=0 and there is no discounting, as in the paper's §4; the reduction of §4.6 from general instances is not formalized. The lead time LLL is general.
  • Information is an arbitrary Filtration ℤ to which demands are adapted with a one-period lag; the paper's information vectors are a special case, and randomized policies are covered when their randomness is part of the information.
  • Expected costs are lower Lebesgue integrals in [0,∞][0,\infty][0,∞], so an infinite expected cost is never read as 000.
  • The balancing condition carries integrability of HtBH^B_tHtB​ and ΠtB\Pi^B_tΠtB​, so a conditional expectation of a non-integrable cost (which Mathlib sets to 000) cannot satisfy it vacuously. The existence item rules out an empty policy class.
  • Lemmas 4.2 and 4.3 are pathwise and do not use the balancing rule. The comparator totals are the marginal totals of Eq. (4), which is the stronger reading.
  • Eq. (2) prints Xt+LX_{t+L}Xt+L​ and its restatement on p. 292 prints ptp_tpt​; both are typos, and the formalization uses XtX_tXt​ and pt+Lp_{t+L}pt+L​.

A complete development needs finite-sum manipulations for Eq. (3) and Lemma 4.2, conditional expectation (tower property, pulling out bounded Ft\mathcal F_tFt​-measurable factors) for Lemma 4.1 and the goal, and regular conditional distributions with a measurable selection for the existence item. Theorem 4.2 (the randomized policy for integer demands) is outside this mission.

Selected references

  • R. Levi, M. Pál, R. O. Roundy, D. B. Shmoys, Approximation Algorithms for Stochastic Inventory Control Models, Mathematics of Operations Research 32(2):284–302, 2007. doi:10.1287/moor.1060.0205
  • D. C. Heath, P. L. Jackson, Modeling the evolution of demand forecasts with application to safety stock analysis in production/distribution systems, IIE Transactions 26(3):17–30, 1994. doi:10.1080/07408179408966604
  • P. H. Zipkin, Foundations of Inventory Management, McGraw-Hill, 2000. ISBN 978-0-256-11379-7.
6 thms2 active usersReviewed
🏆Completed
Captain: wurtle

WordRAM to Turing machines: polynomial simulation for NP proofsResearch Paper

We establish the polynomial simulation needed for WordRAM-based NP proofs. It reuses the same machines and Cook–Levin definitions, with uniform programs, logarithmic word widths, and standard bit input/output.

The targets cover function outputs and verifier verdicts, including loading and serialization costs.

This adapts Cook–Reckhow’s Theorem 2(a), pp. 361–363, to Hagerup’s bounded-word operations, including multiplication; no particular simulation exponent is prescribed.

References:

  • Stephen A. Cook and Robert A. Reckhow. Time Bounded Random Access Machines. Journal of Computer and System Sciences 7(4), 354–375, 1973.
  • Torben Hagerup. Sorting and Searching on the Word RAM. STACS 1998, 366–398.
15 thms2 active usersReviewed
🏆Completed
Operations ResearchOptimization·Captain: mikedeng1

Optimal Sequencing of a Single Machine Subject to Precedence Constraints: Repeatedly Placing Last a Least-Cost Eligible Job Yields a Minmax Optimal SequenceResearch Paper

Motivation

Single-machine sequencing is the base case of deterministic scheduling theory. Many multi-machine and shop problems are analysed by reduction to it, and many bounds and approximation algorithms for harder models use it as a subroutine. A central objective class is the bottleneck or minmax objective. Each job carries a nondecreasing cost of its completion time, and the schedule is judged by its worst job. Maximum lateness, maximum tardiness and maximum weighted tardiness are all special cases.

Before 1973 the minmax problem was solved without precedence constraints. Jackson (1955) showed that ordering by due date minimizes maximum lateness. Moore (1968, Management Science 15(1)) gave a procedure for general nondecreasing deferral costs, and Lawler and Moore (1969) gave a related method. In Lawler, Optimal Sequencing of a Single Machine Subject to Precedence Constraints, Management Science 19(5), 1973, Lawler showed that arbitrary precedence constraints can be added at no loss of efficiency. Jobs are chosen from last to first, by a single comparison of costs at a known time. The resulting O(n2)O(n^2)O(n2) procedure is the standard algorithm for the problem written 1 ∣ prec ∣ fmax⁡1\,|\,\mathrm{prec}\,|\,f_{\max}1∣prec∣fmax​ in the classification of Graham, Lawler, Lenstra and Rinnooy Kan (1979). It is one of the first polynomial-time results for precedence-constrained scheduling that every survey of the field cites.

Setting

A finite, nonempty set JJJ of jobs is processed on a single machine, one job at a time and without interruption. Each job jjj has a processing time aj≥0a_j \ge 0aj​≥0 and a cost function cj:R→Rc_j : \mathbb{R} \to \mathbb{R}cj​:R→R that is monotone nondecreasing. The value cj(t)c_j(t)cj​(t) is the cost incurred when jjj is completed at time ttt.

The precedence constraints are an arbitrary relation ≺\prec≺ on jobs: i≺ji \prec ji≺j means that job iii is required to precede job jjj. A sequence π=(π1,…,πn)\pi = (\pi_1, \dots, \pi_n)π=(π1​,…,πn​) lists every job of JJJ once. It observes the precedence constraints if πq≺πp\pi_q \prec \pi_pπq​≺πp​ never holds for positions p<qp < qp<q. The machine starts at time 000 with no idle time, so the completion time of πm\pi_mπm​ is Cπm(π)=aπ1+⋯+aπmC_{\pi_m}(\pi) = a_{\pi_1} + \dots + a_{\pi_m}Cπm​​(π)=aπ1​​+⋯+aπm​​. The maximum incurred cost of π\piπ is

fmax⁡(π)=max⁡j∈Jcj(Cj(π)),f_{\max}(\pi) = \max_{j \in J} c_j\bigl(C_j(\pi)\bigr),fmax​(π)=j∈Jmax​cj​(Cj​(π)),

and a feasible π\piπ is minmax optimal if fmax⁡(π)≤fmax⁡(π′)f_{\max}(\pi) \le f_{\max}(\pi')fmax​(π)≤fmax​(π′) for every feasible π′\pi'π′.

For a set PPP of jobs, S(P)S(P)S(P) is the set of jobs of PPP that are not required to precede any other job of PPP, and TP=∑j∈PajT_P = \sum_{j \in P} a_jTP​=∑j∈P​aj​. Lawler's rule builds a sequence from the last position to the first. With PPP the jobs not yet placed, it chooses k∈S(P)k \in S(P)k∈S(P) with ck(TP)=min⁡j∈S(P)cj(TP)c_k(T_P) = \min_{j \in S(P)} c_j(T_P)ck​(TP​)=minj∈S(P)​cj​(TP​), places kkk in the latest open position and removes it from PPP. Ties are broken arbitrarily. In Lean the objects are IsFeasible, lastEligible (SSS), IsMinmaxOptimal and IsLawlerSequence, in namespace LawlerPrec.MinMax. They are built on the published MooreLateJobs.Shared.completionTime and MooreLateJobs.MaxDeferral.maxCost.

Formalization targets

Goal: the rule is optimal

Every sequence π\piπ that Lawler's rule can produce, under any tie-breaking, observes the precedence constraints and satisfies

fmax⁡(π)  ≤  fmax⁡(π′)for every sequence π′ of J observing the precedence constraints.f_{\max}(\pi) \;\le\; f_{\max}(\pi') \qquad \text{for every sequence } \pi' \text{ of } J \text{ observing the precedence constraints.}fmax​(π)≤fmax​(π′)for every sequence π′ of J observing the precedence constraints.

This is the statement of §3 (p. 545), "An efficient algorithm for finding a minmax optimal sequence follows immediately from the theorem above". It contains no constants.

Milestones

  1. §2 proof, third paragraph. Moving a job of S(J)S(J)S(J) to the end of a feasible sequence keeps it feasible.
  2. §2 proof, fourth paragraph, first sentence. After that move, no job other than kkk completes later, and kkk completes at T=∑j∈JajT = \sum_{j \in J} a_jT=∑j∈J​aj​.
  3. §2 proof, fourth paragraph. If ck(T)≤ck′(T)c_k(T) \le c_{k'}(T)ck​(T)≤ck′​(T), where k′k'k′ is the last job of the feasible sequence, the move does not raise fmax⁡f_{\max}fmax​.
  4. THEOREM (§2), p. 544. If some feasible sequence exists and k∈S(J)k \in S(J)k∈S(J) minimizes cj(T)c_j(T)cj​(T) over S(J)S(J)S(J), then some minmax optimal sequence has kkk last.
  5. §3, the reduction. A minmax optimal sequence of J∖{k}J \setminus \{k\}J∖{k}, followed by kkk, is minmax optimal for JJJ.
  6. §3, the procedure never stalls. If a feasible sequence exists, the rule produces a complete sequence. This shows the goal is not vacuous.

Significance

The result shows that 1 ∣ prec ∣ fmax⁡1\,|\,\mathrm{prec}\,|\,f_{\max}1∣prec∣fmax​ is solvable in polynomial time for every family of nondecreasing costs. The ordering of an optimal sequence depends on the costs only through their values at the nnn partial sums TPT_PTP​ along the way. The deadline problem is a corollary (§5): sequencing from last to first by latest deadline among the currently available jobs avoids tardiness whenever any sequence does. The last-to-first scheme is reused in later backward rules for fmax⁡f_{\max}fmax​ objectives. A formal statement of the rule, its feasibility and its optimality makes these extensions available for formal reuse.

The result is classical and its proof is short. No machine-checked proof of it is known to be in Mathlib. The work this mission asks for is a formal proof of the known exchange argument and of the induction that turns the Theorem into the algorithm's correctness. The induction needs the reduced problem's sets S(P)S(P)S(P) and times TPT_PTP​ to be the correct ones at each stage, which the definitions fix.

Difficulty

The exchange argument of §2 is elementary. The difficulty lies in stating the algorithm faithfully and carrying the induction. At each stage the eligible set S(P)S(P)S(P) and the time TPT_PTP​ must be recomputed on the remaining jobs, with constraints into already placed jobs ignored. The induction must also show that the rule's sequence is feasible, which is a conclusion and not an assumption.

A first attempt often proves only the Theorem, that some optimal sequence has kkk last. That statement says nothing about a sequence built entirely by the rule, because an optimal sequence of JJJ with kkk last need not restrict to an optimal sequence of J∖{k}J \setminus \{k\}J∖{k}. Optimality of the rule's whole sequence is the target, and milestone 5 isolates the corresponding step of the page.

Formalization scope

  • Jobs form a type ι with decidable equality, and the job set is J : Finset ι.
  • Processing times are a : ι → ℝ, costs are c : ι → ℝ → ℝ, and the precedence constraints are prec : ι → ι → Prop.
  • A sequence is a duplicate-free list whose elements are exactly J. Positions are 0-based, and completion times are prefix sums (MooreLateJobs.Shared.completionAt).
  • The relation prec is arbitrary: it is not assumed transitive, irreflexive or acyclic. A cycle among distinct jobs leaves no feasible sequence. A self-loop constrains nothing, both in feasibility and in SSS (the "others" of the page exclude the job itself).

The standing assumptions of §1 appear as hypotheses wherever they are used: monotone nondecreasing cjc_jcj​ for j∈Jj \in Jj∈J, and JJJ nonempty where the maximum is taken. Two hypotheses are added relative to the page and disclosed in each statement. Processing times are non-negative (aj≥0a_j \ge 0aj​≥0), since they are durations and the exchange argument fails without them. The Theorem also assumes the existence of a feasible sequence, which its conclusion presupposes.

The rule is the property IsLawlerSequence of a finished sequence. At each position mmm, the job there lies in SSS of the jobs in positions 0..m0..m0..m and minimizes the cost at their total processing time. Every tie-break is covered. The rule is not a deterministic function, and it is not an arbitrary choice function. Feasibility of the rule's output is part of the goal's conclusion, so the goal cannot be obtained by assuming it. A statement that compares the rule only with some sequence, or that asserts only that an optimal sequence exists, is weaker and is ruled out by the goal's form. Milestone 6 shows the goal's hypotheses are satisfiable whenever a feasible sequence exists.

The n2n^2n2 operation count of §4, the first-to-last rule of §5 and the deadline corollaries of §5 are not part of this mission. A development needs only finite lists and finsets from Mathlib. Lemmas about moving an element to the end of a duplicate-free list, and about prefix sums under that move, are reusable for other exchange arguments in single-machine scheduling.

Selected references

  • E. L. Lawler, Optimal Sequencing of a Single Machine Subject to Precedence Constraints, Management Science 19(5):544–546, 1973. https://doi.org/10.1287/mnsc.19.5.544
  • J. M. Moore, An n Job, One Machine Sequencing Algorithm for Minimizing the Number of Late Jobs, Management Science 15(1):102–109, 1968. https://doi.org/10.1287/mnsc.15.1.102
  • E. L. Lawler and J. M. Moore, A Functional Equation and its Application to Resource Allocation and Sequencing Problems, Management Science 16(1):77–84, 1969. https://doi.org/10.1287/mnsc.16.1.77
  • J. R. Jackson, Scheduling a Production Line to Minimize Maximum Tardiness, Research Report 43, Management Science Research Project, UCLA, 1955.
  • R. L. Graham, E. L. Lawler, J. K. Lenstra and A. H. G. Rinnooy Kan, Optimization and Approximation in Deterministic Sequencing and Scheduling: a Survey, Annals of Discrete Mathematics 5:287–326, 1979. https://doi.org/10.1016/S0167-5060(08)70356-X
13 thms2 active usersReviewed
Operations ResearchProbabilityStochastic Systems·Captain: mikedeng1

Approximation Algorithms for Stochastic Inventory Control Models 2: The Triple-Balancing Policy Costs at Most Three Times the Optimum for Stochastic Lot-SizingResearch Paper

Motivation

Periodic-review inventory control with a fixed ordering cost is one of the oldest problems in operations research. A firm reviews its stock at the beginning of each of TTT periods, decides whether to place an order, pays a fixed cost KKK for every order it places, and pays holding costs on leftover stock and penalties on unmet (backlogged) demand. When demand is random and correlated across periods, and the firm's forecast evolves as information arrives, the optimal policy solves a dynamic program over the whole information state. That program is intractable in general, and in practice firms use heuristics with no performance guarantee.

Levi, Pál, Roundy and Shmoys (Math. Oper. Res. 32(2), 2007) gave policies with worst-case guarantees for these models, using a "marginal cost accounting" scheme that charges each unit's holding cost to the period in which it was ordered. For the model with fixed ordering costs, the stochastic lot-sizing problem, they assume that the demand of each period is known at the beginning of that period (make-to-order systems, or settings where the short-term forecast is accurate), while demand further ahead stays random and arbitrarily correlated. Under this assumption they define the triple-balancing policy and prove it costs at most three times the optimum in expectation.

Timeline:

  • Scarf (1960) proved that (s,S)(s,S)(s,S) policies are optimal for independent demands with fixed costs; with correlated demand the optimal policy is a state-dependent (st(ft),St(ft))(s_t(f_t), S_t(f_t))(st​(ft​),St​(ft​)) rule that is hard to compute.
  • Levi, Pál, Roundy and Shmoys (2007) gave the dual-balancing 2-approximation for the model without fixed costs (§4) and the triple-balancing 3-approximation for the stochastic lot-sizing problem (§6, Theorem 6.1), both for arbitrarily correlated demand.

Setting

There are periods t=1,…,Tt=1,\dots,Tt=1,…,T on a probability space (Ω,F,μ)(\Omega,\mathcal F,\mu)(Ω,F,μ) with a filtration (Ft)(\mathcal F_t)(Ft​): Ft\mathcal F_tFt​ is the information available at the beginning of period ttt. The data are a fixed ordering cost K≥0K\ge0K≥0, per-unit holding costs ht≥0h_t\ge0ht​≥0, per-unit backlogging penalties pt≥0p_t\ge0pt​≥0, an initial inventory level x1∈Rx_1\in\mathbb Rx1​∈R, and nonnegative demands DtD_tDt​. The per-unit ordering cost is zero, the lead time is zero and there is no discounting. The defining assumption is that DtD_tDt​ is Ft\mathcal F_tFt​-measurable: the demand of a period is known when the period begins. For every period sss there is a conditional joint distribution IsI_sIs​ of the demands given Fs\mathcal F_sFs​, under which every conditional mean E[Dt∣fs]E[D_t\mid f_s]E[Dt​∣fs​] is finite.

A feasible policy is an order process Q=(Qt)Q=(Q_t)Q=(Qt​) with Qt≥0Q_t\ge0Qt​≥0 and QtQ_tQt​ determined by Ft\mathcal F_tFt​. Its inventory levels are xt=x1+∑j<t(Qj−Dj)x_t=x_1+\sum_{j<t}(Q_j-D_j)xt​=x1​+∑j<t​(Qj​−Dj​) before ordering and yt=xt+Qty_t=x_t+Q_tyt​=xt​+Qt​ after ordering, and its cost is

C(Q)=∑t=1T(K 1(Qt>0)+ht(yt−Dt)++pt(Dt−yt)+).\mathcal C(Q)=\sum_{t=1}^T\Bigl(K\,\mathbb 1(Q_t>0)+h_t(y_t-D_t)^++p_t(D_t-y_t)^+\Bigr).C(Q)=t=1∑T​(K1(Qt​>0)+ht​(yt​−Dt​)++pt​(Dt​−yt​)+).

The triple-balancing policy TB uses two rules. Let s∗s^*s∗ be the last period before sss in which TB ordered (s∗=0s^*=0s∗=0 if none). Rule 1: TB orders in period sss if and only if, without an order in sss, the accumulated backlogging cost over (s∗,s](s^*,s](s∗,s] would exceed KKK. Rule 2: when it orders in s<Ts<Ts<T, it orders

qsB=max⁡{q≥0: E[HsB(q)∣fs]≤K},HsB(q)=∑j=sThj(q−(D[s,j]−xs)+)+,q_s^B=\max\{q\ge0:\ E[H_s^B(q)\mid f_s]\le K\},\qquad H_s^B(q)=\sum_{j=s}^T h_j\bigl(q-(D_{[s,j]}-x_s)^+\bigr)^+,qsB​=max{q≥0: E[HsB​(q)∣fs​]≤K},HsB​(q)=j=s∑T​hj​(q−(D[s,j]​−xs​)+)+,

the largest quantity whose expected marginal holding cost over [s,T][s,T][s,T] is at most KKK. When it orders in period TTT, it orders exactly enough to clear the backorders and meet DTD_TDT​. Let NNN be the number of orders TB places.

Formalization targets

Goal: Theorem 6.1

For every instance, the triple-balancing policy TB and every feasible policy PPP satisfy

E[C(TB)]≤3 E[C(P)].E[\mathcal C(TB)]\le 3\,E[\mathcal C(P)].E[C(TB)]≤3E[C(P)].

The constant 3 is the paper's. The statement leaves the demand law, the information structure and the cost data unrestricted beyond the standing assumptions above.

Milestones

  1. §6.1, Rule 2 observation. In a period where TB orders, Ds≤ysTBD_s\le y_s^{TB}Ds​≤ysTB​: no backorders remain at the end of the period.
  2. Lemma 6.1. K⋅E[N]≤E[C(P)]K\cdot E[N]\le E[\mathcal C(P)]K⋅E[N]≤E[C(P)] for every feasible PPP.
  3. Lemma 6.2. E[C(TB)]≤E[C(P)]+2K⋅E[N]E[\mathcal C(TB)]\le E[\mathcal C(P)]+2K\cdot E[N]E[C(TB)]≤E[C(P)]+2K⋅E[N] for every feasible PPP.

Two non-milestone theorems show that the setting is not empty. A conditional demand law exists whenever demands are integrable, and a triple-balancing policy exists when hT>0h_T>0hT​>0.

Significance

The theorem gives a policy that can be computed online and comes with a worst-case expected-cost guarantee that does not depend on the demand distribution, the horizon or the cost data. In this setting the optimal policy is not computable in general, and the previously used heuristics have no such bound. The two lemmas separate a lower bound on every policy, in terms of TB's own number of orders, from an upper bound on TB's cost. The authors' subsequent work extends the balancing template to capacitated and multi-echelon models (§7 of the paper).

The result is proved in the paper. As far as we know, no machine-checked version exists of this theorem, of the balancing argument, or of a stochastic inventory model with correlated demand and evolving information. A formalization would check the argument, which is terse in places: the printed proof of Lemma 6.2 indexes its final sum loosely and must handle the event N=0N=0N=0. It would also produce reusable infrastructure for policies adapted to a filtration, for regular conditional distributions of future demand, and for cost accounting over random intervals between orders.

Difficulty

The costs of TB and of an arbitrary policy cannot be compared period by period, because the two policies order at different, random times that depend on the evolving information. Any comparison has to be made over intervals whose endpoints are stopping times determined by TB, conditioned on the information at their start. At such a time the other policy may hold more or less stock than TB, and the bound must hold in both cases. Bounding each policy's cost on its own does not work: the guarantee rests on a coupling between when TB orders and what every other policy must pay over the same random stretch of time. The formal side adds a second difficulty. Rule 2 is defined through a conditional expectation viewed as a function of the order quantity, so it needs a regular conditional distribution and a measurable selection of the maximizer.

Formalization scope

  • Periods are natural numbers 1,…,T1,\dots,T1,…,T, demands and orders are real-valued, and data at indices outside 1,…,T1,\dots,T1,…,T are unused.
  • Information is a MeasureTheory.Filtration ℕ. A policy is feasible when it is nonnegative and adapted, and "DtD_tDt​ known at the start of period ttt" means DtD_tDt​ is Ft\mathcal F_tFt​-measurable.
  • The conditional distributions IsI_sIs​ are model data: Markov kernels to demand paths that are Fs\mathcal F_sFs​-measurable regular conditional distributions of the demand path. At every outcome they make DsD_sDs​ deterministic, demands nonnegative and the conditional means E[Dt∣fs]E[D_t\mid f_s]E[Dt​∣fs​] finite.
  • Expected costs, E[N]E[N]E[N] and the conditional expectation in Rule 2 are lower Lebesgue integrals in [0,∞][0,\infty][0,∞]. Lemma 6.2 is stated additively, E[C(TB)]≤E[C(P)]+2K E[N]E[\mathcal C(TB)]\le E[\mathcal C(P)]+2K\,E[N]E[C(TB)]≤E[C(P)]+2KE[N], which is the paper's inequality whenever the expectations are finite.
  • The comparison policy is an arbitrary feasible policy, not an optimal one. The paper's proofs use only feasibility, and this form implies the paper's whenever an optimum exists, without any existence hypothesis.
  • TB is the predicate "feasible and satisfies Rules 1 and 2 at every period and outcome". The rules determine the policy uniquely. Rule 1 uses a strict "exceeds KKK", and the period-TTT order is DT−xTD_T-x_TDT​−xT​.

Several trivializing formalizations are ruled out. Junk conditional expectations cannot make Rule 2 hold for every qqq, because it uses kernel integrals in [0,∞][0,\infty][0,∞]. Infinite expected costs cannot be read as 000. The policy class is not empty, because a separate theorem gives existence under hT>0h_T>0hT​>0 (without some positive holding cost on [s,T][s,T][s,T] the maximum in Rule 2 does not exist).

Contributions welcome: proofs of the existence theorems (measurable selection of qsBq_s^BqsB​, versions of regular conditional distributions), the stopping-time decomposition of the cost over TB's order intervals, and Lemmas 6.1 and 6.2.

Selected references

  • R. Levi, M. Pál, R. O. Roundy, D. B. Shmoys, Approximation Algorithms for Stochastic Inventory Control Models, Mathematics of Operations Research 32(2):284–302, 2007. https://doi.org/10.1287/moor.1060.0205
  • H. Scarf, The Optimality of (S, s) Policies in the Dynamic Inventory Problem, in Mathematical Methods in the Social Sciences, Stanford University Press, 1960.
7 thms2 active usersReviewed
🏆Completed
Algorithmic Game TheoryOperations ResearchProbability·Captain: mikedeng1

Secretary Problems: Weights and Discounts 1: An (8+3e)-Competitive Algorithm for the Weighted Secretary ProblemResearch Paper

Motivation

The classical secretary problem asks how to select one valuable candidate when candidates arrive in random order and a decision must be made when each candidate appears. Many allocation settings have several goods of unequal quality instead of a single position. An employer may have roles of different desirability, or a seller may have placements with different visibility. In the weighted secretary problem, an agent's value is multiplied by the weight of the good assigned to that agent. The algorithm must decide irrevocably as agents arrive, while the benchmark sees every value before assigning goods. Babaioff, Dinitz, Gupta, Immorlica and Talwar study this model with arbitrary fixed agent values and a uniformly random arrival order, and give a constant competitive ratio independent of the number of agents and goods (authors' version, §§2–3).

The paper also studies time discounts and matroid constraints. This mission concerns its weighted-goods result, Theorem 3.4. The result combines an online allocation rule for several comparably valuable agents with the familiar one-choice secretary rule for an unusually valuable agent. These are distinct ways in which the sorted offline assignment can earn value; both are present even when the weights are fixed in advance. The weighted model matters because matching a valuable agent to an unsuitable good can lose value despite accepting the right agent.

Setting

There are nnn agents e∈Ue\in Ue∈U, each with a nonnegative value v(e)v(e)v(e), and KKK goods indexed in decreasing order of nonnegative weight:

w(1)≥w(2)≥⋯≥w(K)≥0.w(1)\ge w(2)\ge\cdots\ge w(K)\ge0.w(1)≥w(2)≥⋯≥w(K)≥0.

An assignment sss gives each good to at most one agent, and each agent receives at most one good. A good may remain unassigned, represented by ⊥\bot⊥ with v(⊥)=0v(\bot)=0v(⊥)=0. Its value is ∑k=1Kv(s(k))w(k)\sum_{k=1}^K v(s(k))w(k)∑k=1K​v(s(k))w(k). Agent values are arbitrary, not drawn independently from a distribution. The uncertainty is the arrival order π\piπ, chosen uniformly from all permutations; an agent's value becomes visible on arrival, and an allocation decision cannot be revised.

The offline optimum, OPT\mathrm{OPT}OPT, assigns the heaviest good to the highest-valued agent, the next good to the next agent, and so on. If K>nK>nK>n, the extra goods remain unassigned. A consistent tie break makes the ordering unique without changing the numerical value. This sorted assignment is defined directly; the mission does not replace it with an unconstrained variable said to be optimal.

The reservation algorithm draws a sample size τ∼Binom(n,1/2)\tau\sim\mathrm{Binom}(n,1/2)τ∼Binom(n,1/2), observes the first τ\tauτ agents without allocation, and retains the best min⁡(K,τ)\min(K,\tau)min(K,τ) sampled agents. Positive values are grouped into value classes [2i−1,2i)[2^{i-1},2^i)[2i−1,2i) for integer iii. A sampled agent in class iii reserves one good in that class's contiguous block, with higher classes receiving heavier blocks. A later agent receives the heaviest unassigned good reserved for its class when one is available. The classical secretary rule instead observes the first ⌊n/e⌋\lfloor n/e\rfloor⌊n/e⌋ agents, then selects the first later arrival better than every predecessor; its winner receives good 111.

Formalization targets

The mission's goal is the exact guarantee of Theorem 3.4 for Algorithm AAA, which runs the reservation algorithm with probability 8/(3e+8)8/(3e+8)8/(3e+8) and the classical rule with probability 3e/(3e+8)3e/(3e+8)3e/(3e+8):

OPT≤(8+3e) E[A].\mathrm{OPT}\le(8+3e)\,\mathbb E[A].OPT≤(8+3e)E[A].

Here the expectation covers the uniform arrival permutation, the independent binomial sample size used by the reservation branch, and the mixing coin. The multiplicative inequality expresses competitiveness even when an expected payoff is zero. It uses the explicit constant in the paper's proof rather than an instance-dependent or unspecified constant.

Four source results form the milestones. The classical secretary rule selects the maximum with probability at least 1/e1/e1/e. Lemma 3.2 compares the starting indices bib_ibi​ and oio_ioi​ of class-iii blocks in the reservation and optimum assignments. Lemma 3.1 says that if the optimum assigns at least two agents from class iii, the reservation rule assigns at least ui/4u_i/4ui​/4 agents from that class in expectation. Lemma 3.3 converts this to expected value at least OPTi/8\mathrm{OPT}_i/8OPTi​/8. The target retains the paper's class condition and both numerical fractions (authors' version, pp. 4–5).

Significance

Theorem 3.4 supplies a constant factor guarantee for irrevocable allocation when goods have different weights and agents arrive in random order. The factor does not grow with nnn or KKK. It separates the effects of uncertain arrivals from the offline matching of high values to high weights, and it supplies a benchmark for later variants with more complicated feasibility constraints. The paper extends the reservation idea to additional combinatorial settings, including partition-matroid variants in Appendix C (authors' version, Appendix C).

The theorem is proved in the source paper, while the Lean statements in this mission are proof obligations. Formalizing them requires checking that the random-order model, sample distribution, tie convention and assignments jointly express the same algorithm. A complete development will also establish reusable finite-average facts for random permutations and binomial samples, and structural facts about sorted assignments and reserved blocks. Those pieces can support other secretary problems in the series; the mission's specific promise remains the weighted algorithm's exact bound.

Difficulty

A count of how many agents a class receives does not by itself control the weighted value of those goods. Goods have unequal weights, and the value of assigning the next good changes with its position in a block. A class whose offline optimum receives several agents can also lose all its sampled members from the allocation phase. Thus a direct comparison of expected class counts with expected class values is insufficient. The paper's separate count, block-position and value statements identify the claims a solver must establish; the final theorem must also account for classes represented only once in the offline assignment (authors' version, p. 5).

Formalization scope

Agents and goods are Fin n and Fin K; their indices start at zero in Lean, so paper time ttt corresponds to Lean index t−1t-1t−1. An arrival permutation maps time to agent. Values and weights are real and explicitly nonnegative, and weights are antitone in the good index. The finite sums defining expectations are normalized by n!n!n! for permutations and by (nτ)/2n\binom n\tau/2^n(τn​)/2n for sample sizes. No measurability or integration convention is needed. For the goal, K≥1K\ge1K≥1 makes the heaviest good available; K>nK>nK>n is allowed.

Equal values are ordered by smaller original agent index throughout the sorted optimum, the sample's top agents and the classical rule. The classical rule observes exactly ⌊n/e⌋\lfloor n/e\rfloor⌊n/e⌋ arrivals, and zero-valued agents reserve no value-class goods. Positive values below one use negative integer class indices. The paper says only that class iii holds the values “between” 2i−12^{i-1}2i−1 and 2i2^i2i (p. 4, and again in Appendix C, p. 12); the mission fixes the half-open interval [2i−1,2i)[2^{i-1},2^i)[2i−1,2i), so that the classes partition the positive reals (authors' version, pp. 4, 12). A reservation assignment is built from each post-sample agent's rank within its class, so a good is offered to at most one such agent. The theorem is about this concrete algorithm and the concrete sorted offline assignment; an arbitrary favorable policy or an optimum supplied as a hypothesis would not express the source result.

The development needs a finite assignment interface, a tie-aware rank order, value classes, the two online rules, and normalized finite expectations. The assignment and finite-average definitions are reusable. Contributions that prove the structural validity of the reservation assignment, the classical success guarantee, Lemmas 3.1–3.3, or the final combination all advance the stated target.

Selected references

  • Moshe Babaioff, Michael Dinitz, Anupam Gupta, Nicole Immorlica and Kunal Talwar, Secretary Problems: Weights and Discounts, Proceedings of SODA 2009; authors' full version, proceedings DOI.
7 thms2 active usersReviewed
🏆Completed
CombinatoricsOperations Research·Captain: mikedeng1

The Online Set Cover Problem 2: Given α ≥ c(C_OPT), the Weighted Potential-Function Algorithm Never Fails and Pays at Most (6+o(1)) α log m log nResearch Paper

Motivation

Set cover is one of the basic covering problems of combinatorial optimization: given a ground set and a family of subsets with costs, choose a cheapest subfamily whose union contains every element. In many applications the elements to be covered are not known in advance but appear over time: requests for a service that must be served by opening facilities, clients that must be assigned to servers, or constraints of a covering program that are revealed one at a time. Each arriving element must be covered at once, and decisions cannot be undone. This is the online set cover problem, introduced by Alon, Awerbuch, Azar, Buchbinder and Naor (SIAM J. Comput. 39(2), 2009; conference version STOC 2003).

The quality of an online algorithm is measured by its competitive ratio: the worst case, over all arrival sequences, of the ratio between the algorithm's cost and the cost of an optimal offline cover of the elements that actually arrived. The paper gives a deterministic algorithm with ratio O(log⁡mlog⁡n)O(\log m \log n)O(logmlogn), where nnn is the number of elements and mmm the number of sets, and shows a nearly matching lower bound for deterministic algorithms. Its algorithm for the weighted case, analysed with a potential function, became a template for the online primal–dual method surveyed by Buchbinder and Naor (Found. Trends Theor. Comput. Sci. 3(2–3), 2009).

This mission formalizes the core of the weighted result: the algorithm that is given a value α\alphaα at least the optimal cost, and its guarantee (Theorem 3.4).

Setting

The ground set XXX has n=∣X∣n = |X|n=∣X∣ elements and the family S\mathcal SS has m=∣S∣m = |\mathcal S|m=∣S∣ sets; every set SSS has a cost cS>0c_S > 0cS​>0. Both are known to the algorithm in advance. For an element jjj, Sj\mathcal S_jSj​ denotes the sets containing jjj. Elements of an unknown subset of XXX arrive one at a time in a sequence σ\sigmaσ; on arrival each must be covered by a chosen set. The chosen family C\mathcal CC can only grow. COPT\mathcal C_{OPT}COPT​ is any family covering every arriving element, and c(COPT)=∑S∈COPTcSc(\mathcal C_{OPT}) = \sum_{S \in \mathcal C_{OPT}} c_Sc(COPT​)=∑S∈COPT​​cS​.

The algorithm is given α≥c(COPT)\alpha \ge c(\mathcal C_{OPT})α≥c(COPT​). It discards sets costing more than α\alphaα, buys sets costing at most α/m\alpha/mα/m outright, and rescales costs; on the resulting normalized instance 1≤cS≤m1 \le c_S \le m1≤cS​≤m and cS≤αc_S \le \alphacS​≤α for every set (p. 365).

The algorithm keeps a weight wS>0w_S > 0wS​>0 for every set, initially wS=1/m2w_S = 1/m^2wS​=1/m2; the weight of an element is wj=∑S∈SjwSw_j = \sum_{S \in \mathcal S_j} w_Swj​=∑S∈Sj​​wS​. With CCC the set of covered elements and χC\chi_{\mathcal C}χC​ the indicator of C\mathcal CC, the potential is

Φ=∑j∉Cn2wj+n⋅exp⁡(12α∑S∈S(cSχC(S)−3wScSlog⁡n)),\Phi = \sum_{j \notin C} n^{2 w_j} + n \cdot \exp\Big(\frac{1}{2\alpha} \sum_{S \in \mathcal S} \big(c_S \chi_{\mathcal C}(S) - 3 w_S c_S \log n\big)\Big),Φ=j∈/C∑​n2wj​+n⋅exp(2α1​S∈S∑​(cS​χC​(S)−3wS​cS​logn)),

with natural logarithms throughout. When jjj arrives with wj≥1w_j \ge 1wj​≥1 nothing happens; otherwise the algorithm performs weight augmentation steps while wj<1w_j < 1wj​<1. In a step, for each S∈SjS \in \mathcal S_jS∈Sj​: (a) wS←wS(1+1ncS)w_S \leftarrow w_S (1 + \frac{1}{n c_S})wS​←wS​(1+ncS​1​); (b) if S∉CS \notin \mathcal CS∈/C, add SSS to C\mathcal CC when Φ\PhiΦ does not exceed its value before (a); (c) if Φ\PhiΦ has increased, return FAIL.

In Lean, the instance is the published OnlinePrimalDual.OnlineSetCover.SetCoverInstance over finite types X (elements) and T (sets), with the published elementWeight, coveredBy and potential. The run is OnlineSetCover.Weighted.Reachable inst α σ, the set of configurations reachable from initState σ under the transition relation Step.

Formalization targets

Goal: Theorem 3.4

On the normalized instance, with COPT\mathcal C_{OPT}COPT​ covering σ\sigmaσ, c(COPT)≤αc(\mathcal C_{OPT}) \le \alphac(COPT​)≤α, and n⋅n2/m+n<n2n \cdot n^{2/m} + n < n^2n⋅n2/m+n<n2, every reachable configuration is a running state (never FAIL) in which (i) every j∈Xj \in Xj∈X with wj≥1w_j \ge 1wj​≥1 is covered, and (ii)

∑S∈CcS≤3log⁡n(1+(1+1n)αlog⁡(m2(1+1n)))+2αlog⁡n=(6+o(1)) αlog⁡mlog⁡n.\sum_{S \in \mathcal C} c_S \le 3 \log n \Big(1 + \Big(1 + \frac1n\Big)\alpha \log\Big(m^2\Big(1+\frac1n\Big)\Big)\Big) + 2\alpha \log n = (6 + o(1))\,\alpha \log m \log n.S∈C∑​cS​≤3logn(1+(1+n1​)αlog(m2(1+n1​)))+2αlogn=(6+o(1))αlogmlogn.

Milestones

  • Lemma 3.1 (p. 365): the number NNN of augmentation steps satisfies N≤∑S∈COPT(ncS+1)log⁡(m2(1+1/n))≤(n+1)αlog⁡(m2(1+1/n))N \le \sum_{S \in \mathcal C_{OPT}} (n c_S + 1)\log(m^2(1 + 1/n)) \le (n+1)\alpha\log(m^2(1+1/n))N≤∑S∈COPT​​(ncS​+1)log(m2(1+1/n))≤(n+1)αlog(m2(1+1/n)).
  • Lemma 3.2 (p. 366): throughout, ∑SwScS≤1+N/n≤1+(1+1/n)αlog⁡(m2(1+1/n))\sum_S w_S c_S \le 1 + N/n \le 1 + (1 + 1/n)\alpha\log(m^2(1+1/n))∑S​wS​cS​≤1+N/n≤1+(1+1/n)αlog(m2(1+1/n)).
  • Lemma 3.3 (p. 366): a per-set step with cS≤αc_S \le \alphacS​≤α never increases Φ\PhiΦ; in particular the algorithm never fails.

The Proved platform theorem OnlinePrimalDual.OnlineSetCover.algorithm_correctness (the last paragraph of the proof of Theorem 3.4, with the invariant Φ<n2\Phi < n^2Φ<n2 assumed) is included as a supporting reference.

Significance

Theorem 3.4 is the analysis of the subroutine; with the doubling over guesses of α\alphaα described on pp. 364–365 (which loses a factor of at most 4) it yields the paper's deterministic O(log⁡mlog⁡n)O(\log m \log n)O(logmlogn)-competitive algorithm for weighted online set cover. The lower bound of Section 4 shows that no deterministic algorithm can do much better on general instances, so the result is close to the deterministic optimum. The technique, a potential that couples a fractional multiplicative-weights solution to a deterministic rounding, reappears in online covering and packing, online facility location and related problems.

The result is proved in the paper and restated in the Buchbinder–Naor monograph. On Prove2Me, the monograph's final step (from the invariant Φ<n2\Phi < n^2Φ<n2 to the cost bound) is a Proved theorem, and its expectation form of the monotonicity lemma is Disproved because it omits the hypothesis cS≤αc_S \le \alphacS​≤α. Neither the full statement about the algorithm's run nor Lemmas 3.1, 3.2 and the corrected Lemma 3.3 are formalized on the platform. This mission produces them, with the o(1)o(1)o(1) terms replaced by explicit expressions.

Difficulty

The cost bound in the last step is short once two facts about the run are available: that Φ\PhiΦ stays below n2n^2n2, and that the fractional cost ∑SwScS\sum_S w_S c_S∑S​wS​cS​ stays logarithmic. Neither is a local fact about one state. The first requires showing that, at every per-set step, one of the two deterministic choices (add SSS or not) does not increase Φ\PhiΦ; the paper proves this by a probabilistic argument over an auxiliary randomized choice, and the bound on the exponential term depends on the cost of the set being at most α\alphaα. The platform's earlier statement of this lemma, which omits that hypothesis, is Disproved. The second requires a bound on the number of augmentation steps over the whole run, which depends on the run's history and not on any single state. In Lean both are inductions over an operational semantics with real-valued exponentials and powers n2wjn^{2 w_j}n2wj​, where the initial bound Φ<n2\Phi < n^2Φ<n2 is a genuine size condition on nnn and mmm.

Formalization scope

The run is a small-step transition relation. A state records the weights, the cover, the number of augmentation steps begun, the elements not yet given, and the position inside the current step; FAIL is a separate terminal configuration. The order in which a step visits Sj\mathcal S_jSj​ is arbitrary and may differ between steps; every statement holds for every order. "Throughout the algorithm" means every reachable configuration, including those between per-set substeps. Arrival sequences are arbitrary lists (repetitions allowed) of elements covered by COPT\mathcal C_{OPT}COPT​.

Conventions: costs, weights and α\alphaα are real; nnn and mmm are the cardinalities of the finite types cast to R\mathbb RR; log⁡\loglog is Real.log; n2wjn^{2 w_j}n2wj​ and n2/mn^{2/m}n2/m are real powers. The paper's asymptotic expressions are replaced by what its proofs establish:

  • Lemma 3.1: (2+o(1))nαlog⁡m(2 + o(1)) n\alpha\log m(2+o(1))nαlogm becomes (n+1)αlog⁡(m2(1+1/n))(n+1)\alpha\log(m^2(1+1/n))(n+1)αlog(m2(1+1/n));
  • Lemma 3.2: (2+o(1))αlog⁡m(2 + o(1))\alpha\log m(2+o(1))αlogm becomes 1+(1+1/n)αlog⁡(m2(1+1/n))1 + (1+1/n)\alpha\log(m^2(1+1/n))1+(1+1/n)αlog(m2(1+1/n)), together with the intermediate bound 1+N/n1 + N/n1+N/n;
  • Theorem 3.4 (ii): (6+o(1))αlog⁡mlog⁡n(6 + o(1))\alpha\log m\log n(6+o(1))αlogmlogn becomes 3log⁡n (1+(1+1/n)αlog⁡(m2(1+1/n)))+2αlog⁡n3\log n\,(1 + (1+1/n)\alpha\log(m^2(1+1/n))) + 2\alpha\log n3logn(1+(1+1/n)αlog(m2(1+1/n)))+2αlogn;
  • "n and m large" becomes the hypothesis n⋅n2/m+n<n2n \cdot n^{2/m} + n < n^2n⋅n2/m+n<n2 used for the initial potential (it holds, for instance, when n≥4n \ge 4n≥4 and m≥3m \ge 3m≥3).

The goal is a statement about the configurations the algorithm actually reaches from wS=1/m2w_S = 1/m^2wS​=1/m2 and the empty cover. Taking the invariant Φ<n2\Phi < n^2Φ<n2 or the fractional-cost bound as a hypothesis on an arbitrary state would trivialize it, and is ruled out: those are exactly what the milestones establish. The doubling wrapper for unknown α\alphaα is not part of this mission.

A complete development needs an invariant for reachable states (positive weights, steps of an element processed in full), the per-set potential inequality, and the step-counting argument. The per-set inequality is reusable for the monograph's version of the algorithm. Contributions of proofs of any milestone, and of auxiliary invariants as separate lemmas, are welcome.

Selected references

  • N. Alon, B. Awerbuch, Y. Azar, N. Buchbinder, J. Naor, The Online Set Cover Problem, SIAM Journal on Computing 39(2):361–370, 2009. https://doi.org/10.1137/060661946
  • N. Buchbinder, J. Naor, The Design of Competitive Online Algorithms via a Primal–Dual Approach, Foundations and Trends in Theoretical Computer Science 3(2–3):93–263, 2009. https://doi.org/10.1561/0400000024
10 thms2 active usersReviewed
🏆Completed
CombinatoricsOperations Research·Captain: mikedeng1

The Online Set Cover Problem 3: Every Deterministic Online Algorithm Has Competitive Ratio at Least kr on the Block FamilyResearch Paper

Motivation

In the online set cover problem of Alon, Awerbuch, Azar, Buchbinder and Naor (SIAM J. Comput. 2009; preliminary version STOC 2003), a ground set and a family of subsets are known in advance, but the elements that actually need covering arrive one at a time, and each must be covered on arrival by sets chosen irrevocably. The paper's motivating example is a network of servers with activation costs: the set of potential clients is known, the clients that actually request service are not, and each request must be served on arrival.

The paper gives a deterministic online algorithm whose cost is within a factor O(log⁡mlog⁡n)O(\log m \log n)O(logmlogn) of the offline optimum, where nnn is the number of elements and mmm the number of sets. Its Section 4 shows that this is close to optimal for deterministic algorithms: for all interesting values of mmm and nnn, every deterministic online algorithm has competitive ratio Ω(log⁡nlog⁡m/(log⁡log⁡m+log⁡log⁡n))\Omega\big(\log n \log m / (\log\log m + \log\log n)\big)Ω(lognlogm/(loglogm+loglogn)). The lower bound is the reason the log⁡mlog⁡n\log m \log nlogmlogn product, rather than the ln⁡n\ln nlnn of offline approximation (Feige 1998), is the right target online. The online primal–dual framework that grew out of this paper (Buchbinder and Naor 2009) cites it as the benchmark for online covering problems.

This mission formalizes the exact, non-asymptotic statements behind that lower bound: Propositions 4.1 and 4.2 of the paper.

Setting

A ground set XXX and a family F\mathcal FF of distinct subsets of XXX are fixed and known to the algorithm; m=∣F∣m = |\mathcal F|m=∣F∣. An adversary presents elements x1,x2,…x_1, x_2, \dotsx1​,x2​,… of XXX one by one, choosing each after seeing the algorithm's previous responses. A deterministic online algorithm AAA, on the arrival of xtx_txt​, sees the earlier arrivals (x1,…,xt−1)(x_1, \dots, x_{t-1})(x1​,…,xt−1​) and xtx_txt​, and adds a finite family A((x1,…,xt−1),xt)⊆FA\big((x_1,\dots,x_{t-1}), x_t\big) \subseteq \mathcal FA((x1​,…,xt−1​),xt​)⊆F of sets to its collection; sets are never removed. It is valid if after every arrival that lies in some member of F\mathcal FF, that element lies in a chosen set. After an arrival sequence σ\sigmaσ the chosen collection is CA(σ)\mathcal C_A(\sigma)CA​(σ), and since every set has unit cost, the cost is ∣CA(σ)∣|\mathcal C_A(\sigma)|∣CA​(σ)∣. The offline optimum OPT(σ)\mathrm{OPT}(\sigma)OPT(σ) is the least number of members of F\mathcal FF covering the elements of σ\sigmaσ. The competitive ratio of AAA is at least ρ\rhoρ when some arrival sequence σ\sigmaσ has OPT(σ)≥1\mathrm{OPT}(\sigma) \ge 1OPT(σ)≥1 and ∣CA(σ)∣≥ρ OPT(σ)|\mathcal C_A(\sigma)| \ge \rho\,\mathrm{OPT}(\sigma)∣CA​(σ)∣≥ρOPT(σ).

Two families are used.

  • The bit family: X={0,…,2k−1}X = \{0, \dots, 2^k - 1\}X={0,…,2k−1} and Fi={j:bit i of j is on}F_i = \{ j : \text{bit } i \text{ of } j \text{ is on}\}Fi​={j:bit i of j is on} for 1≤i≤k1 \le i \le k1≤i≤k.
  • The block family: kr2k r^2kr2 disjoint blocks X1,…,Xkr2X_1, \dots, X_{kr^2}X1​,…,Xkr2​ of 2k2^k2k elements each; Xb(t)X_b(t)Xb​(t) is the set of elements of block XbX_bXb​ whose tttth bit is on. For an rrr-set R={b1<⋯<br}R = \{b_1 < \dots < b_r\}R={b1​<⋯<br​} of blocks and bit locations I=(i1,…,ir)I = (i_1, \dots, i_r)I=(i1​,…,ir​),
FR,I=⋃t=1rXbt(it),F_{R,I} = \bigcup_{t=1}^r X_{b_t}(i_t),FR,I​=t=1⋃r​Xbt​​(it​),

and the family consists of all FR,IF_{R,I}FR,I​; it has m=(kr2r)krm = \binom{kr^2}{r} k^rm=(rkr2​)kr members.

Formalization targets

Goal: Proposition 4.2

For all positive integers k,rk, rk,r and all n,mn, mn,m with

n≥2k+1kr2,22kkr2≥m≥(kr2r)kr,n \ge 2^{k+1} k r^2, \qquad 2^{2^k k r^2} \ge m \ge \binom{kr^2}{r} k^r,n≥2k+1kr2,22kkr2≥m≥(rkr2​)kr,

there is a family F\mathcal FF of exactly mmm distinct subsets of an nnn-element set such that for every valid deterministic online algorithm AAA there is a nonempty arrival sequence σ\sigmaσ, covered by a single member of F\mathcal FF, with

∣CA(σ)∣≥kr=kr⋅OPT(σ).|\mathcal C_A(\sigma)| \ge kr = kr \cdot \mathrm{OPT}(\sigma).∣CA​(σ)∣≥kr=kr⋅OPT(σ).

The goal leaves the instance existential, as the paper does, and keeps both bounds on mmm and the bound on nnn exactly as printed.

Milestones

  1. Proposition 4.1. On the bit family, ∣F∣=k|\mathcal F| = k∣F∣=k; every valid deterministic algorithm can be forced to cost kkk on a sequence with OPT=1\mathrm{OPT} = 1OPT=1; and some valid algorithm has cost at most k⋅∣C∣k \cdot |C|k⋅∣C∣ for every offline cover CCC. So the best deterministic competitive ratio is exactly k=log⁡2nk = \log_2 nk=log2​n.
  2. The adversary claim of Section 4 (p. 369). On the block family, every valid deterministic algorithm can be forced to choose krkrkr sets by at most krkrkr arrivals that a single set covers.

A supporting item (not a milestone) records the count ∣F∣=(kr2r)kr|\mathcal F| = \binom{kr^2}{r} k^r∣F∣=(rkr2​)kr of the block family.

Significance

The result. Proposition 4.2 is the exact statement behind the paper's lower bound: choosing rrr of order log⁡m/(log⁡log⁡m+log⁡log⁡n)\log m / (\log\log m + \log\log n)logm/(loglogm+loglogn) and kkk of order log⁡n\log nlogn turns it into the asymptotic bound Ω(log⁡nlog⁡m/(log⁡log⁡m+log⁡log⁡n))\Omega\big(\log n \log m/(\log\log m + \log\log n)\big)Ω(lognlogm/(loglogm+loglogn)), which shows that the paper's O(log⁡mlog⁡n)O(\log m \log n)O(logmlogn) algorithm is optimal among deterministic algorithms up to a log⁡log⁡m+log⁡log⁡n\log\log m + \log\log nloglogm+loglogn factor. Without it, the gap between the ln⁡n\ln nlnn achievable offline and the log⁡mlog⁡n\log m \log nlogmlogn achieved online would be unexplained. Proposition 4.1 alone gives the matching bound log⁡2n\log_2 nlog2​n when m=log⁡2nm = \log_2 nm=log2​n.

Formalizing it. Both propositions are proved in the paper; neither is formalized anywhere to our knowledge. The mission produces a reusable model of deterministic online algorithms against an adaptive adversary, with a validity notion and a cost, and machine-checked adversary arguments on it. The paper's proof tacitly lets the algorithm add one set per arrival; the statements here cover algorithms that add any number of sets per arrival, so a complete formalization also closes that gap.

Difficulty

The adversary must be adaptive, and the quantifiers are ordered instance, then algorithm, then arrival sequence. The obvious single-block argument (Proposition 4.1) forces only kkk sets. To force krkrkr sets with OPT=1\mathrm{OPT} = 1OPT=1, the adversary must move to blocks that no chosen set has touched yet, which requires counting the blocks touched by the sets chosen so far. When an algorithm adds many sets at once, the paper's count "at most 1+(r−1)k1 + (r-1)k1+(r−1)k blocks after kkk steps" no longer applies as written, and the stopping rule has to be phrased in terms of the cost already paid. The padding of Proposition 4.2 must reach exactly nnn elements and exactly mmm distinct sets without creating sets that help cover the adversary's elements.

Formalization scope

The ground set is a Fin type: Fin (2^k) for Proposition 4.1, Fin (k r²) × Fin (2^k) (block, element) for the block family, Fin n for Proposition 4.2. A family is a Finset (Finset X), so its cardinality counts distinct sets. Bit iii (1-based) of jjj is Nat.testBit j (i-1). An online algorithm is a function from (earlier arrivals in arrival order, current element) to the finite family of sets it adds; it may add any number of sets. Validity demands coverage only for elements that some member of the family contains. Costs are unit (the problem of Section 4 is unweighted).

The offline optimum is never encoded as an infimum: lower bounds exhibit a nonempty arrival sequence and a single covering set (OPT=1\mathrm{OPT} = 1OPT=1), and the upper bound of Proposition 4.1 quantifies over all offline covers. This rules out the trivializing reading in which the empty arrival sequence satisfies cost≥kr⋅OPT\text{cost} \ge kr \cdot \mathrm{OPT}cost≥kr⋅OPT as 0≥00 \ge 00≥0.

The statements contain no O(⋅)O(\cdot)O(⋅): every quantity is the paper's exact one. The asymptotic bound (8) under the range (7), whose final paragraph only sketches the choice of rrr and kkk, is excluded, as are the remarks on the trivial ratio-mmm and O(n)O(\sqrt n)O(n​) algorithms.

Contributions welcome: proofs of the milestones; lemmas on the chosen collection (monotonicity, decomposition along a sequence); the count of the block family; and the padding construction of Proposition 4.2. The online-algorithm model is reusable for other deterministic online covering lower bounds.

Selected references

  • N. Alon, B. Awerbuch, Y. Azar, N. Buchbinder, J. Naor, The Online Set Cover Problem, SIAM J. Comput. 39(2):361–370, 2009. https://doi.org/10.1137/060661946
  • N. Alon, B. Awerbuch, Y. Azar, N. Buchbinder, J. Naor, The online set cover problem, Proc. 35th ACM STOC, 2003, pp. 100–105. https://doi.org/10.1145/780542.780558
  • U. Feige, A threshold of ln n for approximating set cover, J. ACM 45(4):634–652, 1998. https://doi.org/10.1145/285055.285059
  • N. Buchbinder, J. Naor, The Design of Competitive Online Algorithms via a Primal–Dual Approach, Foundations and Trends in Theoretical Computer Science 3(2–3):93–263, 2009. https://doi.org/10.1561/0400000024
6 thms2 active usersReviewed
🏆Completed
CombinatoricsOperations Research·Captain: mikedeng1

The Online Set Cover Problem 1: A Deterministic O(log m log n)-Competitive Algorithm for Unweighted Online Set CoverResearch Paper

Motivation

Set cover asks for the fewest sets from a family S\mathcal SS of mmm subsets of a ground set XXX of nnn elements whose union contains XXX. It is NP-hard, and the best ratio achievable in polynomial time is Θ(log⁡n)\Theta(\log n)Θ(logn) (Feige 1998, doi:10.1145/285055.285059).

Alon, Awerbuch, Azar, Buchbinder and Naor (SIAM J. Comput. 39(2), 2009; preliminary version STOC 2003) introduced an online version. The instance (X,S)(X,\mathcal S)(X,S) is known in advance, but an adversary reveals elements one at a time, and each revealed element must be covered at once, by sets that can never be removed later. The set X′⊆XX'\subseteq XX′⊆X of elements that will actually be revealed is unknown. The paper's motivating example is a network of servers: the potential clients and the servers that can serve each client are known, but which clients will request service is not, and every activated server costs money.

The question is how much an algorithm loses against an offline adversary who knows X′X'X′ and covers it with a family COPT\mathcal C_{OPT}COPT​. This mission formalizes the paper's answer for unit costs (Section 2): a deterministic algorithm whose cover is within a factor O(log⁡mlog⁡n)O(\log m\log n)O(logmlogn) of ∣COPT∣|\mathcal C_{OPT}|∣COPT​∣. Section 3 of the paper extends the algorithm to weighted sets and Section 4 proves a nearly matching lower bound; those are separate missions of this series.

Setting

An instance consists of a finite ground set XXX with n=∣X∣n=|X|n=∣X∣ elements and a finite family S\mathcal SS of m=∣S∣m=|\mathcal S|m=∣S∣ sets. For an element jjj, Sj\mathcal S_jSj​ is the collection of sets containing jjj. Every set has cost 111, so the cost of a family is its number of members.

The adversary gives a sequence σ\sigmaσ of elements (the given elements form X′X'X′). A family COPT⊆S\mathcal C_{OPT}\subseteq\mathcal SCOPT​⊆S covers σ\sigmaσ if each element of σ\sigmaσ lies in some member of it.

The algorithm keeps a weight wS>0w_S>0wS​>0 for every set, initially wS=1/(2m)w_S=1/(2m)wS​=1/(2m), and a cover C\mathcal CC, initially empty. The weight of an element is wj=∑S∈SjwSw_j=\sum_{S\in\mathcal S_j}w_Swj​=∑S∈Sj​​wS​, and CCC is the set of elements covered by members of C\mathcal CC. The potential is

Φ=∑j∉Cn2wj.\Phi=\sum_{j\notin C}n^{2w_j}.Φ=j∈/C∑​n2wj​.

When the adversary gives an element jjj:

  1. if wj≥1w_j\ge1wj​≥1, nothing changes;
  2. otherwise a weight augmentation is performed: (a) kkk is the minimal integer with 2kwj>12^k w_j>12kwj​>1; (b) every S∈SjS\in\mathcal S_jS∈Sj​ gets the weight 2kwS2^k w_S2kwS​; (c) at most 4log⁡n4\log n4logn sets from Sj\mathcal S_jSj​ are added to C\mathcal CC, so that Φ\PhiΦ does not exceed its value before the augmentation.

Step (c) prescribes a property of the chosen sets, not the sets themselves. A run on σ\sigmaσ is any sequence of iterations, one per arrival, in which every iteration makes an admissible choice.

Formalization targets

Goal: Theorem 2.3

For n≥2n\ge2n≥2, every arrival sequence σ\sigmaσ, and every family COPT\mathcal C_{OPT}COPT​ covering σ\sigmaσ: a run of the algorithm on σ\sigmaσ exists, and every run ends with a cover C\mathcal CC that covers every element of σ\sigmaσ and satisfies

∣C∣  ≤  ⌈4ln⁡n⌉⋅∣COPT∣⋅(log⁡2m+2).|\mathcal C|\;\le\;\lceil 4\ln n\rceil\cdot|\mathcal C_{OPT}|\cdot(\log_2 m+2).∣C∣≤⌈4lnn⌉⋅∣COPT​∣⋅(log2​m+2).

The paper states ∣C∣=O(∣COPT∣log⁡mlog⁡n)|\mathcal C|=O(|\mathcal C_{OPT}|\log m\log n)∣C∣=O(∣COPT​∣logmlogn); the displayed bound is the constant its proof produces. Because the bound holds for every covering family, it holds in particular for an optimal one.

Milestones

Lemma 2.1. In every run, the number of iterations with a weight augmentation is at most

∣COPT∣⋅(log⁡2m+2).|\mathcal C_{OPT}|\cdot(\log_2 m+2).∣COPT​∣⋅(log2​m+2).

Lemma 2.2. In an iteration with a weight augmentation, from a state with positive weights, there is a family F⊆SjF\subseteq\mathcal S_jF⊆Sj​ with ∣F∣≤⌈4ln⁡n⌉|F|\le\lceil4\ln n\rceil∣F∣≤⌈4lnn⌉ such that

Φe≤Φs,\Phi_e\le\Phi_s,Φe​≤Φs​,

where Φs\Phi_sΦs​ is the potential before the iteration and Φe\Phi_eΦe​ the potential after it, computed with the augmented weights and the cover C∪F\mathcal C\cup FC∪F.

Significance

The theorem shows that online set cover over a known instance admits a deterministic O(log⁡mlog⁡n)O(\log m\log n)O(logmlogn)-competitive algorithm. Section 4 of the paper shows this is nearly optimal: no deterministic algorithm achieves o ⁣(log⁡mlog⁡nlog⁡log⁡m+log⁡log⁡n)o\!\left(\frac{\log m\log n}{\log\log m+\log\log n}\right)o(loglogm+loglognlogmlogn​) over a wide range of parameters. Its multiplicative weight updates were developed further into the online primal–dual framework for covering problems of Buchbinder and Naor (FnT TCS 3(2–3), 2009), whose Section 5.1 restates this algorithm.

The result is proved in the paper; it is not machine-checked. The Prove2Me platform has the weighted version's final counting step from the Buchbinder–Naor monograph, but no statement of Section 2. A complete development here gives a checked proof of the unweighted competitive ratio with an explicit constant, together with a reusable formal model of an online algorithm with a nondeterministic step, whose correctness includes the existence of an admissible choice at every step.

Difficulty

The central step is Lemma 2.2: a family of at most ⌈4ln⁡n⌉\lceil4\ln n\rceil⌈4lnn⌉ sets that keeps the potential from increasing must exist at every augmentation. The obvious rules fail. Adding every set of Sj\mathcal S_jSj​ can exceed the cardinality bound, since Sj\mathcal S_jSj​ may contain up to mmm sets. Adding nothing, or a single set, can increase Φ\PhiΦ: every uncovered element sharing a set with jjj has its weight raised, and its term n2wn^{2w}n2w grows by a factor up to n2δn^{2\delta}n2δ. The paper's argument is non-constructive, and a formal proof must establish existence for a finite averaging statement over real powers of nnn.

The second difficulty is that the algorithm is nondeterministic. A statement "every run has property P" is empty if no run exists, and the existence of a run is exactly Lemma 2.2 applied at every step under the invariants that weights stay positive and that each arriving element lies in some set. Feasibility (that every given element ends up covered) is not part of the algorithm's rule; it follows from the potential never increasing, which needs n≥2n\ge2n≥2 and a careful treatment of the initial potential, which is at most n2n^2n2 and equals n2n^2n2 when every element lies in every set.

Formalization scope

The instance is the published OnlinePrimalDual.OnlineSetCover.SetCoverInstance (finite types E of elements and T of set indices, incidence elemSets), with the published elementWeight (wjw_jwj​) and coveredBy (j∈Cj\in Cj∈C). Its positive cost field is not used: all sets have unit cost and the cover is measured by its cardinality. n=∣E∣n=|E|n=∣E∣ and m=∣T∣m=|T|m=∣T∣. Weights are real numbers; n2wjn^{2w_j}n2wj​ is the real power.

The algorithm is the definition OnlineSetCover.Unweighted.Algorithm: a relation Step for one iteration (recording whether a weight augmentation occurred) and Run for a sequence of iterations from the initial state, counting augmentations. Arrival sequences are lists and may repeat elements.

Explicit forms of the paper's asymptotic and unspecified quantities:

  • the paper's "4log⁡n4\log n4logn" sets per augmentation is ⌈4ln⁡n⌉\lceil 4\ln n\rceil⌈4lnn⌉ (natural logarithm, rounded up: the proof repeats a random choice that many times and needs (1−δ/2)4log⁡n≤n−2δ(1-\delta/2)^{4\log n}\le n^{-2\delta}(1−δ/2)4logn≤n−2δ);
  • Lemma 2.1's log⁡m+2\log m+2logm+2 is log⁡2m+2=log⁡2(4m)\log_2 m+2=\log_2(4m)log2​m+2=log2​(4m) (weights grow from 1/(2m)1/(2m)1/(2m) to at most 222 by factors at least 222);
  • Theorem 2.3's O(∣COPT∣log⁡mlog⁡n)O(|\mathcal C_{OPT}|\log m\log n)O(∣COPT​∣logmlogn) is ⌈4ln⁡n⌉⋅∣COPT∣⋅(log⁡2m+2)\lceil4\ln n\rceil\cdot|\mathcal C_{OPT}|\cdot(\log_2 m+2)⌈4lnn⌉⋅∣COPT​∣⋅(log2​m+2);
  • kkk ranges over natural numbers; for wj<1w_j<1wj​<1 the minimal integer with 2kwj>12^kw_j>12kwj​>1 is one;
  • the paper's remark "(Clearly, 2k⋅wj<22^k\cdot w_j<22k⋅wj​<2.)" is not encoded; the correct bound is ≤2\le2≤2 (wj=1/2w_j=1/2wj​=1/2 gives k=2k=2k=2) and is not a hypothesis anywhere.

The goal adds the hypothesis n≥2n\ge2n≥2, which the paper's log⁡n\log nlogn assumes tacitly: for n=1n=1n=1 no set may be added and the element is never covered.

Replacing the algorithm by the set of states whose potential is at most the initial one, or dropping the existence of a run from the goal, gives a weaker theorem; part (a) of the goal rules this out.

A complete development needs elementary real analysis (Real.rpow, Real.log, 1−x≤e−x1-x\le e^{-x}1−x≤e−x), a finite probabilistic or averaging argument for Lemma 2.2, and induction over runs. Contributions are welcome on any milestone; a derandomized averaging lemma for Lemma 2.2 would be reusable in the weighted mission of this series.

Selected references

  • N. Alon, B. Awerbuch, Y. Azar, N. Buchbinder, J. Naor, The Online Set Cover Problem, SIAM J. Comput. 39(2):361–370, 2009. https://doi.org/10.1137/060661946
  • U. Feige, A Threshold of ln n for Approximating Set Cover, J. ACM 45(4):634–652, 1998. https://doi.org/10.1145/285055.285059
  • N. Buchbinder, J. Naor, The Design of Competitive Online Algorithms via a Primal–Dual Approach, Foundations and Trends in Theoretical Computer Science 3(2–3):93–263, 2009. https://doi.org/10.1561/0400000024
7 thms2 active usersReviewed
🏆Completed
CombinatoricsOperations ResearchOptimization·Captain: mikedeng1

A Tight Linear Time (1/2)-Approximation for Unconstrained Submodular Maximization 1: Deterministic Double Greedy Achieves 1/3 of the OptimumResearch Paper

Motivation

A set function f:2N→Rf : 2^{\mathcal N} \to \mathbb Rf:2N→R on a finite ground set N\mathcal NN is submodular if it has diminishing returns, equivalently if f(A)+f(B)≥f(A∪B)+f(A∩B)f(A) + f(B) \ge f(A \cup B) + f(A \cap B)f(A)+f(B)≥f(A∪B)+f(A∩B) for all A,B⊆NA, B \subseteq \mathcal NA,B⊆N. Cut functions of graphs and hypergraphs, coverage functions, entropy, and many facility-location and welfare objectives are submodular. Unconstrained Submodular Maximization (USM) asks, given a nonnegative submodular fff through a value oracle, for a set S⊆NS \subseteq \mathcal NS⊆N of maximum value. It contains Max-Cut, Max-DiCut and Max Facility Location as special cases, and it is a subroutine in algorithms for constrained submodular maximization.

Timeline:

  • Feige, Mirrokni and Vondrák (FOCS 2007; SIAM J. Comput. 2011) gave a uniformly random set achieving 1/41/41/4 of the optimum, a deterministic local search achieving 1/3−ε/n1/3 - \varepsilon/n1/3−ε/n, a randomized local search achieving 2/52/52/5, and proved that no algorithm making polynomially many value queries achieves 1/2+ε1/2 + \varepsilon1/2+ε.
  • Oveis Gharan and Vondrák (SODA 2011) improved the ratio to about 0.410.410.41 by simulated annealing; Feldman, Naor and Schwartz (ICALP 2011) to about 0.420.420.42.
  • Buchbinder, Feldman, Naor and Schwartz (FOCS 2012; SIAM J. Comput. 2015) gave the double greedy algorithms: a deterministic linear-time 1/31/31/3-approximation (this mission) and a randomized linear-time 1/21/21/2-approximation, matching the query lower bound.

Setting

Let N\mathcal NN be a finite ground set and f:2N→R≥0f : 2^{\mathcal N} \to \mathbb R_{\ge 0}f:2N→R≥0​ a nonnegative submodular function. Write f(OPT)=max⁡S⊆Nf(S)f(OPT) = \max_{S \subseteq \mathcal N} f(S)f(OPT)=maxS⊆N​f(S), and let OPTOPTOPT denote a set attaining it.

Algorithm 1 (DeterministicUSM) fixes an arbitrary order u1,…,unu_1, \dots, u_nu1​,…,un​ of N\mathcal NN and maintains two solutions, starting from X0=∅X_0 = \emptysetX0​=∅ and Y0=NY_0 = \mathcal NY0​=N. In iteration i=1,…,ni = 1, \dots, ni=1,…,n it computes

ai=f(Xi−1∪{ui})−f(Xi−1),bi=f(Yi−1∖{ui})−f(Yi−1).a_i = f(X_{i-1} \cup \{u_i\}) - f(X_{i-1}), \qquad b_i = f(Y_{i-1} \setminus \{u_i\}) - f(Y_{i-1}).ai​=f(Xi−1​∪{ui​})−f(Xi−1​),bi​=f(Yi−1​∖{ui​})−f(Yi−1​).

If ai≥bia_i \ge b_iai​≥bi​ it sets Xi=Xi−1∪{ui}X_i = X_{i-1} \cup \{u_i\}Xi​=Xi−1​∪{ui​}, Yi=Yi−1Y_i = Y_{i-1}Yi​=Yi−1​; otherwise Xi=Xi−1X_i = X_{i-1}Xi​=Xi−1​, Yi=Yi−1∖{ui}Y_i = Y_{i-1} \setminus \{u_i\}Yi​=Yi−1​∖{ui​}. A tie adds uiu_iui​. After nnn iterations Xn=YnX_n = Y_nXn​=Yn​, which is the output.

The analysis uses the hybrid sets OPTi=(OPT∪Xi)∩YiOPT_i = (OPT \cup X_i) \cap Y_iOPTi​=(OPT∪Xi​)∩Yi​, which agree with XiX_iXi​ and YiY_iYi​ on u1,…,uiu_1, \dots, u_iu1​,…,ui​ and with OPTOPTOPT on ui+1,…,unu_{i+1}, \dots, u_nui+1​,…,un​. In Lean, the run is state f l i, the state (Xi,Yi)(X_i, Y_i)(Xi​,Yi​) after the first iii entries of the order l, and OPTiOPT_iOPTi​ is optI O (state f l i).

Formalization targets

Goal: Theorem I.1

For every nonnegative submodular fff and every order of N\mathcal NN,

Xn=Ynandf(OPT)≤3 f(Xn).X_n = Y_n \qquad\text{and}\qquad f(OPT) \le 3\, f(X_n).Xn​=Yn​andf(OPT)≤3f(Xn​).

Milestones

  1. Lemma II.1. For every 1≤i≤n1 \le i \le n1≤i≤n, ai+bi≥0a_i + b_i \ge 0ai​+bi​≥0.
  2. The hybrid sequence. OPTiOPT_iOPTi​ agrees with Xi,YiX_i, Y_iXi​,Yi​ on u1,…,uiu_1, \dots, u_iu1​,…,ui​ and with OPTOPTOPT on the rest; OPT0=OPTOPT_0 = OPTOPT0​=OPT and OPTn=Xn=YnOPT_n = X_n = Y_nOPTn​=Xn​=Yn​.
  3. Lemma II.2. For every 1≤i≤n1 \le i \le n1≤i≤n,
f(OPTi−1)−f(OPTi)≤[f(Xi)−f(Xi−1)]+[f(Yi)−f(Yi−1)].f(OPT_{i-1}) - f(OPT_i) \le [f(X_i) - f(X_{i-1})] + [f(Y_i) - f(Y_{i-1})].f(OPTi−1​)−f(OPTi​)≤[f(Xi​)−f(Xi−1​)]+[f(Yi​)−f(Yi−1​)].
  1. The telescoped display. f(OPT0)−f(OPTn)≤[f(Xn)−f(X0)]+[f(Yn)−f(Y0)]≤f(Xn)+f(Yn)f(OPT_0) - f(OPT_n) \le [f(X_n) - f(X_0)] + [f(Y_n) - f(Y_0)] \le f(X_n) + f(Y_n)f(OPT0​)−f(OPTn​)≤[f(Xn​)−f(X0​)]+[f(Yn​)−f(Y0​)]≤f(Xn​)+f(Yn​).
  2. Theorem II.3 (tightness). For every ε>0\varepsilon > 0ε>0 there is a nonnegative submodular fff with f(OPT)>0f(OPT) > 0f(OPT)>0 and an order on which f(Xn)≤(1/3+ε) f(OPT)f(X_n) \le (1/3 + \varepsilon)\, f(OPT)f(Xn​)≤(1/3+ε)f(OPT).

Significance

The result. Algorithm 1 is the deterministic member of the double greedy family. It makes one pass over the ground set with four value queries per element, and it guarantees 1/31/31/3 of the optimum for every order, without the polynomial-but-large running time and the ε/n\varepsilon/nε/n loss of local search. Its analysis, which charges the decrease of f(OPTi)f(OPT_i)f(OPTi​) to the increases of f(Xi)f(X_i)f(Xi​) and f(Yi)f(Y_i)f(Yi​), is the template the paper then refines into the randomized 1/21/21/2-approximation (Theorem I.2) and its continuous counterpart on the multilinear extension. Theorem II.3 shows that 1/31/31/3 is the exact ratio of this algorithm, so the improvement to 1/21/21/2 requires randomization (or a different deterministic rule) rather than a sharper analysis.

Formalizing it. The theorem is proved in the paper; to our knowledge it has no machine-checked proof. The mission produces a formal statement of the algorithm as printed, a checked proof of its guarantee for every order, and a checked tight instance. The definitions of the run and of OPTiOPT_iOPTi​ are the same objects the randomized and fractional analyses reason about, so a complete development here is the first step toward the paper's main theorem.

Difficulty

The individual inequalities are short; the difficulty lies in the bookkeeping. Each step needs the invariants Xi−1⊆Yi−1X_{i-1} \subseteq Y_{i-1}Xi−1​⊆Yi−1​ and ui∈Yi−1∖Xi−1u_i \in Y_{i-1} \setminus X_{i-1}ui​∈Yi−1​∖Xi−1​, which follow from the order being an enumeration (no repetitions, every element present), and the identification of OPTiOPT_iOPTi​ from OPTi−1OPT_{i-1}OPTi−1​ in each branch of the algorithm. Summing Lemma II.2 needs a telescoping over the run defined as a fold. The naive idea of comparing f(Xn)f(X_n)f(Xn​) with f(OPT)f(OPT)f(OPT) directly, without the hybrid sets, gives no bound: the greedy choices are made against XXX and YYY, not against OPTOPTOPT. For Theorem II.3 the difficulty is producing an explicit instance, checking that it is submodular and nonnegative, and tracing the run, including the ties, which the algorithm resolves by adding.

Formalization scope

  • The ground set is a finite type X with decidable equality; subsets are Finset X; fff is real valued, Finset X → ℝ, and nonnegativity is the hypothesis ∀ S, 0 ≤ f S where the page uses it (the goal, the telescoped display and the tight example). Lemma II.1, Lemma II.2 and the hybrid-sequence milestone do not assume it.
  • Submodularity is the lattice form f(A)+f(B)≥f(A∪B)+f(A∩B)f(A) + f(B) \ge f(A \cup B) + f(A \cap B)f(A)+f(B)≥f(A∪B)+f(A∩B) of the paper's footnote 1, through the published definition NonmonotoneSubmod.Shared.Submodular. The paper's main-text sentence ("for every A⊆B⊆NA \subseteq B \subseteq \mathcal NA⊆B⊆N and u∈Nu \in \mathcal Nu∈N") would force monotonicity when u∈B∖Au \in B \setminus Au∈B∖A and is read as the footnote. f(OPT)f(OPT)f(OPT) is the published NonmonotoneSubmod.Shared.OPT f, the maximum of fff over all subsets.
  • The order u1,…,unu_1, \dots, u_nu1​,…,un​ is a list l with l.Nodup and ∀ x, x ∈ l; uiu_iui​ is l[i - 1]. Every statement quantifies over all such lists. No nonemptiness of N\mathcal NN is assumed: for an empty ground set the goal reads f(∅)≤3f(∅)f(\emptyset) \le 3 f(\emptyset)f(∅)≤3f(∅).
  • The tie rule is line 5's ai≥bia_i \ge b_iai​≥bi​: ties add uiu_iui​.
  • Where a milestone mentions an optimal solution, it takes a set O with ∀ S, f S ≤ f O.
  • The goal is stated multiplied out, f(OPT)≤3f(Xn)f(OPT) \le 3 f(X_n)f(OPT)≤3f(Xn​), because f(OPT)f(OPT)f(OPT) may be 000.
  • Trivializing formalizations ruled out. The paper's Theorem I.1 reads "there exists a deterministic linear time (1/3)(1/3)(1/3)-approximation algorithm"; without the running time that existential is satisfied by exhaustive search, so the goal is the guarantee of the printed Algorithm 1 for every order. Running time is not formalized: the algorithm evaluates fff on four sets per element, nnn elements in all. Theorem II.3 requires f(OPT)>0f(OPT) > 0f(OPT)>0, without which f≡0f \equiv 0f≡0 would satisfy it.
  • Needed infrastructure: elementary lemmas on List.foldl over List.take, on membership in the states of the run, and on telescoping sums over 1≤i≤n1 \le i \le n1≤i≤n. A reusable lemma "the run keeps Xi⊆YiX_i \subseteq Y_iXi​⊆Yi​ and decides exactly u1,…,uiu_1, \dots, u_iu1​,…,ui​" would serve all three missions of this paper. Contributions of proofs of any milestone, of the goal from the milestones, and of the tight instance (e.g. the paper's five-vertex directed cut function) are welcome.

Selected references

  • N. Buchbinder, M. Feldman, J. Naor, R. Schwartz, A Tight Linear Time (1/2)-Approximation for Unconstrained Submodular Maximization, FOCS 2012. https://doi.org/10.1109/FOCS.2012.73 (journal version: SIAM J. Comput. 44(5), 2015, https://doi.org/10.1137/130929205)
  • U. Feige, V. S. Mirrokni, J. Vondrák, Maximizing Non-monotone Submodular Functions, SIAM J. Comput. 40(4), 2011. https://doi.org/10.1137/090779346
  • S. Oveis Gharan, J. Vondrák, Submodular Maximization by Simulated Annealing, SODA 2011. https://doi.org/10.1137/1.9781611973082.83
  • M. Feldman, J. Naor, R. Schwartz, Nonmonotone Submodular Maximization via a Structural Continuous Greedy Algorithm, ICALP 2011. https://doi.org/10.1007/978-3-642-22006-7_29
9 thms2 active usersReviewed
Linear OptimizationOperations ResearchOptimization+1·Captain: mikedeng1

Smoothed Analysis of Algorithms: Why the Simplex Algorithm Usually Takes Polynomial Time 2: The Two-Phase Shadow-Vertex Simplex Method Has Polynomial Smoothed ComplexityResearch Paper

Motivation

The simplex method solves linear programs by moving between vertices of a feasible polyhedron. Its worst-case number of moves can grow exponentially, yet it often performs well on ordinary inputs. Worst-case examples alone therefore give an incomplete account of the method’s behavior. Spielman and Teng introduced smoothed analysis to measure expected performance after small random perturbations of an arbitrary input. Their result for a two-phase shadow-vertex simplex method gives a polynomial bound in the input dimensions and inverse perturbation scale. The pinned preprint is the source for every theorem number and constant in this mission.

The paper separates a geometric result about the expected size of a polytope’s shadow (Theorem 4.0.1) from the algorithmic result here (Theorem 5.0.1). That separation matters: a plane chosen before perturbation and a plane chosen by a running algorithm have different distributions. This mission addresses the latter. It complements the standard-form simplex theorems already formalized in the Introduction to Linear Optimization series and the worst-case Klee–Minty result in the Smale’s Ninth Problem mission; those results concern different algorithms or input models and are context rather than imported statements.

Setting

A linear program is specified by vectors a1,…,an∈Rda_1,\ldots,a_n\in\mathbb R^da1​,…,an​∈Rd, right-hand sides y1,…,yn∈Ry_1,\ldots,y_n\in\mathbb Ry1​,…,yn​∈R, and an objective vector z∈Rdz\in\mathbb R^dz∈Rd:

max⁡x⟨z,x⟩subject to⟨ai,x⟩≤yi(1≤i≤n).\max_x\langle z,x\rangle\quad\text{subject to}\quad \langle a_i,x\rangle\le y_i\qquad(1\le i\le n).xmax​⟨z,x⟩subject to⟨ai​,x⟩≤yi​(1≤i≤n).

The paper’s two-phase shadow-vertex method first draws a collection I\mathcal II of ddd-element subsets of [n][n][n] and chooses one whose constraint matrix AIA_IAI​ has the largest smallest singular value. It sets a power-of-two scale MMM from the input norm and a power-of-two scale κ\kappaκ from that singular value. These determine positive relaxed right-hand sides yi′y'_iyi′​: MMM for i∈Ii\in Ii∈I and dM2/(4κ)\sqrt d M^2/(4\kappa)d​M2/(4κ) otherwise. A coefficient vector α\alphaα is chosen uniformly from A1/d2={α:∑i∈Iαi=1, αi≥1/d2}A_{1/d^2}=\{\alpha:\sum_{i\in I}\alpha_i=1,\ \alpha_i\ge1/d^2\}A1/d2​={α:∑i∈I​αi​=1, αi​≥1/d2}. The first phase solves the relaxed program LP′ from the objective AIαA_I\alphaAI​α.

The second phase uses a lifted program LP⁺ in Rd+1\mathbb R^{d+1}Rd+1. For each original constraint it forms ai+=((yi′−yi)/2,ai)a_i^+=((y'_i-y_i)/2,a_i)ai+​=((yi′​−yi​)/2,ai​) and yi+=(yi′+yi)/2y_i^+=(y'_i+y_i)/2yi+​=(yi′​+yi​)/2, together with two artificial constraints at first coordinates 111 and −1-1−1. LP⁺ connects LP′ to the original program and makes infeasibility detectable. Its shadow is taken in the plane of (0,z)(0,z)(0,z) and z+=(1,0,…,0)z^+=(1,0,\ldots,0)z+=(1,0,…,0).

For positive right-hand sides, an optimal polar simplex is a ddd-subset of constraints whose scaled vectors ai/yia_i/y_iai​/yi​ form a facet of ConvHull⁡(0,a1/y1,…,an/yn)\operatorname{ConvHull}(0,a_1/y_1,\ldots,a_n/y_n)ConvHull(0,a1​/y1​,…,an​/yn​) and whose unscaled cone contains an objective qqq. The shadow for objectives t,zt,zt,z is the union of these simplices over all qqq in Span⁡(t,z)\operatorname{Span}(t,z)Span(t,z). Its size bounds the number of polar pivots. In Section 5 the paper writes Sz′S'_zSz′​ for the first-phase shadow size and Sz+S_z^+Sz+​ for the second-phase shadow size without the two artificial pivots.

The input is perturbed by independent Gaussians: each coordinate of aia_iai​ and each yiy_iyi​ has its prescribed center and common standard deviation σR\sigma RσR, where R=max⁡i∥(yˉi,aˉi)∥2R=\max_i\|(\bar y_i,\bar a_i)\|_2R=maxi​∥(yˉ​i​,aˉi​)∥2​. The algorithm has separate random choices of I\mathcal II and α\alphaα.

Formalization targets

The immediate targets bound the two phases: Lemma 5.2.1 gives an explicit expectation bound for Sz′S'_zSz′​ and Lemma 5.3.1 gives one for Sz+S_z^+Sz+​. Lemma 5.1.1 and its corollaries control the chance that the chosen basis has a very small singular value. Corollary 4.3.3 extends the geometric shadow bound to positive, unequal right-hand sides and general Gaussian covariance. These are the mission’s milestone targets.

The goal is the shape of Theorem 5.0.1. With C(A,y,z)=EI,α(Sz′+Sz++2)C(A,y,z)=\mathbb E_{\mathcal I,\alpha}(S'_z+S_z^++2)C(A,y,z)=EI,α​(Sz′​+Sz+​+2), there are a single polynomial P\mathcal PP and a positive constant σ0\sigma_0σ0​ such that, for all n>d≥3n>d\ge3n>d≥3 and all centers and objectives,

EA,yC(A,y,z)≤min⁡{P(d,n,1min⁡(σ,σ0)),(nd)+(nd+1)+2}.\mathbb E_{A,y}C(A,y,z)\le \min\left\{\mathcal P\left(d,n,\frac1{\min(\sigma,\sigma_0)}\right), \binom nd+\binom n{d+1}+2\right\}.EA,y​C(A,y,z)≤min{P(d,n,min(σ,σ0​)1​),(dn​)+(d+1n​)+2}.

The polynomial is uniform over the dimensions and inputs; its coefficients are not prescribed. The bound on CCC implies the corresponding result for the actual pivot count through the paper’s step-to-shadow comparison. The goal is stated with a positive center scale RRR, the case in which the paper’s Gaussian rescaling applies.

Significance

The theorem places the number of pivots of a complete simplex method under one explicit perturbation model, including the work needed to find a starting feasible basis and handle an arbitrary right-hand side. The trivial binomial bound is retained because it controls rare events in the proof and is part of the stated result. The polynomial bound says that even when the unperturbed LP is adversarial, Gaussian noise of a controlled scale makes the expected shadow-size cost polynomial.

The paper proves the mathematical result. This mission asks for machine-checked proofs of its statement and the listed milestones; the draft Lean declarations are targets with sorry, not completed proofs. The reusable formal infrastructure is the finite polar simplex and shadow construction, product Gaussian input law, smallest-singular-value events for sampled minors, and the uniform truncated-simplex coefficient law. The two shadow-size lemmas also require explicit handling of measurable finite-valued counts and their expectations.

Difficulty

The basic shadow estimate fixes its projection plane before perturbing the constraints. In LP′, the initial objective AIαA_I\alphaAI​α uses a basis selected after the perturbation, so the relevant plane depends on the random LP. The fixed-plane theorem cannot be substituted directly. For LP⁺, the normalized lifted vectors ai+/yi+a_i^+/y_i^+ai+​/yi+​ are nonlinear functions of Gaussian data; they are generally not Gaussian vectors. Thus the same shadow estimate does not apply directly to their law either. A further issue is that a poor sampled basis can make y′y'y′ very large. These are distinct obstacles, reflected in the milestone groups from Sections 5.1, 5.2, and 5.3.

Formalization scope

Vectors are EuclideanSpace ℝ (Fin d), constraints are Fin n → EuclideanSpace ℝ (Fin d), and index families are finite sets of Fin n. The paper’s [n][n][n] starts at one; Fin n starts at zero. The Gaussian constructor receives variance σ2\sigma^2σ2, not standard deviation σ\sigmaσ. The 3ndln⁡n3nd\ln n3ndlnn draws are rounded upward and are independent uniform draws with replacement. Equal singular values are resolved by the first sampled set. The uniform law on AδA_\deltaAδ​ is represented by normalized independent exponential weights followed by the affine shift that imposes αi≥δ\alpha_i\ge\deltaαi​≥δ.

The Lean definition of CCC is exactly the Section 5 shadow-size upper bound E(Sz′+Sz++2)\mathbb E(S'_z+S_z^++2)E(Sz′​+Sz+​+2), computed from the sampled LP data. It is not an arbitrary cost variable. The actual algorithmic step bound needs the paper’s polar algorithm and Lemma 3.3.5. The goal explicitly asks for inner and outer integrability so Lean’s default value for a nonintegrable Bochner integral cannot make the result vacuous. The source’s all-zero center scale is excluded because it gives zero perturbation and defeats the rescaling used in Theorem 5.0.1.

For LP⁺ the vectors live in Rd+1\mathbb R^{d+1}Rd+1, so the two LP⁺ milestone bounds use D(n,d+1,⋅)\mathcal D(n,d+1,\cdot)D(n,d+1,⋅). The preprint prints ddd in those calls even though the preceding extension theorem would be applied in dimension d+1d+1d+1. Lemma 5.2.1 is written as an inequality: its printed equality is stronger than the bound established on page 71. These corrections are visible in the theorem titles and notes. Contributions that prove the exact statements, establish the measurability and Gaussian law facts, or formalize the step-to-shadow comparison are welcome.

Selected references

  • Daniel A. Spielman and Shang-Hua Teng, Smoothed Analysis of Algorithms: Why the Simplex Algorithm Usually Takes Polynomial Time, arXiv:cs/0111050v7, 2003, preprint. The PDF used here is the 96-page version with printed and PDF page numbers aligned.
22 thms2 active usersReviewed
PreviousPage 10 of 19Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me