Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Theoretical Computer Science

464 missions · 244 completed

The mathematical foundations of computation: which problems can be solved, by what algorithms, and at what cost in time, space, or communication. Distinguished by its emphasis on rigor and unconditional lower bounds, it spans computational complexity, algorithm design, automata and computability, cryptography, and the analysis of Boolean functions.

Missions

Open220Completed244All464
Linear OptimizationOperations Research·Captain: mikedeng1

Online Primal-Dual Algorithms for Covering and Packing 4: Online Rounding of the Fractional Routing Scheme Respects Capacities and Is O(log P(max)·[exp(1 + 2 ln m/u(min)) − 1])-CompetitiveResearch Paper

Motivation

In online routing of virtual circuits, connection requests between pairs of nodes of a capacitated network arrive one at a time. Each request must be accepted and routed on a single path with bandwidth 111, or rejected, immediately and irrevocably, and no edge may carry more than its capacity. The goal is to maximize the number of accepted requests (the throughput). The model goes back to Awerbuch, Azar and Plotkin (FOCS 1993), whose deterministic algorithm has a logarithmic competitive ratio when edge capacities are at least logarithmic in the size of the network, and it underlies the analysis of admission control in circuit-switched and bandwidth-reserved networks.

Buchbinder and Naor (Math. Oper. Res. 2009) recover an algorithm with the same competitive factor from a general recipe: an online primal–dual scheme first produces a feasible fractional routing online, and an online version of Raghavan's pessimistic estimator (J. Comput. Syst. Sci. 1988) then rounds it, also online. This mission formalizes that construction and its guarantee (Section 5.2 of the paper, with the Section 3 scheme it uses).

Timeline:

  • 1987–1988: Raghavan and Thompson introduce randomized rounding for multicommodity flow; Raghavan derandomizes it with pessimistic estimators.
  • 1993: Awerbuch, Azar and Plotkin give the deterministic throughput-competitive online routing algorithm.
  • 2005–2009: Buchbinder and Naor's primal–dual framework (ESA 2005; MOR 2009) derives an algorithm with the same factor systematically.

Setting

Let EEE be a finite set of mmm edges with capacities u(e)>0u(e) > 0u(e)>0, and u(min⁡)=min⁡eu(e)u(\min) = \min_e u(e)u(min)=mine​u(e). Requests r1,r2,…r_1, r_2, \dotsr1​,r2​,… arrive online; request rir_iri​ comes with a finite list P(ri)\mathcal P(r_i)P(ri​) of admissible paths, each a set of edges, all of size at most P(max⁡)P(\max)P(max).

A fractional routing assigns flows f(ri,P)≥0f(r_i, P) \ge 0f(ri​,P)≥0; it is feasible when ∑P∈P(ri)f(ri,P)≤1\sum_{P \in \mathcal P(r_i)} f(r_i, P) \le 1∑P∈P(ri​)​f(ri​,P)≤1 for every request and the load ∑ri∑P∋ef(ri,P)\sum_{r_i}\sum_{P \ni e} f(r_i, P)∑ri​​∑P∋e​f(ri​,P) of every edge is at most u(e)u(e)u(e). Its value is val(f)=∑ri∑Pf(ri,P)\mathrm{val}(f) = \sum_{r_i}\sum_P f(r_i, P)val(f)=∑ri​​∑P​f(ri​,P); OPT\mathrm{OPT}OPT is the largest value of a feasible routing of the arrived requests, an upper bound on the integral optimum.

The fractional scheme. The covering LP paired with the routing LP (the paper's primal, Fig. 3) has variables x(e)x(e)x(e) (cost u(e)u(e)u(e)) and Z(ri)Z(r_i)Z(ri​) (cost 111) with constraints ∑e∈Px(e)+Z(ri)≥1\sum_{e \in P} x(e) + Z(r_i) \ge 1∑e∈P​x(e)+Z(ri​)≥1. When rir_iri​ arrives, its paths are visited in order; for each path whose constraint fails, f(ri,P)f(r_i,P)f(ri​,P) is raised from 000 to the least value restoring it, while x(e)=max⁡(x(e),1ℓ(eB′Fe/(2u(e))−1))x(e) = \max\big(x(e), \tfrac1\ell(e^{B' F_e/(2u(e))}-1)\big)x(e)=max(x(e),ℓ1​(eB′Fe​/(2u(e))−1)) for e∈Pe \in Pe∈P and Z(ri)=max⁡(Z(ri),1ℓ(eB′f(ri)/2−1))Z(r_i) = \max\big(Z(r_i), \tfrac1\ell(e^{B' f(r_i)/2}-1)\big)Z(ri​)=max(Z(ri​),ℓ1​(eB′f(ri​)/2−1)) follow the flow (FeF_eFe​ the load of eee, f(ri)f(r_i)f(ri​) the flow of rir_iri​). The parameters are ℓ=P(max⁡)+1\ell = P(\max)+1ℓ=P(max)+1 and B′=2ln⁡(1+ℓ)B' = 2\ln(1+\ell)B′=2ln(1+ℓ).

The rounding. With the rounding scale B=exp⁡(1+ln⁡(2m)/u(min⁡))−1B = \exp(1 + \ln(2m)/u(\min)) - 1B=exp(1+ln(2m)/u(min))−1, the integral edge usage χ(e)\chi(e)χ(e) and the number sss of served requests, the potential is Φ=Φ1+Φ2\Phi = \Phi_1 + \Phi_2Φ=Φ1​+Φ2​,

Φ1=12exp⁡(val(f)2B−sln⁡2),Φ2=12m∑eexp⁡((1+ln⁡2mu(e))χ(e)−Fe).\Phi_1 = \tfrac12\exp\Big(\frac{\mathrm{val}(f)}{2B} - s\ln 2\Big), \qquad \Phi_2 = \frac1{2m}\sum_{e}\exp\Big(\Big(1+\frac{\ln 2m}{u(e)}\Big)\chi(e) - F_e\Big).Φ1​=21​exp(2Bval(f)​−sln2),Φ2​=2m1​e∑​exp((1+u(e)ln2m​)χ(e)−Fe​).

After the fractional round of rir_iri​, the algorithm serves rir_iri​ on a path P∈P(ri)P \in \mathcal P(r_i)P∈P(ri​) (adding 111 to χ(e)\chi(e)χ(e) for e∈Pe \in Pe∈P) if this gives potential at most the potential Φstart\Phi^{\mathrm{start}}Φstart before the round; otherwise it rejects rir_iri​.

Formalization targets

Goal: Lemma 5.4

For every request sequence, the algorithm never exceeds a capacity, and for every feasible fractional routing fff,

χ(e)≤u(e)  ∀e,∑riχ(ri) ≥ val(f)4Bln⁡2⋅ln⁡(P(max⁡)+2)−1.\chi(e) \le u(e)\ \ \forall e, \qquad \sum_{r_i}\chi(r_i) \ \ge\ \frac{\mathrm{val}(f)}{4B\ln 2\cdot\ln(P(\max)+2)} - 1 .χ(e)≤u(e)  ∀e,ri​∑​χ(ri​) ≥ 4Bln2⋅ln(P(max)+2)val(f)​−1.

Milestone: Theorem 3.2 (packing half, on routing)

The fractional scheme's flows falgf^{\mathrm{alg}}falg are feasible and val(f)≤2ln⁡(P(max⁡)+2) val(falg)\mathrm{val}(f) \le 2\ln(P(\max)+2)\,\mathrm{val}(f^{\mathrm{alg}})val(f)≤2ln(P(max)+2)val(falg) for every feasible fff.

Milestone: Lemma 5.3

Φ≤1\Phi \le 1Φ≤1 initially, Φ>0\Phi > 0Φ>0 always, and whenever the flows of a request are raised by a non-negative amount of total at most 111, serving the request on some path or rejecting it does not increase Φ\PhiΦ.

Significance

The result shows that a deterministic online algorithm for throughput-competitive routing, previously designed by hand, falls out of two generic components: an online fractional packing scheme and an online pessimistic estimator. A side product is that the fractional phase alone produces, online, a near-optimal routing that respects all capacities exactly, independently of their size. When u(min⁡)≥log⁡nu(\min) \ge \log nu(min)≥logn the rounding loses only a constant factor and the algorithm is O(log⁡P(max⁡))O(\log P(\max))O(logP(max))-competitive, as in Awerbuch–Azar–Plotkin.

The results are proved in the paper; none is machine-checked. A formalization supplies a checked instance of the online primal–dual method together with derandomized online rounding, and fixes the constants the paper leaves inside O(⋅)O(\cdot)O(⋅). Related platform content: the monograph's OnlinePrimalDual.Routing.per_copy_guarantee and routing_competitive concern the Buchbinder–Naor (1,O(log⁡n))(1, O(\log n))(1,O(logn))-competitive algorithm with copies of the graph, a different scheme.

Difficulty

The fractional guarantee is argued in the paper continuously (rates of change of the primal and dual values), while the scheme as formalized is discrete: each flow is the least value restoring a constraint, and every primal variable is a maximum whose branch may switch during the increase. The continuous argument does not transfer verbatim, and feasibility depends on the least value restoring the constraint with equality.

The rounding is a derandomization. The existence of a good path or a good rejection is established in the paper as an expectation over a random trial; a deterministic statement about finitely many alternatives is what the mission asks for, with all m+1m+1m+1 exponential terms of Φ\PhiΦ under control at once. A frequent first attempt compares with the potential after the fractional round; the rule compares with Φstart\Phi^{\mathrm{start}}Φstart, before the flow increase, and the guarantee is stated for that comparison.

Formalization scope

  • Edges are a non-empty Fintype E; capacities are real and positive. A request is a List (Finset E) of paths; the request sequence is a list. Simple paths of a graph are a special case; nothing in the argument uses graph structure. P(max⁡)P(\max)P(max) is a parameter with every path of size at most P(max⁡)P(\max)P(max).
  • A routing is a List (List ℝ) of the shape of the request sequence. OPT\mathrm{OPT}OPT is quantified as "every feasible fractional routing".
  • The continuous increase is its discrete equivalent (an attained sInf). Ties among good paths are broken by list order; only paths that received flow in the current round are candidates for serving, so a request whose flow was not increased is rejected.
  • Explicit constants replacing O(⋅)O(\cdot)O(⋅): Theorem 3.2's O(log⁡ℓ)O(\log \ell)O(logℓ) becomes 2ln⁡(1+ℓ)=2ln⁡(P(max⁡)+2)2\ln(1+\ell) = 2\ln(P(\max)+2)2ln(1+ℓ)=2ln(P(max)+2); Lemma 5.4's O(log⁡P(max⁡)⋅[exp⁡(1+2ln⁡m/u(min⁡))−1])O(\log P(\max)\cdot[\exp(1+2\ln m/u(\min))-1])O(logP(max)⋅[exp(1+2lnm/u(min))−1]) becomes 4Bln⁡2⋅ln⁡(P(max⁡)+2)4B\ln 2\cdot\ln(P(\max)+2)4Bln2⋅ln(P(max)+2) with additive −1-1−1, where B=exp⁡(1+ln⁡(2m)/u(min⁡))−1B = \exp(1+\ln(2m)/u(\min))-1B=exp(1+ln(2m)/u(min))−1 is the scale chosen on p. 15. The printed "2ln⁡m2\ln m2lnm" differs from the proof's "ln⁡2m\ln 2mln2m"; the proof's constant is used (it is at least as strong for m≥2m \ge 2m≥2). All logarithms are natural.
  • The algorithm is a fully specified function: a formalization in which requests are never served, or OPT\mathrm{OPT}OPT is a free variable pinned by hypotheses, would trivialize the goal and is ruled out.
  • Not included: the covering half of Theorem 3.2, and the remark on u(min⁡)≥log⁡nu(\min) \ge \log nu(min)≥logn.

Contributions welcome: proofs of the milestones, a reusable lemma "convex combination ≤\le≤ value ⇒\Rightarrow⇒ some outcome ≤\le≤ value" for derandomization, and the discrete-to-continuous bridge for the Section 3 scheme.

Selected references

  • N. Buchbinder, J. Naor, Online Primal-Dual Algorithms for Covering and Packing, Mathematics of Operations Research, 2009. https://doi.org/10.1287/moor.1080.0363
  • B. Awerbuch, Y. Azar, S. Plotkin, Throughput-Competitive On-Line Routing, Proc. 34th FOCS, pp. 32–40, 1993. https://doi.org/10.1109/SFCS.1993.366884
  • P. Raghavan, Probabilistic construction of deterministic algorithms: approximating packing integer programs, J. Comput. Syst. Sci. 37(2), 1988. https://doi.org/10.1016/0022-0000(88)90003-7
  • P. Raghavan, C. D. Thompson, Randomized rounding: a technique for provably good algorithms and algorithmic proofs, Combinatorica 7(4), 1987. https://doi.org/10.1007/BF02579324
7 thms1 active userReviewed
Linear OptimizationOperations Research·Captain: mikedeng1

Online Primal-Dual Algorithms for Covering and Packing 1: The Online Fractional Packing Scheme Is B-Competitive and Violates Each Packing Constraint by at Most 2 log(1 + n·a_i(max)/a_i(min))/BResearch Paper

Motivation

Many resource-allocation problems arrive one request at a time and must be answered immediately: a bandwidth request is admitted or refused when it appears, an advertiser's budget is charged when a query arrives, a job is accepted before later jobs are seen. Their linear-programming relaxations are packing problems: maximize a total profit subject to capacity constraints, where the variables are revealed online and each must be set irrevocably when it is revealed. A standard yardstick for such an online algorithm is its competitive ratio, the worst-case ratio between the offline optimum and the algorithm's value.

Buchbinder and Naor (Math. Oper. Res. 2009) gave a single online primal-dual scheme for the general online fractional packing problem, together with a matching scheme for covering. The scheme raises the newly revealed packing variable while increasing the dual covering variables along an exponential curve, and its analysis is a short primal-dual argument. Earlier online algorithms for throughput-competitive routing and for set cover (Alon et al. 2009) can be read as instances of it, and the same template later became the basis of a monograph on the primal-dual approach to online algorithms (Buchbinder, Naor 2009).

This mission formalizes the paper's headline result, Theorem 3.1, for the scheme exactly as the paper defines it.

Setting

Fix a finite set III of n≥1n\ge1n≥1 packing constraints (equivalently, primal covering variables), with known capacities c(i)>0c(i)>0c(i)>0. Packing variables y(1),…,y(m)y(1),\dots,y(m)y(1),…,y(m) arrive one per round; in round jjj the variable y(j)y(j)y(j) is revealed together with its non-negative column a(i,j)a(i,j)a(i,j), i∈Ii\in Ii∈I. The offline problems form the primal-dual pair of Figure 1 of the paper:

(P) min⁡∑ic(i)x(i)  s.t. ∑ia(i,j)x(i)≥1 ∀j, x≥0;(D) max⁡∑jy(j)  s.t. ∑ja(i,j)y(j)≤c(i) ∀i, y≥0.\text{(P)}\ \min\sum_i c(i)x(i)\ \text{ s.t. } \sum_i a(i,j)x(i)\ge1\ \forall j,\ x\ge0;\qquad \text{(D)}\ \max\sum_j y(j)\ \text{ s.t. } \sum_j a(i,j)y(j)\le c(i)\ \forall i,\ y\ge0.(P) mini∑​c(i)x(i)  s.t. i∑​a(i,j)x(i)≥1 ∀j, x≥0;(D) maxj∑​y(j)  s.t. j∑​a(i,j)y(j)≤c(i) ∀i, y≥0.

The profit of every y(j)y(j)y(j) is normalized to 111. Every column is assumed to have a positive entry; otherwise the packing problem is unbounded. An online algorithm may set y(j)y(j)y(j) only in round jjj and never changes it later.

The scheme with parameter B>0B>0B>0 keeps a primal vector xxx (initially 000) and the dual vector yyy. In round jjj it computes the prefix maximum ai(max⁡)=max⁡k≤ja(i,k)a_i(\max)=\max_{k\le j}a(i,k)ai​(max)=maxk≤j​a(i,k). If the new covering constraint ∑ia(i,j)x(i)≥1\sum_i a(i,j)x(i)\ge1∑i​a(i,j)x(i)≥1 already holds, it sets y(j)=0y(j)=0y(j)=0. Otherwise it sets y(j)y(j)y(j) to the least t≥0t\ge0t≥0 at which the constraint holds after every x(i)x(i)x(i) is replaced by

max⁡{x(i), 1n ai(max⁡)[exp⁡(B2c(i)∑k=1ja(i,k)y(k))−1]},y(j)=t.\max\Big\{x(i),\ \frac{1}{n\,a_i(\max)}\Big[\exp\Big(\frac{B}{2c(i)}\sum_{k=1}^{j}a(i,k)y(k)\Big)-1\Big]\Big\},\qquad y(j)=t.max{x(i), nai​(max)1​[exp(2c(i)B​k=1∑j​a(i,k)y(k))−1]},y(j)=t.

After rrr rounds, X(r)=∑ic(i)x(i)X(r)=\sum_i c(i)x(i)X(r)=∑i​c(i)x(i) is the primal value and Y(r)=∑k≤ry(k)Y(r)=\sum_{k\le r}y(k)Y(r)=∑k≤r​y(k) the dual value. For the analysis, ai(max⁡)a_i(\max)ai​(max) and ai(min⁡)a_i(\min)ai​(min) also denote the largest and the smallest non-zero coefficient of row iii over all mmm columns.

Formalization targets

Goal: Theorem 3.1

For every B>0B>0B>0, the scheme's dual solution is non-negative; after every round rrr, every non-negative y′y'y′ that satisfies the packing constraints restricted to the first rrr columns has ∑k≤ry′(k)≤B Y(r)\sum_{k\le r}y'(k)\le B\,Y(r)∑k≤r​y′(k)≤BY(r) (the scheme is BBB-competitive); and after all mmm rounds, for every iii,

∑k=1ma(i,k) y(k) ≤ c(i)⋅2log⁡(1+n ai(max⁡)/ai(min⁡))B.\sum_{k=1}^{m}a(i,k)\,y(k)\ \le\ c(i)\cdot\frac{2\log\big(1+n\,a_i(\max)/a_i(\min)\big)}{B}.k=1∑m​a(i,k)y(k) ≤ c(i)⋅B2log(1+nai​(max)/ai​(min))​.

The paper states the second part as c(i)⋅O((log⁡n+log⁡(ai(max⁡)/ai(min⁡)))/B)c(i)\cdot O\big((\log n+\log(a_i(\max)/a_i(\min)))/B\big)c(i)⋅O((logn+log(ai​(max)/ai​(min)))/B); the bound above is the one its proof establishes.

Milestones: the three claims of the proof

  1. Claim (i): X(r)≤B⋅Y(r)X(r)\le B\cdot Y(r)X(r)≤B⋅Y(r) after every round rrr.
  2. Claim (ii): after every round, x≥0x\ge0x≥0 and xxx satisfies every covering constraint revealed so far; no x(i)x(i)x(i) ever decreases.
  3. Claim (iii): the violation bound of the goal.

Significance

Theorem 3.1 says that a solution within factor BBB of the optimum can be maintained online at the price of overloading each packing constraint by a factor of order (log⁡n+log⁡(amax⁡/amin⁡))/B(\log n+\log(a_{\max}/a_{\min}))/B(logn+log(amax​/amin​))/B. Scaling the output down by the overload gives a feasible online packing solution with competitive ratio O(log⁡n+log⁡(amax⁡/amin⁡))O(\log n+\log(a_{\max}/a_{\min}))O(logn+log(amax​/amin​)), and Lemma 3.1 of the paper shows that no online algorithm does better up to constant factors. The same trade-off underlies the paper's online rounding results for routing (§5.2) and, through the covering counterpart, for set cover (§5.1).

The result is proved in the paper. As far as the platform's record shows, it is not formalized: the published OnlinePrimalDual.GeneralPacking.theorem14_1 (a restatement of the monograph's version) takes the inequality X≤BYX\le BYX≤BY and primal feasibility as hypotheses on arbitrary vectors x,yx,yx,y and derives competitiveness by weak duality; it does not mention the scheme and has no violation bound. The published OnlinePrimalDual.GeneralPacking.lemma14_2 is the matching lower bound (Lemma 3.1) and is not part of this mission. A formalization here would give the first machine-checked guarantee for the scheme itself and a reusable analysis pattern (a potential bound integrated along a monotone path) for the other schemes of the paper.

Difficulty

The paper's argument is a derivative comparison along a continuous process: while y(j)y(j)y(j) rises, ∂X/∂y(j)≤B\partial X/\partial y(j)\le B∂X/∂y(j)≤B. In the discrete formulation each round jumps directly to the least admissible y(j)y(j)y(j), and each x(i)x(i)x(i) is a maximum of its old value and an exponential, so it is continuous but not differentiable where the maximum switches; the comparison must be turned into an integral inequality over [0,y(j)][0,y(j)][0,y(j)] for such functions. The prefix maximum ai(max⁡)a_i(\max)ai​(max) changes between rounds, and the claim that this never lowers or raises the primal value needs an invariant (x(i)x(i)x(i) is always at least the current increment value). The violation bound rests on a second invariant, x(i)≤1/ai(min⁡)x(i)\le1/a_i(\min)x(i)≤1/ai​(min), which holds because y(j)y(j)y(j) is the least admissible value; any formalization that loses minimality (for example by taking an arbitrary admissible ttt) loses claim (iii).

Formalization scope

  • The instance is the published OnlinePrimalDual.GeneralPacking.GeneralInstance I (Fin m) (costs c>0c>0c>0, coefficients a≥0a\ge0a≥0); n=∣I∣n=|I|n=∣I∣ with [Nonempty I]; columns are Fin m, arrive in index order, and are 0-based in Lean, so "the first rrr columns" is (k : ℕ) < r. m≥1m\ge1m≥1 is [NeZero m].
  • ai(max⁡)a_i(\max)ai​(max), ai(min⁡)a_i(\min)ai​(min) over all columns are the published aMax and aMin. For a row with no non-zero coefficient aMin is 000 and both sides of the violation bound are 000.
  • The scheme is a function, stateAfter inst B r. The continuous loop of the paper is replaced by its discrete implementation, which the paper itself prescribes (p. 4): y(j)y(j)y(j) is the least t≥0t\ge0t≥0 restoring the new covering constraint, written as sInf. Every theorem assumes that every column has a positive entry (the paper's standing assumption, p. 4); this makes the infimum attained. If the prefix maximum is 000, Lean's 1/0=01/0=01/0=0 gives increment 000, which agrees with the paper's bracket being 000.
  • Explicit constant. The paper's c(i)⋅O((log⁡n+log⁡(ai(max⁡)/ai(min⁡)))/B)c(i)\cdot O((\log n+\log(a_i(\max)/a_i(\min)))/B)c(i)⋅O((logn+log(ai​(max)/ai​(min)))/B) is instantiated as c(i)⋅2log⁡(1+n ai(max⁡)/ai(min⁡))/Bc(i)\cdot 2\log(1+n\,a_i(\max)/a_i(\min))/Bc(i)⋅2log(1+nai​(max)/ai​(min))/B, from claim (iii) of the proof. Logarithms are natural (Real.log), since they invert Real.exp.
  • BBB-competitiveness is stated against every non-negative feasible packing solution of every prefix of the input, not only at the end.
  • A formalization in which the inequality X≤BYX\le BYX≤BY, primal feasibility, or the bound x(i)≤1/ai(min⁡)x(i)\le1/a_i(\min)x(i)≤1/ai​(min) is assumed rather than derived from the scheme is ruled out: every statement here is about the vectors the scheme computes from the instance.
  • Needed infrastructure: monotonicity and continuity of the per-round primal path, attainment of the infimum, an integral (or mean-value) form of the derivative comparison for maxima of exponentials, and weak duality for finite LPs. The weak-duality step and the per-round integration lemma are reusable for missions 2–4 of this series. Proofs of the milestones, and of helper lemmas such as the invariant x(i)≤1/ai(min⁡)x(i)\le1/a_i(\min)x(i)≤1/ai​(min), are welcome.

Selected references

  • N. Buchbinder, J. Naor, Online Primal-Dual Algorithms for Covering and Packing, Mathematics of Operations Research, 2009. https://doi.org/10.1287/moor.1080.0363
  • N. Buchbinder, J. Naor, The Design of Competitive Online Algorithms via a Primal-Dual Approach, Foundations and Trends in Theoretical Computer Science 3(2–3), 2009. https://doi.org/10.1561/0400000024
  • N. Alon, B. Awerbuch, Y. Azar, N. Buchbinder, J. Naor, The Online Set Cover Problem, SIAM Journal on Computing 39(2), 2009. https://doi.org/10.1137/060661946
8 thms1 active userReviewed
Complexity Theory·Captain: hao jia

Weighted Falsifiability of Unambiguous DNFsOpen Problem

Motivation

A disjunctive normal form (DNF) is a disjunction of terms, each term a conjunction of Boolean literals. An unambiguous DNF has pairwise disjoint terms: no Boolean assignment satisfies two different terms. This restriction makes several tasks easy. In particular, the cited open-problem entry records polynomial-time algorithms for weighted satisfiability on unambiguous DNFs and for unweighted falsifiability. The unresolved boundary is weighted falsifiability: can one find a high-weight assignment outside the union of the terms, without enumerating all assignments?

This question is relevant to the complexity of negating compact representations of Boolean functions. Amarilli's entry observes that, since unambiguous DNFs are d-DNNFs, a polynomial-time negation procedure for d-DNNFs would yield a polynomial-time solution to weighted falsifiability on unambiguous DNFs by applying weighted satisfiability to the negated representation. Conversely, if weighted falsifiability for unambiguous DNFs—or even for d-DNNFs—is NP-hard, then, unless P=NP\mathrm{P}=\mathrm{NP}P=NP, d-DNNFs cannot be negated in polynomial time. These are implications stated by the source, not results established by this mission.

Historical note

The question appears on Albertine Amarilli's open-problem list. The entry cites a Theoretical Computer Science Stack Exchange question by Mikaël Monet and credits him with helping prepare the entry. It records two partial tractability results: weighted satisfiability with binary weights, and weighted falsifiability when the variable weights are unary. The entry gives no date for when the problem was posed or last seen open, so this description does not assign one. The linked discussion is useful context, not a novelty or resolution certificate.

Setting

Let X={x0,…,xn−1}X=\{x_0,\ldots,x_{n-1}\}X={x0​,…,xn−1​} be exactly the variables occurring in the DNF. The formal input declares this finite universe by its size nnn; validity requires every declared variable to occur in at least one literal. An input DNF is a finite list of terms, and each term is a finite list of signed variable indices. An assignment is a function ν:X→{0,1}\nu:X\to\{0,1\}ν:X→{0,1}. A positive literal xix_ixi​ is true when ν(xi)=1\nu(x_i)=1ν(xi​)=1; a negative literal ¬xi\neg x_i¬xi​ is true when ν(xi)=0\nu(x_i)=0ν(xi​)=0. A term is true when all its literals are true, and the DNF is true when at least one term is true. Thus the empty DNF is false and an empty term is true.

The input also contains one positive integer weight cic_ici​ for each variable and a positive threshold ttt. The weight of an assignment is

w(ν)=∑i=0n−1ciν(xi).w(\nu)=\sum_{i=0}^{n-1} c_i\nu(x_i).w(ν)=i=0∑n−1​ci​ν(xi​).

The DNF is valid for this problem when every literal index is below nnn and every pair of distinct terms is mutually unsatisfiable. The decision question is whether there exists an assignment that falsifies the DNF and has weight at least ttt.

Formalization targets

Partial result — weighted satisfiability

For valid unambiguous DNF inputs with positive binary-encoded weights and threshold, the decision problem asking whether a satisfying assignment has weight at least ttt has a deterministic polynomial-time algorithm. This is the weighted-satisfiability baseline recorded in the source entry. It is a separate result from the goal below.

Partial result — unary-weight falsifiability

For the same valid DNF model, when each variable weight is encoded in unary, weighted falsifiability has a deterministic polynomial-time algorithm. The threshold remains binary-encoded in this formalization. The source entry records this unary-weight restriction as tractable.

Goal — binary-weight falsifiability

For arbitrary positive binary-encoded variable weights and a positive binary-encoded threshold, determine whether one fixed deterministic Turing machine and one polynomial time bound decide weighted falsifiability for every valid input. The machine must be correct on all valid instances; its running-time bound is uniform and measured in the length of the explicit input code. No witness output is required.

The two partial results are reference points, not assumptions from which the goal is claimed to follow. The goal is the open binary-weight case; it must not be replaced by the satisfiability problem or by the unary-weight restriction.

Dependency graph

Input, semantics, validity, and serialization definitions
├── binary-weight weighted satisfiability (source baseline)
├── unary-weight weighted falsifiability (source baseline)
└── binary-weight weighted falsifiability (open goal)

Each branch shares the same finite DNF model and correctness predicates. The arrows indicate required definitions and scope, not a claim that either partial theorem implies the open goal.

Significance

A positive result would give a uniform algorithm for finding whether a disjoint union of Boolean subcubes omits any sufficiently heavy point, even when weights are represented compactly in binary. A negative complexity result would identify a sharp obstruction to efficient complement-related operations on these representations. The exact-weight version (asking for weight exactly ttt) is a different problem and is outside this mission's scope; the goal here is specifically weight at least ttt.

Formalizing the question fixes the universe of variables, signed-literal semantics, unambiguity condition, threshold direction, input encoding, and computational model. It also makes the unary and satisfiability baselines comparable to the binary-weight goal without treating a finite search or a candidate implementation as a complexity proof. No solution is supplied or presumed here.

Difficulty

The direct search over all 2n2^n2n assignments is exponential in nnn. Counting satisfying assignments is enough to settle ordinary falsifiability, but a weighted threshold partitions assignments by exponentially many possible total weights when the weights are binary. The unary dynamic program therefore does not by itself give a polynomial bound in the binary input length. Conversely, solving weighted satisfiability on the DNF does not answer whether a heavy assignment lies outside it. The task is to settle that gap without silently replacing binary magnitude by unary size.

Formalization scope

The Lean model uses Input, an explicit variable count, a list of signed-index terms, a weight list, and a threshold. validInput requires exactly one positive weight per variable, positive weights and threshold, in-range literal indices, that every declared variable occurs in the formula, and pairwise unsatisfiable distinct terms. The finite assignment type is Fin n → Bool; unused variables remain part of the input. The decision predicate is existential and exact.

The binary code includes the variable count, every list count and delimiter, all signed indices, all weights, and the threshold. Natural-number payloads use canonical binary digits with an explicit unary length prefix. The unary-weight code changes only the variable-weight payloads to unary; formula data and threshold remain binary. The complexity statements use Mathlib's bundled deterministic Turing.TM2ComputableInPolyTime model, with a single machine and polynomial bound in the chosen code length. This formalization does not claim refinement to JSON, CPython, or any runtime implementation. Human review should check the encoding/decoder round-trip and the source correspondence before launch.

The reusable definitions are the finite DNF semantics, weighted assignment score, validity predicate, binary/unary encoders, and exact decision predicates. Formalizing the two cited partial results is part of the mission's milestone path; neither is evidence that the binary-weight goal is solved.

Selected references

  • Albertine Amarilli, “Weighted falsifiability for unambiguous DNFs,” List of open questions in theoretical computer science, https://a3nm.net/work/research/questions/#weighted-falsifiability-for-unambiguous-dnfs.
  • Mikaël Monet, “Is this problem on unambiguous DNFs hard?”, Theoretical Computer Science Stack Exchange, https://cstheory.stackexchange.com/questions/53733/is-this-problem-on-unambiguous-dnfs-hard.
4 thms1 active userReviewed
Captain: Goku

QMA Strong Error Reduction with No Witness-Length IncreaseResearch Paper

Motivation

A QMA verifier receives a quantum witness and checks it with a circuit generated efficiently from the input. An acceptance probability separated by an inverse-polynomial gap is enough to define the class, but applications often need the probability of a wrong answer to be exponentially small. Repeating the verifier on many supplied witness registers achieves this error reduction while allowing the witness to grow. Marriott and Watrous proved the stronger statement that the same error reduction can be obtained without increasing the number of witness qubits Quantum Arthur–Merlin Games, Section 3.

The existing Lean development verifies the copy-based theorem, including soundness for witnesses entangled across the copies, and constructs a uniform circuit family with polynomial resources. This mission asks for the separate witness-preserving theorem. The paper already proves that mathematical statement; the open work here is its formalization in the stated QMA circuit model.

Setting

At each input length nnn, a verifier has m(n)m(n)m(n) witness qubits, a finite work register, a designated output wire, and a quantum circuit. A uniformly generated family has a polynomial-time classical procedure that emits the complete circuit description, including the witness and work-register sizes. On yes-instances, some normalized witness makes the verifier accept with probability at least a(n)a(n)a(n). On no-instances, every normalized witness is accepted with probability at most b(n)b(n)b(n). The thresholds satisfy 0≤b(n)≤a(n)≤10\le b(n)\le a(n)\le10≤b(n)≤a(n)≤1 and a(n)−b(n)≥1/q(n)a(n)-b(n)\ge1/q(n)a(n)−b(n)≥1/q(n) for a polynomial qqq.

The existing formalization represents witnesses as complex amplitude functions on bit strings, requires normalization explicitly, and uses layered circuits over its specified finite gate set. It also represents efficiently available real thresholds by polynomial-time procedures that output dyadic approximations. These are part of the formal statement's interface and must be made visible to users of the mission.

Target

For every polynomial error exponent rrr and every source verifier satisfying the conditions above, construct a uniformly generated, well-formed, polynomial-resource verifier for the same language, with completeness at least 1−2−r(n)1-2^{-r(n)}1−2−r(n) and soundness at most 2−r(n)2^{-r(n)}2−r(n), while keeping the witness count exactly m(n)m(n)m(n) at every input length:

mnew(n)=mold(n).m_{\mathrm{new}}(n)=m_{\mathrm{old}}(n).mnew​(n)=mold​(n).

This is the witness-preserving strong error-reduction result of Marriott and Watrous (Theorem 4). The existing copy-based result corresponds to the weaker QMA class inclusion in Theorem 3 and will be linked as a proved background result. The mission goal must state the witness-count equation explicitly so that a copy-based amplifier cannot satisfy it.

Significance

Witness-preserving amplification lets a QMA protocol demand much stronger reliability without asking the prover for a longer message. That matters whenever witness size is itself a resource being compared or bounded. The copy-based theorem shows that the QMA class is robust under error reduction, but does not establish this fixed-message guarantee.

Formalizing the stronger result would add a reusable account of a verifier that reuses one witness, proves soundness for every normalized input state, and compiles its behavior into an ordinary uniform circuit family. Those components can support later formalizations that reason about repeated quantum verification under a fixed witness budget.

Difficulty

The completed copy-based proof uses three independent verifier blocks in each amplification round and bounds arbitrary entangled witnesses across those blocks. Its circuit resource analysis therefore allows the witness count to grow. A witness-preserving argument cannot use that construction. It must analyze repeated verification on one register and establish exponentially small error without assuming the input witness has a special spectral form. The formal circuit model currently exposes final-output measurements; any additional measurement behavior used in the analysis must be justified in that model and shown implementable by a finite, uniformly generated circuit.

The central audit point is the exact witness-length equation. A theorem that merely returns another polynomial-size witness, or that changes the source verifier's witness definition, is a useful class-level result but does not prove this mission's target.

Formalization scope

The goal is parameterized by input-length-dependent completeness and soundness thresholds with an inverse-polynomial gap, and by a polynomial target exponent. Every witness quantifier is over normalized states. The output verifier must satisfy the same well-formedness and polynomial-resource conditions as the completed copy-based development. The platform statement uses its existing ShiClassQMAU.UniformQMA circuit-family encoding, which includes the witness and ancilla counts separately. A final proof should be kernel checked with only Lean's standard logical axioms and should not assume an amplification transducer or an unproved measurement lemma.

The paper quantifies over the class poly of unary-time constructible functions. This proposal represents the gap denominator and target exponent as literal Polynomial ℕ values, matching the checked copy-based development. It therefore formalizes a polynomial-parameter instance of Theorem 4 rather than the paper's full function-class generality. The threshold functions are supplied by polynomial-time dyadic approximators in place of the paper's informal efficient-computation convention. These interface choices are explicit in the Lean goal and should not be read as a proof of the broader formulation.

The local copy-based proof is complete and audited, but it has not yet been transplanted to Prove2Me. Its publication is preparatory work for this mission, not evidence that the witness-preserving goal is already solved. The proposal should reference the published copy-based endpoint and include only a few substantial milestones, so each item is meaningful to audit.

Selected references

  • C. Marriott and J. Watrous, Quantum Arthur–Merlin Games, Computational Complexity 14 (2005), Section 3, Theorems 3 and 4. Paper.
  • A. Kitaev, A. Shen, and M. Vyalyi, Classical and Quantum Computation, Graduate Studies in Mathematics 47, American Mathematical Society (2002), Section 14.2, cited by Marriott and Watrous for the copy-based amplification proof.
3 thms1 active userReviewed
Machine LearningOperations ResearchProbability·Captain: mikedeng1

Competitive Caching with Machine Learned Advice: The Competitive Ratio of Predictive MarkerResearch Paper

Motivation

Caching (online paging) is one of the oldest problems in online algorithms: a fast memory of kkk slots serves a sequence of requests, and every request for an element not in the fast memory is a cache miss that forces the element to be loaded, possibly evicting another one. With the whole request sequence known in advance, evicting the element whose next request is furthest in the future is optimal (Bélády, 1966). Without that knowledge, no deterministic algorithm is better than kkk-competitive, and the best randomized algorithms are Θ(log⁡k)\Theta(\log k)Θ(logk)-competitive (Fiat, Karp, Luby, McGeoch, Sleator and Young, 1991).

Lykouris and Vassilvitskii asked what happens in between: an online algorithm receives, with every request, a machine-learned prediction of the element's next arrival time. A good predictor should make the algorithm nearly as good as Bélády's rule (consistency), and a bad predictor should never make it worse than a classical algorithm (robustness). Their paper (arXiv:1802.05399v4; J. ACM 2021) is one of the founding papers of learning-augmented algorithms, and its algorithm, Predictive Marker, is the reference point for the later literature on caching with predictions.

Timeline.

  • 1966: Bélády's furthest-in-future rule is optimal offline.
  • 1985: Sleator and Tarjan show that deterministic online paging is at best kkk-competitive.
  • 1991: Fiat et al. introduce the Marker algorithm, 2Hk2H_k2Hk​-competitive, and the clean-element lower bound on the optimum.
  • 2018: Lykouris and Vassilvitskii (arXiv:1802.05399) introduce Predictive Marker, with ratio 2min⁡(1+2Sℓ(ϵ),2Hk)2\min(1+2S_\ell(\epsilon), 2H_k)2min(1+2Sℓ​(ϵ),2Hk​) for an ϵ\epsilonϵ-accurate predictor.
  • 2020: Rohatgi (arXiv:1910.12172, SODA 2020) and Wei (arXiv:2005.13716, APPROX/RANDOM 2020) improve the dependence on the error.

Setting

A request sequence σ=(z1,…,zn)\sigma = (z_1, \dots, z_n)σ=(z1​,…,zn​) lists elements of a set ZZZ. A cache of size k≥1k \ge 1k≥1 starts empty. A request for a cached element is a hit; otherwise it is a miss, the element is loaded, and if the cache is full some element is evicted first. The offline optimum Opt(σ)\mathrm{Opt}(\sigma)Opt(σ) is the least number of misses over all eviction schedules chosen with knowledge of σ\sigmaσ.

With each request ziz_izi​ the algorithm receives a real prediction hih_ihi​. The true label yiy_iyi​ is the position of the next request of ziz_izi​, or n+1n+1n+1 if there is none. For a loss function ℓ≥0\ell \ge 0ℓ≥0, the error of the predictions is ηℓ(h,σ)=∑iℓ(yi,hi)\eta_\ell(h,\sigma) = \sum_i \ell(y_i, h_i)ηℓ​(h,σ)=∑i​ℓ(yi​,hi​), and the predictions are ϵ\epsilonϵ-accurate when ηℓ(h,σ)≤ϵ⋅Opt(σ)\eta_\ell(h,\sigma) \le \epsilon \cdot \mathrm{Opt}(\sigma)ηℓ​(h,σ)≤ϵ⋅Opt(σ).

The spread of ℓ\ellℓ measures how cheaply a predictor can get the order of arrivals completely wrong: Sℓ(m)S_\ell(m)Sℓ​(m) is the least length T≥1T \ge 1T≥1 such that every strictly increasing integer sequence a1<⋯<aTa_1 < \dots < a_Ta1​<⋯<aT​ and every non-increasing real sequence b1≥⋯≥bTb_1 \ge \dots \ge b_Tb1​≥⋯≥bT​ have total loss ∑iℓ(ai,bi)≥m\sum_i \ell(a_i, b_i) \ge m∑i​ℓ(ai​,bi​)≥m.

Predictive Marker (Algorithm 1) works in the phases of the Marker algorithm. Requested elements are marked. A phase ends when the cache is full, every cached element is marked, and a miss occurs; then all marks are removed. An element requested in a phase but not in the previous one is clean, and Q(σ)Q(\sigma)Q(σ) is the total number of clean elements. Each clean miss starts a chain. An element evicted in the current phase that is requested again (a stale miss) extends the chain in which it was evicted. Evictions are among unmarked elements. As long as the chain's length n(r,c)n(r,c)n(r,c) is at most Hk=1+12+⋯+1kH_k = 1 + \tfrac12 + \dots + \tfrac1kHk​=1+21​+⋯+k1​, the evicted element is one with the largest prediction. After that it is chosen uniformly at random. The expected number of misses of Predictive Marker is costPM(σ)\mathrm{cost}_{PM}(\sigma)costPM​(σ).

Formalization targets

Goal: Theorem 3.3

If SSS is concave on [0,∞)[0,\infty)[0,∞) and majorizes the spread, then for every ϵ≥0\epsilon \ge 0ϵ≥0, every tie-breaking rule, and every sequence with ϵ\epsilonϵ-accurate predictions,

E[costPM(σ)]≤2⋅min⁡(1+2S(ϵ), 2Hk)⋅Opt(σ).\mathbb E\bigl[\mathrm{cost}_{PM}(\sigma)\bigr] \le 2\cdot\min\bigl(1 + 2S(\epsilon),\ 2H_k\bigr)\cdot \mathrm{Opt}(\sigma).E[costPM​(σ)]≤2⋅min(1+2S(ϵ), 2Hk​)⋅Opt(σ).

Milestones

  • Claim 1 (Fiat et al.): Q(σ)≤2 Opt(σ)Q(\sigma) \le 2\,\mathrm{Opt}(\sigma)Q(σ)≤2Opt(σ).
  • Proof of Theorem 3.3, last sentence: Opt(σ)≤Q(σ)\mathrm{Opt}(\sigma) \le Q(\sigma)Opt(σ)≤Q(σ).
  • Lemma 3.3: a chain that evicts by the predictions only has length n(r,c)≤1+S(ηr,c)n(r,c) \le 1 + S(\eta_{r,c})n(r,c)≤1+S(ηr,c​), where ηr,c\eta_{r,c}ηr,c​ is the error of the predictions on the elements evicted into it.
  • Lemma 3.4: E[n(r,c)]≤E[min⁡(1+2S(ηr,c),2Hk)]\mathbb E[n(r,c)] \le \mathbb E[\min(1 + 2S(\eta_{r,c}), 2H_k)]E[n(r,c)]≤E[min(1+2S(ηr,c​),2Hk​)].

Significance

The result. Theorem 3.3 gives both guarantees at once. For an exact predictor (ϵ=0\epsilon = 0ϵ=0) the ratio is a constant, 2(1+2S(0))2(1 + 2S(0))2(1+2S(0)), independent of kkk; for an arbitrary predictor it is 4Hk4H_k4Hk​, within a constant factor of the optimal randomized ratio. In between, the ratio degrades with the error at the rate of the spread: for the absolute loss the spread grows like m\sqrt mm​, so the ratio grows like ϵ\sqrt\epsilonϵ​. The spread and the chain decomposition are the tools later papers build on to trade consistency against robustness.

Formalizing it. The theorem is proved on paper; no machine-checked proof of it, of the Marker analysis, or of the clean-element bound of Fiat et al. is known. A formalization supplies a precise model of a randomized online algorithm with predictions. It also settles the details the paper leaves implicit: the eviction missing from the clean branch of Algorithm 1 as printed, the cap 2Hk2H_k2Hk​ printed as 2log⁡k2\log k2logk in Lemma 3.4, and the behaviour of the spread at 000.

Difficulty

The obvious argument charges every miss to a chain and bounds each chain separately. That works for chains that follow the predictions, but a chain that switches to random evictions interacts with every other chain of the phase, because all of them evict from the same pool of unmarked elements. A bound on its expected length must hold whatever the other chains evict, including evictions that depend on earlier coin flips. A second difficulty is summing. The chain errors ηr,c\eta_{r,c}ηr,c​ and the chain lengths are both random, while the hypothesis controls only the total error ηℓ(h,σ)\eta_\ell(h,\sigma)ηℓ​(h,σ) against Opt(σ)\mathrm{Opt}(\sigma)Opt(σ), not the number of chains Q(σ)Q(\sigma)Q(σ) in which the error is spread.

Formalization scope

Elements form a type with decidable equality. A request sequence is a list; predictions are one real per request, and every real sequence is allowed. Labels are 1-based next-arrival positions, with n+1n+1n+1 for elements never requested again. The paper prints the label with equal features; the element is meant. Opt\mathrm{Opt}Opt is computed as the minimum over all demand-paging schedules from the empty cache, which loses no generality. HkH_kHk​ is harmonic k as a real number, never log⁡k\log klogk.

Predictive Marker is a PMF over final states. The random eviction of line 21 is uniform over the unmarked cached elements, and ties in the arg max are a parameter quantified universally. The eviction of lines 23–24 is also performed after a clean miss; as printed, it sits only in the stale branch. The expected cost lies in [0,∞][0,\infty][0,∞].

The spread takes real arguments and lengths T≥1T \ge 1T≥1. SSS must be concave on [0,∞)[0,\infty)[0,∞), finite, and at least the spread. It must also be continuous at 000, which the paper does not say: without it the chain lemma fails for losses whose minimal reversed-order loss stays 000 over several lengths. ϵ\epsilonϵ-accuracy is the pointwise condition on the given pair (σ,h)(\sigma, h)(σ,h). The competitive ratio is written as a product, so Opt(σ)=0\mathrm{Opt}(\sigma) = 0Opt(σ)=0 needs no special case. Lemma 3.3 is stated pointwise for chains without random evictions, as its proof shows. Lemma 3.4 has 2Hk2H_k2Hk​ in place of the printed 2log⁡k2\log k2logk, with the minimum inside the expectation because ηr,c\eta_{r,c}ηr,c​ is random.

The statement must not be trivialized. Opt\mathrm{Opt}Opt is the true offline optimum, not Bélády's rule applied to the predictions. The expectation is taken over Predictive Marker's own run, never compared with itself. The spread hypothesis is satisfiable; for example, the constant loss 111 has spread max⁡(1,⌈m⌉)≤m+1\max(1,\lceil m\rceil) \le m + 1max(1,⌈m⌉)≤m+1.

Out of scope: Lemma 3.2 (the special-marking algorithm SM, which enters only through Lemma 3.4's proof); Lemma 3.1 and Corollaries 1–2, whose printed constants are false for small mmm or disagree with Theorem 3.3; the lower bounds of §3.1 and §3.4; the extensions of §4; the experiments of §5; running time and learnability.

Welcome contributions: the Marker phase structure and its equivalence with the combinatorial phases, the clean-element bounds Q/2≤Opt≤QQ/2 \le \mathrm{Opt} \le QQ/2≤Opt≤Q (reusable for any marking algorithm), and a bound on the expected number of misses caused by elements evicted uniformly at random within a phase.

Selected references

  • T. Lykouris, S. Vassilvitskii, Competitive Caching with Machine Learned Advice, arXiv:1802.05399v4, 2020; J. ACM 68(4), 2021. https://arxiv.org/abs/1802.05399v4
  • A. Fiat, R. M. Karp, M. Luby, L. A. McGeoch, D. D. Sleator, N. E. Young, Competitive paging algorithms, J. Algorithms 12(4), 1991. https://doi.org/10.1016/0196-6774(91)90041-V
  • L. A. Bélády, A study of replacement algorithms for a virtual-storage computer, IBM Systems Journal 5(2), 1966. https://doi.org/10.1147/sj.52.0078
  • D. D. Sleator, R. E. Tarjan, Amortized efficiency of list update and paging rules, Comm. ACM 28(2), 1985. https://doi.org/10.1145/2786.2793
  • D. Rohatgi, Near-optimal bounds for online caching with machine learned advice, SODA 2020. https://arxiv.org/abs/1910.12172
  • A. Wei, Better and simpler learning-augmented online caching, APPROX/RANDOM 2020. https://arxiv.org/abs/2005.13716
10 thms1 active userReviewed
Operations ResearchOptimizationProbability·Captain: mikedeng1

An Optimal On-Line Algorithm for Metrical Task System 2: The Randomized Competitive Ratio of the Uniform Task System Lies Between H(n) and 2H(n)Research Paper

Motivation

Metrical task systems, introduced by Borodin, Linial and Saks (J. ACM 39(4), 1992), are a common abstraction of on-line problems in which a server occupies one of finitely many states, pays a cost for each task depending on its current state, and may pay a transition cost to change state first. Paging, list update and the kkk-server problem all fit into this framework. The paper's first main result is that every deterministic on-line algorithm on an nnn-state metrical task system has competitive ratio at least 2n−12n-12n−1, and that 2n−12n-12n−1 is attained. The lower bound comes from an adversary that always charges the state the algorithm currently occupies. That adversary needs to know the algorithm's state, which suggests that randomization can help.

Section 7 of the paper makes this precise for the simplest system, the uniform task system, in which all transitions cost 111. There the randomized competitive ratio against an oblivious adversary is between H(n)H(n)H(n) and 2H(n)2H(n)2H(n), where H(n)=1+12+⋯+1nH(n)=1+\tfrac12+\cdots+\tfrac1nH(n)=1+21​+⋯+n1​ is between ln⁡n\ln nlnn and 1+ln⁡n1+\ln n1+lnn. This was the first logarithmic bound for a task system.

Timeline:

  • 1985: Sleator and Tarjan introduce competitive analysis for list update and paging (CACM 28(2)).
  • 1987/1992: Borodin, Linial and Saks define metrical task systems, prove the deterministic ratio 2n−12n-12n−1, and prove H(n)≤wˉ≤2H(n)H(n)\le\bar w\le 2H(n)H(n)≤wˉ≤2H(n) for the uniform system (conference version STOC 1987; journal version cited above).
  • 1991: Fiat, Karp, Luby, McGeoch, Sleator and Young prove the analogous 2Hk2H_k2Hk​ upper bound for randomized paging (J. Algorithms 12(4)).

Setting

A task system (S,d)(S,d)(S,d) is a finite set SSS of nnn states with a transition-cost matrix ddd: d(i,i)=0d(i,i)=0d(i,i)=0, d(i,j)>0d(i,j)>0d(i,j)>0 for i≠ji\ne ji=j, and d(i,k)≤d(i,j)+d(j,k)d(i,k)\le d(i,j)+d(j,k)d(i,k)≤d(i,j)+d(j,k). In the uniform task system, d(i,j)=1d(i,j)=1d(i,j)=1 for all i≠ji\neq ji=j. A task is a vector T∈R≥0ST\in\mathbb R_{\ge0}^ST∈R≥0S​ of processing costs. Given an initial state s0s_0s0​ and tasks T=T1⋯Tm\mathbf T=T^1\cdots T^mT=T1⋯Tm, a schedule is σ:{0,…,m}→S\sigma:\{0,\dots,m\}\to Sσ:{0,…,m}→S with σ(0)=s0\sigma(0)=s_0σ(0)=s0​, of cost

c(T;σ)=∑i=1md(σ(i−1),σ(i))+∑i=1mTi(σ(i)).c(\mathbf T;\sigma)=\sum_{i=1}^m d(\sigma(i-1),\sigma(i))+\sum_{i=1}^m T^i(\sigma(i)).c(T;σ)=i=1∑m​d(σ(i−1),σ(i))+i=1∑m​Ti(σ(i)).

The off-line optimum c0(T)c_0(\mathbf T)c0​(T) is the least cost over all schedules.

A deterministic on-line algorithm chooses σ(i)\sigma(i)σ(i) from s0s_0s0​ and T1,…,TiT^1,\dots,T^iT1,…,Ti. A randomized on-line algorithm RRR chooses σ(i)\sigma(i)σ(i) at random, with a distribution that depends on s0s_0s0​, on T1,…,TiT^1,\dots,T^iT1,…,Ti and on the states σ(0),…,σ(i−1)\sigma(0),\dots,\sigma(i-1)σ(0),…,σ(i−1) already visited. The task sequence is fixed before any random choice is made (an oblivious adversary). With pr(σ∣T)\mathrm{pr}(\sigma\mid\mathbf T)pr(σ∣T) the probability that RRR follows σ\sigmaσ, the expected cost is cˉR(T)=∑σc(T;σ) pr(σ∣T)\bar c_R(\mathbf T)=\sum_\sigma c(\mathbf T;\sigma)\,\mathrm{pr}(\sigma\mid\mathbf T)cˉR​(T)=∑σ​c(T;σ)pr(σ∣T). For w>0w>0w>0, RRR is expected www-competitive if there is a constant KKK with

cˉR(T)≤w c0(T)+K\bar c_R(\mathbf T)\le w\,c_0(\mathbf T)+KcˉR​(T)≤wc0​(T)+K

for every finite task sequence and every initial state. The randomized competitive ratio wˉ(S,d)\bar w(S,d)wˉ(S,d) is the infimum of all such www over all RRR.

Formalization targets

Goal: Theorem 7.1

For the uniform task system on n≥1n\ge1n≥1 states,

H(n)  ≤  wˉ(S,d)  ≤  2H(n).H(n)\;\le\;\bar w(S,d)\;\le\;2H(n).H(n)≤wˉ(S,d)≤2H(n).

Milestones

  1. Upper bound (p. 759). Some randomized on-line algorithm is expected 2H(n)2H(n)2H(n)-competitive on the uniform task system.
  2. Lemma 7.2 (p. 759). Let DDD be a distribution on infinite task sequences over a finite task alphabet, with E(c0(Tj))→∞E(c_0(\mathbf T^j))\to\inftyE(c0​(Tj))→∞, and let mj=inf⁡AE(cA(Tj))m_j=\inf_A E(c_A(\mathbf T^j))mj​=infA​E(cA​(Tj)) over deterministic on-line algorithms. Then every achievable www satisfies
lim sup⁡j→∞mjE(c0(Tj))≤w.\limsup_{j\to\infty}\frac{m_j}{E(c_0(\mathbf T^j))}\le w .j→∞limsup​E(c0​(Tj))mj​​≤w.
  1. mj≥j/nm_j\ge j/nmj​≥j/n (p. 760) when the tasks are independent uniformly random unit elementary tasks UsU_sUs​ (cost 111 in sss, 000 elsewhere).
  2. Coupon collector (p. 760). For i.i.d. uniform states on SSS, the expected number of draws until every state has appeared is nH(n)nH(n)nH(n).
  3. Off-line cost (p. 760). Under the same distribution, E(c0(Tj))≤j/(nH(n))+CE(c_0(\mathbf T^j))\le j/(nH(n))+CE(c0​(Tj))≤j/(nH(n))+C for a constant CCC independent of jjj.

Significance

The theorem shows that randomization reduces the competitive ratio of the uniform task system from 2n−12n-12n−1 to Θ(log⁡n)\Theta(\log n)Θ(logn). That is an exponential improvement, and it identifies the adversary's knowledge of the algorithm's state as the source of the deterministic lower bound. Lemma 7.2 is a form of Yao's principle adapted to the additive-constant definition of competitiveness. It is the standard tool for randomized lower bounds in on-line computation, and the same argument shape reappears for paging and kkk-server lower bounds.

On the formalization side, the result is proved but, as far as is known, has not been machine-checked. A complete development yields a reusable model of randomized on-line algorithms with oblivious adversaries, a Yao-type lemma usable for other on-line problems, and a coupon-collector expectation in the product-measure setting. The upper half additionally needs the continuous-time reduction of the paper's Lemma 3.1 in randomized form, or a direct discrete-time algorithm.

Difficulty

For the upper bound, the natural algorithm is continuous-time. It proceeds in phases, and inside a phase it stays in a state until that state has accumulated cost 111. A discrete task can saturate several states at once and straddle a phase boundary. So a discrete algorithm must either simulate the continuous one or be analyzed directly, and the expected transition count per phase must be controlled with the first phase starting in a deterministic state.

For the lower bound, the first obstacle is that the natural statement "wˉ≥lim sup⁡mj/E(c0)\bar w\ge\limsup m_j/E(c_0)wˉ≥limsupmj​/E(c0​)" silently assumes that a randomized algorithm's expected cost, averaged over random inputs, is at least that of the best deterministic algorithm. With the behavioural (kernel) definition used here, this requires converting a kernel into a mixture of deterministic algorithms, which is Kuhn's theorem on each finite horizon. The second obstacle is that the paper's claim E(c0(Tj))≤j/(nH(n))+O(1)E(c_0(\mathbf T^j))\le j/(nH(n))+O(1)E(c0​(Tj))≤j/(nH(n))+O(1) is supported only by the elementary renewal theorem, which gives a limit of ratios; the additive bound needs a sharper renewal estimate. Mathlib has no renewal theory. The hypothesis E(c0(Tj))→∞E(c_0(\mathbf T^j))\to\inftyE(c0​(Tj))→∞ of Lemma 7.2 must also be established for the uniform distribution; the paper does not prove it separately.

Formalization scope

  • States form a finite nonempty type S, and nnn = Fintype.card S; no n≥2n\ge2n≥2 assumption is made (at n=1n=1n=1 the goal reads 1≤wˉ≤21\le\bar w\le21≤wˉ≤2, and wˉ=1\bar w=1wˉ=1). H(n)H(n)H(n) is Mathlib's harmonic n, cast to R\mathbb RR. The uniform system has unit transition cost.
  • Tasks are finite and nonnegative. The paper also allows +∞+\infty+∞ entries; these are excluded. Task sequences are Fin m → S → ℝ and schedules are Fin (m+1) → S with σ 0 = s₀. c0c_0c0​ is a finite minimum.
  • A randomized algorithm is a kernel S → List (S → ℝ) → List S → PMF S. This is the paper's scheduler–taskmaster description (p. 758), equivalent to a distribution over deterministic algorithms on every finite task sequence. pr(σ∣T)\mathrm{pr}(\sigma\mid\mathbf T)pr(σ∣T) is the product of kernel probabilities, and cˉR\bar c_RcˉR​ is a finite sum. That pr(⋅∣T)\mathrm{pr}(\cdot\mid\mathbf T)pr(⋅∣T) sums to 111 has been checked locally.
  • wˉ(S,d)\bar w(S,d)wˉ(S,d) is the real sInf of {w:∃R, R expected w-competitive}\{w : \exists R,\ R \text{ expected } w\text{-competitive}\}{w:∃R, R expected w-competitive}. On the empty set this would be 000, so the upper bound is stated as the existence of an expected 2H(n)2H(n)2H(n)-competitive algorithm, and Lemma 7.2 is stated for every achievable www. The goal's lower half forces the set to be nonempty. Statements of the form "wˉ≤c\bar w\le cwˉ≤c" alone are therefore not acceptable substitutes for milestones 1 and 2.
  • Lemma 7.2 is restricted to task sequences over a finite alphabet, with the product σ\sigmaσ-algebra and measurable singletons. This makes every E(cA(Tj))E(c_A(\mathbf T^j))E(cA​(Tj)) a genuine integral for every deterministic AAA, and it covers the paper's application. The lim sup⁡\limsuplimsup of Lemma 7.2 is taken in EReal.
  • The coupon-collector time takes values in [0,∞][0,\infty][0,∞] and its expectation is a lower Lebesgue integral. Milestone 5 renders the paper's O(1)O(1)O(1) as an explicit constant CCC chosen before jjj.

Contributions welcome: proofs of any milestone; a discrete-time randomized phase algorithm; a general Kuhn-type conversion from kernels to mixtures of deterministic algorithms; renewal-theoretic lemmas.

Selected references

  • A. Borodin, N. Linial, M. Saks, An Optimal On-Line Algorithm for Metrical Task System, J. ACM 39(4):745–763, 1992. https://doi.org/10.1145/146585.146588
  • D. D. Sleator, R. E. Tarjan, Amortized Efficiency of List Update and Paging Rules, Commun. ACM 28(2):202–208, 1985. https://doi.org/10.1145/2786.2793
  • A. Fiat, R. M. Karp, M. Luby, L. A. McGeoch, D. D. Sleator, N. E. Young, Competitive Paging Algorithms, J. Algorithms 12(4):685–699, 1991. https://doi.org/10.1016/0196-6774(91)90041-V
  • A. C.-C. Yao, Probabilistic Computations: Toward a Unified Measure of Complexity, FOCS 1977, 222–227. https://doi.org/10.1109/SFCS.1977.24
  • S. M. Ross, Applied Probability Models with Optimization Applications, Holden-Day, 1970 (the elementary renewal theorem cited as [20] in the paper).
9 thms1 active userReviewed
🏆Completed
CombinatoricsOptimization·Captain: moutei

Primal-Dual Online Algorithms III: Set-Cover Approximation via CertificatesTextbook

Motivation

Set cover is the standard worked example of the primal-dual method, and Chapter 2 of Buchbinder's thesis uses it that way: it is where the machinery of §2.1 is first turned on a concrete NP-hard problem. Two analyses appear. The greedy algorithm, analysed by dual fitting, buys the set with the best cost-per-newly-covered-element ratio and charges the price to the elements it covers; the resulting element prices form an infeasible dual that becomes feasible after scaling by HnH_nHn​. The primal-dual algorithm instead raises the price of an uncovered element until some set's constraint goes tight, buys that set, and repeats; the resulting dual is feasible, and each bought set is paid for by elements of frequency at most fff, giving an fff-approximation.

Both analyses have the same shape, and it is the shape that matters for the rest of the series: the algorithm never sees the optimum. It maintains a dual solution, and the approximation ratio falls out of comparing the primal it built against the dual it accumulated.

Setting

An instance consists of a finite type EEE of elements, a finite type SSS indexing available sets, an assignment s↦As⊆Es \mapsto A_s \subseteq Es↦As​⊆E, and a nonnegative cost c:S→Rc : S \to \mathbb{R}c:S→R. Every element is assumed to lie in at least one available set; the source leaves this implicit, and without it no cover exists and the approximation statements are vacuous. The covering LP and its packing dual are

(P)min⁡∑scsxs  s.t. ∑s:e∈Asxs ≥ 1  (∀e∈E),x≥0,(P)\quad \min \sum_{s} c_s x_s \ \text{ s.t. } \sum_{s : e \in A_s} x_s \ \ge\ 1 \ \ (\forall e \in E), \quad x \ge 0,(P)mins∑​cs​xs​  s.t. s:e∈As​∑​xs​ ≥ 1  (∀e∈E),x≥0, (D)max⁡∑eye  s.t. ∑e∈Asye ≤ cs  (∀s∈S),y≥0.(D)\quad \max \sum_{e} y_e \ \text{ s.t. } \sum_{e \in A_s} y_e \ \le\ c_s \ \ (\forall s \in S), \quad y \ge 0.(D)maxe∑​ye​  s.t. e∈As​∑​ye​ ≤ cs​  (∀s∈S),y≥0.

The frequency of an element is the number of sets containing it, and fff denotes the maximum frequency over all elements.

The two standing assumptions — nonnegative costs, and every element lying in some available set — are carried by a bundled SetCoverInstance, not passed as loose hypotheses. Every source-facing statement in the mission takes such an instance and reads those facts off its fields, so none of them can be instantiated at data violating either. The two indicator lemmas are the exceptions and are labelled as generalized assisting results: one has no cost function in scope at all, and the other's hypothesis that a given CCC covers is strictly stronger than coverability of the family.

Costs are permitted to be zero and the ground type is permitted to be empty. No Nonempty E hypothesis appears anywhere; when EEE is empty, f=0f = 0f=0 and the fff-approximation bound reads cost(C)≤0\mathrm{cost}(C) \le 0cost(C)≤0, which the certificate's tightness clause forces to be 0≤00 \le 00≤0 rather than anything false.

Formalization targets

The results are stated about certificates, not about executable algorithms. This is the central modelling decision of the mission and it is deliberate: the mathematical content of the source's proofs is entirely a statement about the invariants the output satisfies, and separating that from the question of whether a particular procedure produces such output keeps each half provable on its own.

A primal-dual certificate is a pair (C,y)(C, y)(C,y) where C⊆SC \subseteq SC⊆S covers EEE, yyy is dual-feasible, and every s∈Cs \in Cs∈C has a tight dual constraint, ∑e∈Asye=cs\sum_{e \in A_s} y_e = c_s∑e∈As​​ye​=cs​.

Goal — the primal-dual fff-approximation

For any primal-dual certificate (C,y)(C,y)(C,y) and any fractional cover xxx,

∑s∈Ccs ≤ f⋅∑s∈Scsxs.\sum_{s \in C} c_s \ \le\ f \cdot \sum_{s \in S} c_s x_s .s∈C∑​cs​ ≤ f⋅s∈S∑​cs​xs​.

Since this holds against every fractional cover, it holds in particular against an optimal one, so the cover CCC costs at most fff times the fractional optimum and a fortiori at most fff times the integral optimum.

The double-counting step

The one substantive step of the goal is split out as its own target: for a primal-dual certificate,

∑s∈Ccs ≤ f⋅∑e∈Eye.\sum_{s \in C} c_s \ \le\ f \cdot \sum_{e \in E} y_e .s∈C∑​cs​ ≤ f⋅e∈E∑​ye​.

Tightness rewrites the cover's cost as a double sum over chosen sets and their elements; exchanging the order groups it by element, each charged at most fff times. With this and weak duality, the goal is two lines.

The greedy bound

A greedy certificate at ratio ρ\rhoρ is a cover CCC and a nonnegative yyy with ∑s∈Ccs=∑eye\sum_{s \in C} c_s = \sum_{e} y_e∑s∈C​cs​=∑e​ye​ and ∑e∈Asye≤ρ cs\sum_{e \in A_s} y_e \le \rho\, c_s∑e∈As​​ye​≤ρcs​ for every sss. For such a certificate and any fractional cover xxx,

∑s∈Ccs ≤ ρ⋅∑scsxs.\sum_{s \in C} c_s \ \le\ \rho \cdot \sum_{s} c_s x_s .s∈C∑​cs​ ≤ ρ⋅s∑​cs​xs​.

Instantiating ρ=Hn\rho = H_nρ=Hn​ is what recovers the source's greedy guarantee; the harmonic bound itself is already in Mathlib.

Set-cover weak duality and LP attainment

Every dual packing is bounded by every fractional cover, ∑eye≤∑scsxs\sum_e y_e \le \sum_s c_s x_s∑e​ye​≤∑s​cs​xs​; the fractional optimum is at most the integral optimum; and both optima are attained, not merely bounded below. Attainment of the fractional optimum is a genuine linear-programming fact and is the hardest supporting item in the mission.

Significance

This is where the series first converts a dual-feasibility invariant into an approximation ratio on a concrete combinatorial problem, and the two certificate predicates are reused verbatim by the online covering missions later in the series. Set cover approximation has, as far as we can determine, no prior formalization in Mathlib or in any public Lean library: there is no set-cover problem statement, no greedy analysis, and no fff-approximation result to build on.

Difficulty

The two certificate bounds are finite-summation arguments of moderate length — the work is in a double-counting step that reindexes a sum over chosen sets into a sum over elements, weighted by frequency. Attainment of the fractional optimum is different in kind: it needs a compactness or vertex argument about the covering polytope and is the item most likely to need real work. Zero-cost sets are permitted throughout, so any later algorithm definition that divides by a cost must handle that case explicitly.

Formalization scope

Definitions cover §2.2 of the source, excluding §2.2.2 (randomized rounding), which is deferred to a separate mission because its expected-cost and failure-probability analysis is measure-theoretic and shares no infrastructure with the deterministic results.

Two theorems are not in this mission: that the greedy algorithm produces a greedy certificate, and that the primal-dual algorithm produces a primal-dual certificate. Those require defining the algorithms and proving termination and coverage, and are planned as a second wave. Until that wave lands, the source's Theorems 2.4 and 2.6 should not be described as fully formalized — what this mission establishes is the certificate-to-ratio half of each.

Selected references

  • Niv Buchbinder, Designing Competitive Online Algorithms via a Primal-Dual Approach, PhD thesis, Tel Aviv University, 2008, §2.2, pp. 10–14. https://www.tau.ac.il/~nivb/download/phd-thsis.pdf
  • Vijay V. Vazirani, Approximation Algorithms, Springer, 2001, Chapters 2 and 15 — the standard treatment of the greedy and primal-dual set-cover analyses.
10 thms1 active userReviewed
🏆Completed
Linear OptimizationOptimization·Captain: moutei

Primal-Dual Online Algorithms I: Fractional Ski RentalTextbook

Motivation

An online algorithm must commit to decisions before it knows the rest of its input, and it is judged by competitive analysis: the ratio between its cost and the cost of an optimal solution computed with full knowledge of the input. A recurring obstacle in this area is that each problem seems to need its own ad hoc potential-function argument. Buchbinder's thesis develops a single method that replaces those arguments — formulate the offline problem as a covering linear program, let the online algorithm raise the dual variables of its packing dual, and read the competitive ratio off the ratio between the primal and dual increments. The same recipe then yields algorithms for online set cover, weighted caching, ad-auction revenue, routing, and load balancing.

This mission formalizes the chapter where the method is introduced on its smallest example, the ski-rental problem. A customer needs skis for an unknown number of days: renting costs 111 per day and buying costs BBB once. The customer must decide, each morning, whether to rent again or buy, without knowing how many ski days remain. Despite its size the problem is the canonical rent-or-buy dilemma, and it has two classical tight results: a deterministic 222-competitive algorithm, and a randomized algorithm whose competitive ratio tends to e/(e−1)e/(e-1)e/(e−1), due to Karlin, Manasse, McGeoch and Owicki (1994). The primal-dual derivation of both is the content of Chapter 3.

Setting

An instance is a pair (B,k)(B, k)(B,k): the purchase price BBB, a positive integer, and the number k≥0k \ge 0k≥0 of ski days, which the online algorithm does not know. An offline solution either buys at once, paying BBB, or rents on every day, paying kkk; so the offline optimum is

OPT(B,k)  =  min⁡(B,k).\mathrm{OPT}(B,k) \;=\; \min(B, k).OPT(B,k)=min(B,k).

Chapter 3 casts this as a linear program (Figure 3.1, p. 18). The primal is a covering program with one buy variable xxx and one rent variable zjz_jzj​ per day jjj:

minimize   Bx+∑j=1kzjsubject tox+zj≥1  for each day j.\text{minimize } \; B x + \sum_{j=1}^{k} z_j \quad \text{subject to} \quad x + z_j \ge 1 \ \text{ for each day } j.minimize Bx+j=1∑k​zj​subject tox+zj​≥1  for each day j.

Its dual is a packing program with one variable yjy_jyj​ per day:

maximize   ∑j=1kyjsubject to∑j=1kyj≤B,0≤yj≤1.\text{maximize } \; \sum_{j=1}^{k} y_j \quad \text{subject to} \quad \sum_{j=1}^{k} y_j \le B, \qquad 0 \le y_j \le 1 .maximize j=1∑k​yj​subject toj=1∑k​yj​≤B,0≤yj​≤1.

The online structure enters in a single way: a new ski day appends a new covering constraint to the primal and a new variable to the dual, and previously raised primal variables may never be decreased. That monotonicity is what "previous decisions cannot be regretted" means formally.

The fractional primal-dual algorithm maintains xxx, initially 000. On each new day, while x<1x < 1x<1 it sets zj←1−xz_j \leftarrow 1 - xzj​←1−x, then raises

x  ←  x(1+1B)+1cB,x \;\leftarrow\; x\left(1 + \tfrac{1}{B}\right) + \tfrac{1}{cB},x←x(1+B1​)+cB1​,

and sets yj←1y_j \leftarrow 1yj​←1; once xxx has reached 111 it does nothing further. The free parameter ccc is then pinned to the value that makes xxx reach exactly 111 after BBB days,

c  =  (1+1B)B−1.c \;=\; \left(1 + \tfrac{1}{B}\right)^{B} - 1 .c=(1+B1​)B−1.

Formalization targets

Goal — the fractional algorithm's competitive ratio at finite BBB

B xk+∑j=0k−1zj  ≤  (1+1(1+1B)B−1)⋅min⁡(B,k)for every B≥1, k≥0.B\,x_k + \sum_{j=0}^{k-1} z_j \;\le\; \left(1 + \frac{1}{\left(1 + \frac{1}{B}\right)^{B} - 1}\right) \cdot \min(B, k) \qquad \text{for every } B \ge 1, \ k \ge 0 .Bxk​+j=0∑k−1​zj​≤(1+(1+B1​)B−11​)⋅min(B,k)for every B≥1, k≥0.

The coefficient is the exact finite-BBB ratio 1+1/c1 + 1/c1+1/c, left in closed form rather than replaced by a constant. This is deliberate: (1+1B)B\left(1+\frac1B\right)^B(1+B1​)B increases to eee, so c<e−1c < e - 1c<e−1 and therefore 1+1/c>e/(e−1)1 + 1/c > e/(e-1)1+1/c>e/(e−1) for every finite BBB. A goal asserting e/(e−1)e/(e-1)e/(e−1)-competitiveness at finite BBB would be false, and a goal asserting some rounded constant would be invalidated by any sharpening. The closed-form coefficient is the weakest statement that is stable under improvement.

Asymptotic companion — where e/(e−1)e/(e-1)e/(e−1) actually lives

lim⁡B→∞(1+1(1+1B)B−1)  =  ee−1  ≈  1.5819767.\lim_{B \to \infty} \left(1 + \frac{1}{\left(1 + \frac{1}{B}\right)^{B} - 1}\right) \;=\; \frac{e}{e-1} \;\approx\; 1.5819767 .B→∞lim​(1+(1+B1​)B−11​)=e−1e​≈1.5819767.

The classical constant is recorded here, as a limit of the coefficient sequence, and nowhere else.

Parallel target — the deterministic algorithm

detCost(B,k)  ≤  2⋅min⁡(B,k),detCost(B,k)={kk<B2Bk≥B\mathrm{detCost}(B,k) \;\le\; 2 \cdot \min(B,k), \qquad \mathrm{detCost}(B,k) = \begin{cases} k & k < B \\ 2B & k \ge B\end{cases}detCost(B,k)≤2⋅min(B,k),detCost(B,k)={k2B​k<Bk≥B​

Chapter 3's other result, independent of the fractional development.

Significance

The ski-rental bounds themselves are classical and tight, and nothing here is mathematically open. What the chapter contributes, and what this mission captures, is the derivation: it is the template instantiated by every later chapter of the thesis, so the artifacts built here — a covering/packing LP pair, its weak-duality instance, a monotone online variable with a closed-form growth law, and the primal-to-dual increment ratio as the source of the competitive factor — are the vocabulary in which the rest of the series will be stated.

On status: the mathematics is proved, published, and standard. It is not, to the best of a search of Mathlib at revision 0df444a, formalized — that revision contains no competitive-analysis or online-algorithm framework, no ski-rental development, and no general linear-programming weak-duality theorem. So the work this mission asks for is formalization of a known proof, not new mathematics, and the reusable output is infrastructure that does not currently exist in the library.

Difficulty

The offline problem is trivial, and a newcomer's first move — prove min⁡(B,k)\min(B,k)min(B,k) is the optimum and stop — solves the wrong problem. The content is entirely in the online constraint. Three specific places where the obvious argument stalls:

The optimum is never observed. The algorithm's cost must be compared against min⁡(B,k)\min(B,k)min(B,k) without kkk being available to it. The comparison is routed through the dual instead: the dual objective the algorithm accumulates is a lower bound on every feasible primal solution, hence on the optimum, and the algorithm's own primal cost is a fixed multiple of that dual objective.

The growth law is piecewise. The update fires only while x<1x < 1x<1. Summing the per-day increments therefore does not telescope uniformly: days before xxx reaches 111 contribute 1+1/c1 + 1/c1+1/c each and later days contribute nothing, and the index at which the switch happens is exactly BBB — which is a theorem about the recurrence, not an assumption.

The constant is forced, not chosen. c=(1+1/B)B−1c = (1+1/B)^B - 1c=(1+1/B)B−1 is not a free tuning parameter; it is the unique value for which the geometric sequence xj=((1+1/B)j−1)/cx_j = \bigl((1+1/B)^j - 1\bigr)/cxj​=((1+1/B)j−1)/c hits 111 at j=Bj = Bj=B, which is in turn what makes the dual solution feasible (∑jyj≤B\sum_j y_j \le B∑j​yj​≤B). Dual feasibility and the choice of ccc are the same fact.

Formalization scope

Conventions this development commits to. The purchase price is a natural number BBB with 0<B0 < B0<B, because Chapter 3 uses BBB simultaneously as a price, as a day index ("buy skis on the BBBth day"), and as the exponent in (1+1/B)B(1+1/B)^B(1+1/B)B; costs are real numbers, with BBB and kkk coerced. Days are indexed from 000, so day j+1j+1j+1 of the prose is index jjj, and Fin k indexes the kkk days. Real division is total, so 1/0=01/0 = 01/0=0; the hypothesis 0<B0 < B0<B is what keeps every reciprocal in the development genuine, and without it ccc would evaluate to 000 and the recurrence would collapse to the constant zero sequence. The algorithm's x < 1 guard is part of the formalized definition, not an informal aside: without it the cost would keep growing past day BBB.

A documented discrepancy in the source. The prose on p. 17 relaxes the integer program by letting xxx and each zjz_jzj​ range over [0,1][0,1][0,1]; Figure 3.1 on p. 18 prints only x≥0x \ge 0x≥0, zj≥0z_j \ge 0zj​≥0. This mission takes the prose version, 0≤x≤10 \le x \le 10≤x≤1 and 0≤zj≤10 \le z_j \le 10≤zj​≤1, as the canonical fractional program, and also records the nonnegativity-only region exactly as printed. Two separate theorems establish that both have least value min⁡(B,k)\min(B,k)min(B,k), so the discrepancy is resolved inside the mission rather than silently chosen. Solvers should note which of the two predicates a given statement uses.

Ruling out a trivializing formalization. The offline optimum is defined independently, as min⁡(B,k)\min(B,k)min(B,k), and is not derived from the algorithm's own behaviour; a separate theorem certifies that this value really is the least attainable objective value of the canonical program, so the goal cannot be satisfied by redefining the benchmark. The goal inequality is also tight — both sides are equal to (1+1/c)(1+1/c)(1+1/c) times the number of days on which x<1x < 1x<1 — so it cannot be weakened into vacuity without becoming false.

Infrastructure, and what is reusable. The development needs only Mathlib big operators over Fin k, basic real analysis for the limit, and IsLeast. Two items are explicitly infrastructure rather than ski-rental content: the specialized weak-duality theorem for this covering/packing pair, and the Figure 3.1 optimum. Both are candidates for generalization by the later mission on Chapter 2's general linear-programming duality, and a solver who proves the general form there should expect this instance to be derivable from it rather than duplicated.

Out of scope here. The final paragraph of p. 19 rounds the fractional solution into a randomized algorithm by sampling a threshold α∈[0,1]\alpha \in [0,1]α∈[0,1] uniformly and buying on the day whose increment of xxx contains α\alphaα. That step needs a probability space and an expectation argument, and is deferred to the immediate follow-up mission, Primal-Dual Online Algorithms II: Randomized Rounding for Ski Rental. Contributions here should not anticipate it.

Selected references

  • Niv Buchbinder, Designing Competitive Online Algorithms via a Primal-Dual Approach, PhD thesis, Tel Aviv University, 2008. Chapter 3, pp. 17–19. https://www.tau.ac.il/~nivb/download/phd-thsis.pdf
  • Niv Buchbinder and Joseph (Seffi) Naor, The Design of Competitive Online Algorithms via a Primal-Dual Approach, Foundations and Trends in Theoretical Computer Science 3(2–3), 2009. https://doi.org/10.1561/0400000024
  • Anna R. Karlin, Mark S. Manasse, Lyle A. McGeoch and Susan Owicki, Competitive randomized algorithms for nonuniform problems, Algorithmica 11(6), 1994, 542–571. https://doi.org/10.1007/BF01294260
  • Allan Borodin and Ran El-Yaniv, Online Computation and Competitive Analysis, Cambridge University Press, 1998.
9 thms1 active userReviewed
🏆Completed
Mathematical Logic·Captain: tomasz

Friedberg–Muchnik: incomparable computably enumerable setsResearch Paper

Comparing undecidable problems

Computability theory studies which questions admit algorithms and how the unsolvable questions compare with one another. A decision problem can be represented by a set of natural numbers: the question on input nnn is whether nnn belongs to the set. Even when there is no algorithm that always answers this question, there may be an algorithm that eventually recognizes every positive instance. Understanding the relative difficulty of such problems is the setting of the Friedberg–Muchnik theorem.

The original paper by Richard M. Friedberg appeared in 1957 under the title Two recursively enumerable sets of incomparable degrees of unsolvability (solution of Post's problem, 1944). It supplies the historical paper source for this formalization. A. A. Muchnik's independent contribution appeared in Russian in 1956. Friedberg, PNAS 43(2), 236–238; Muchnik, Math-Net bibliography, 1956 entry.

Sets, enumeration, and oracle access

A set A⊆NA\subseteq\mathbb NA⊆N is computably enumerable, abbreviated c.e., if membership has a semidecision procedure: on input nnn, the procedure halts exactly when n∈An\in An∈A. The older terminology is recursively enumerable, abbreviated r.e. The Lean predicate CEnumerable A uses Mathlib's REPred for this property. A computable set has a decision procedure that terminates on every input and answers membership correctly; this is expressed separately by ComputableSet A using ComputablePred.

For each set AAA, define its characteristic function by

χA(n)={1n∈A,0n∉A.\chi_A(n)=\begin{cases}1&n\in A,\\0&n\notin A.\end{cases}χA​(n)={10​n∈A,n∈/A.​

An oracle for AAA answers requests for this function's values. It always supplies an answer, even if membership in AAA cannot be computed without an oracle. The declaration setOracle A represents this total function inside Mathlib's type of partial functions from natural numbers to natural numbers.

Write A≤TBA\le_T BA≤T​B when an algorithm with access to the membership oracle for BBB computes χA\chi_AχA​ on every input. This is Turing reducibility, expressed by SetTuringReducible A B. The algorithm may make several queries, with later queries depending on earlier answers. Incomparability requires both A̸≤TBA\not\le_T BA≤T​B and B̸≤TAB\not\le_T AB≤T​A; it is stronger than saying the two sets merely have different degrees. These conventions specify the mathematical reading of the supplied Lean definitions.

Formalization target

The goal is the following unconditional existence statement:

∃A,B⊆N,A is c.e. ∧ B is c.e. ∧ A̸≤TB ∧ B̸≤TA.\exists A,B\subseteq\mathbb N,\qquad A\text{ is c.e.}\ \land\ B\text{ is c.e.}\ \land\ A\not\le_T B\ \land\ B\not\le_T A.∃A,B⊆N,A is c.e. ∧ B is c.e. ∧ A≤T​B ∧ B≤T​A.

Its Lean name is Computability.friedberg_muchnik. No enumeration, pair of sets, or oracle program is supplied as a hypothesis. Both sets must be obtained as witnesses to the conclusion. The statement matches Theorem 26.2 in Arnold W. Miller's Lecture notes in Recursion Theory, Section 26, with the theorem on page 51 and its proof on pages 51–54. Miller, December 3, 2008 version.

Mathematical and formal significance

The target establishes that the c.e. problems have incomparable levels of computational difficulty. Its witnesses cannot be computable: a computable membership procedure would also work in the presence of any other oracle simply by making no queries, contradicting the required nonreducibility. The stronger historical consequence is a positive solution of Post's problem: a c.e. degree can lie strictly between the computable degree and the halting degree. Miller records this consequence separately as Corollary 26.3 on page 54. Miller, Section 26.

The mathematical theorem is established; the work requested here is its Lean 4 formalization. A completed development must construct witnesses, prove their computable enumerability, and exclude oracle computations in each direction using Mathlib's actual reducibility relation. The provided goal currently ends in sorry. Successful compilation of this statement checks its formulation and imports; it does not constitute a proof of the existence result.

Difficulty of simultaneous requirements

The main obstacle is preserving decisions about oracle computations while both sets are still being enumerated. An additional element in one set can change an oracle answer used by an earlier computation, undermining the attempt to separate the other set from it. There are infinitely many candidate programs in both directions. Thus a formal treatment has to justify the eventual stability of the relevant computations as well as the effectiveness of the enumeration. This is the setting of the finite injury argument developed in Miller's proof of Theorem 26.2. Miller, pages 51–54.

Formalization scope

The sets are arbitrary Set ℕ, including the natural number zero in their ambient domain. The oracle answers use natural numbers, with one for membership and zero for nonmembership. Classical reasoning is used to define the oracle for an arbitrary set; it supplies no assertion that this function is computable. Each oracle is nevertheless total. Replacing it with a partial membership recognizer would change the meaning of the target.

The foundation consists of Mathlib.Computability.RE and Mathlib.Computability.TuringDegree, together with the supplied definitions in namespace Computability. SetTuringEquivalent records reducibility in both directions. degreeOfSet maps a characteristic-function oracle to its Turing degree, and CEnumerableDegree says that a degree has a c.e. representative. These additional definitions are retained as useful interfaces, while the root theorem itself is expressed directly with sets and TuringIncomparable.

A complete proof will need representations of effective finite stages and oracle computations, and lemmas relating those representations to the imported predicates. Such infrastructure can support later formalizations involving oracle use, computable enumerations, and priority constructions. Contributions should establish these connections with Mathlib's definitions and finish the unconditional target. The theorem must not be replaced by mere degree inequality, weakened reducibility, or a conditional assertion that assumes the required incomparable sets already exist.

Selected references

  • Richard M. Friedberg, Two recursively enumerable sets of incomparable degrees of unsolvability (solution of Post's problem, 1944), Proceedings of the National Academy of Sciences of the USA 43(2), 236–238, 1957. DOI; free archived paper.
  • A. A. Muchnik, On the unsolvability of the problem of reducibility in the theory of algorithms (Russian: Неразрешимость проблемы сводимости теории алгоритмов), Doklady Akademii Nauk SSSR 108(2), 194–197, 1956. Math-Net bibliography, 1956 entry.
  • Arnold W. Miller, Lecture notes in Recursion Theory, University of Wisconsin–Madison, version dated December 3, 2008, Section 26, Theorem 26.2, pages 51–54. Author-hosted PDF.
11 thms1 active userReviewed
🏆Completed
Algebra·Captain: Cosme

Eilenberg Theorems for Many-Sorted FormationsResearch Paper

Motivation

Classical Eilenberg correspondence theorems connect algebraic descriptions of finite-state behavior with language-theoretic closure principles. The version developed by Juan Climent Vidal and Enric Cosme Llópez replaces one-sorted monoids by many-sorted algebras, so that operations may accept arguments of several prescribed sorts and return a value of another sort. This is the natural algebraic setting for typed term languages: a signature records the permitted input and output sorts of each operation, and a language is a family of sets indexed by sorts. The paper proves that two ways of organizing finite-state behavior—through finite-index congruences and through regular languages—determine the same ordered structure. The source is the final section of Climent Vidal and Cosme Llópez, Eilenberg theorems for many-sorted formations, published in the Houston Journal of Mathematics 45(2), 2019.

The companion manuscript A Kleene theorem for free many-sorted algebras develops the free-term and recognizability infrastructure used by this formalization. It supplies a concrete Lean representation of sorted signatures, free algebras, homomorphisms, terms, and finite many-sorted carriers. The present mission begins from that reusable core and formalizes the formation-level theorem of the HJM paper, rather than repeating the already completed Kleene development.

Setting

Fix a finite type of sorts SSS and an SSS-sorted signature Σ\SigmaΣ. For an SSS-sorted set XXX, write TΣ(X)T_\Sigma(X)TΣ​(X) for the free Σ\SigmaΣ-algebra on XXX. A congruence Φ\PhiΦ on a many-sorted algebra is a family of equivalence relations Φs\Phi_sΦs​, one on each carrier sort, compatible with every basic operation. Its index is finite when the entire sorted quotient family

(TΣ(X)s/Φs)s∈S(T_\Sigma(X)_s/\Phi_s)_{s\in S}(TΣ​(X)s​/Φs​)s∈S​

is finite. A sorted language LLL is Φ\PhiΦ-saturated when membership in LsL_sLs​ is constant on every Φs\Phi_sΦs​-class. The syntactic congruence Ω(L)\Omega(L)Ω(L) is the greatest algebra congruence that saturates LLL, and LLL is regular when Ω(L)\Omega(L)Ω(L) has finite index.

A finite-index congruence formation F\mathfrak FF selects, for every variable family XXX, a nonempty filter F(X)\mathfrak F(X)F(X) of finite-index congruences on TΣ(X)T_\Sigma(X)TΣ​(X). The selection is closed under intersections, upward inclusion, and pullback along homomorphisms whose composite with the relevant quotient projection is surjective at every sort.

A regular-language formation L\mathcal LL selects regular languages in each TΣ(X)T_\Sigma(X)TΣ​(X). It contains every language saturated by the universal congruence; whenever L,K∈L(X)L,K\in\mathcal L(X)L,K∈L(X) it contains every language saturated by Ω(L)∩Ω(K)\Omega(L)\cap\Omega(K)Ω(L)∩Ω(K); and it satisfies the corresponding pullback-saturation condition for quotient-surjective homomorphisms.

The two constructions are

LF(X)={L∣L is saturated by some Φ∈F(X)},\mathcal L_{\mathfrak F}(X) =\{L\mid \text{$L$ is saturated by some }\Phi\in\mathfrak F(X)\}, LF​(X)={L∣L is saturated by some Φ∈F(X)},

and

FL(X)={Φ∣Φ has finite index and every Φ-saturated language lies in L(X)}. \mathfrak F_{\mathcal L}(X) =\{\Phi\mid \text{$\Phi$ has finite index and every $\Phi$-saturated language lies in $\mathcal L(X)$}\}. FL​(X)={Φ∣Φ has finite index and every Φ-saturated language lies in L(X)}.

Formalization targets

The capstone is the paper's final formation theorem: the ordered sets of finite-index congruence formations and regular-language formations are order-isomorphic, with the isomorphism fixed to be exactly the two displayed constructions.

Form⁡Cgrfi(Σ)≅Form⁡Langr(Σ). \operatorname{Form}_{\mathrm{Cgr}_{\mathrm{fi}}}(\Sigma) \cong \operatorname{Form}_{\mathrm{Lang}_{r}}(\Sigma). FormCgrfi​​(Σ)≅FormLangr​​(Σ).

The milestones establish the universal property of the syntactic congruence, closure of finite-index congruences under the filter operations, the well-definedness of each construction, and the two recovery identities

FLF=F,LFL=L. \mathfrak F_{\mathcal L_{\mathfrak F}}=\mathfrak F, \qquad \mathcal L_{\mathfrak F_{\mathcal L}}=\mathcal L.FLF​​=F,LFL​​=L.

These identities determine the inverse maps and prevent the goal from being satisfied by an unrelated abstract order equivalence.

Significance

The theorem packages a family of finite quotients and a family of regular languages as interchangeable data. On the algebraic side, closure is expressed by filters of congruences and quotient-surjective pullbacks. On the language side, the same information is expressed through saturation by syntactic congruences. The result therefore gives a systematic translation between quotient-based and language-based classifications in a typed, many-sorted setting.

Formalizing the theorem adds congruence, quotient-index, saturation, syntactic-congruence, and formation interfaces to the existing free many-sorted algebra library. These components are reusable for future formalizations of recognizability, Myhill–Nerode principles, finite algebra formations, and varieties or pseudovarieties of typed algebras. The mathematical theorem is already proved in the cited 2019 paper; the remaining task is to produce machine-checked Lean proofs of the source-faithful statements.

Difficulty

The two maps are simple to write down but their inverse laws are not pointwise tautologies. A finite-index congruence must be reconstructed from the family of all languages it saturates, and a language formation must be reconstructed from all selected finite-index congruences. In the many-sorted case, finiteness applies to the entire quotient family, including its support across sorts, and intersections and pullbacks must preserve this global condition. The quotient-surjectivity premise is also essential: replacing it by ordinary surjectivity of the original homomorphism would change the formation axiom.

The syntactic congruence creates a second layer of care. It must be characterized as the greatest compatible sorted equivalence saturating a language, not merely as the kernel of the language's characteristic function, which need not itself respect the algebra operations. Thus an argument that treats saturation as an arbitrary set-theoretic equivalence misses the algebraic compatibility required by the theorem.

Formalization scope

The Lean development uses the existing MSKleene representation of sorted sets, signatures, argument tuples, algebras, homomorphisms, terms, and free algebras. Congruences are sort-indexed setoids with explicit compatibility for every signature operation. Their order is inclusion of relations. Intersection and the universal congruence are concrete constructions, while pullback is defined along an algebra homomorphism.

Finite index is represented by finiteness of the sigma-type of all quotient carriers, matching the paper's finite sorted-set convention; it is not weakened to separate finiteness of each inhabited component. The sort type is assumed finite in the finite-index filter and formation correspondence theorems, as required in the final section of the source. Languages are arbitrary sorted subsets of free term algebras, including empty components. No nonemptiness assumption on variable carriers or algebra sorts is added.

The syntactic congruence is defined internally as the supremum-style least upper bound of all congruences saturating a language, rather than postulated together with its universal property. The formation structures contain only the source closure axioms. In particular, neither correspondence map nor either inverse identity is stored as a structure field; doing so would trivialize the capstone. Contributions are welcome on the foundational universal-property and finite-index lemmas, the two formation constructors, and the recovery identities that assemble into the final order isomorphism.

Selected references

  • Juan Climent Vidal and Enric Cosme Llópez, Eilenberg theorems for many-sorted formations, Houston Journal of Mathematics 45(2), 2019, pp. 351–416. arXiv:1604.04792
  • Samuel Eilenberg, Automata, Languages, and Machines, Volume B, Academic Press, 1976.
  • Adolfo Ballester-Bolinches, Jean-Éric Pin, and Xaro Soler-Escrivà, Formations of finite monoids and formal languages: Eilenberg's variety theorem revisited, Forum Mathematicum 26, 2014, pp. 1737–1761.
9 thms1 active userReviewed
🏆Completed
Algebra·Captain: Cosme

A Kleene Theorem for Free Many-Sorted AlgebrasResearch Paper

Motivation

Kleene's theorem (Kleene 1956; McNaughton–Yamada 1960) is a cornerstone of formal language theory: over a free monoid, the languages recognized by finite automata are exactly the regular ones — those built from finite languages by union, concatenation, and the Kleene star. Mezei and Wright (1967) lifted recognizability off strings, calling a subset of an arbitrary algebra recognizable when it is the preimage of a subset of a finite algebra under a homomorphism. Replacing strings by terms — finite trees labelled by operation symbols — gives the theory of recognizable tree languages and finite tree automata of Gécseg and Steinby (1984), where the Kleene correspondence reappears with a tree concatenation and an iteration operation in the role of the star.

Many computational structures are inherently many-sorted: typed lambda calculi, structured programming languages, process calculi, XML schemas — data and operations organized into distinct sorts. In the many-sorted setting a signature assigns to each operation symbol the sorts of its arguments and of its value, variables carry sorts, and a language is a sort-indexed family of term sets. The predecessor of this mission, Climent Vidal–Cosme Llópez 2020 (CVCL20), established that recognizability over free many-sorted algebras is preserved — and, where applicable, reflected — by substitution, iteration, quotient, inverse tree-homomorphic image, and direct linear image, via finite-index congruences. What CVCL20 left open is the regular side: whether a natural class of many-sorted regular expressions captures exactly the recognizable languages. This mission closes that gap.

Setting

Fix a finite set of sorts SSS. An SSS-sorted set A=(As)s∈SA = (A_s)_{s\in S}A=(As​)s∈S​ is a family of sets; it is finite when ∐s∈SAs\coprod_{s\in S} A_s∐s∈S​As​ is finite. An SSS-sorted signature Σ\SigmaΣ assigns to each pair (s,s)∈S⋆×S(\mathbf{s}, s) \in S^\star \times S(s,s)∈S⋆×S a set Σs,s\Sigma_{\mathbf{s},s}Σs,s​ of operation symbols of arity s\mathbf{s}s and coarity sss. A Σ\SigmaΣ-algebra A\mathbf{A}A is an SSS-sorted set AAA together with, for each σ∈Σs,s\sigma \in \Sigma_{\mathbf{s},s}σ∈Σs,s​, an operation σA ⁣:As→As\sigma^{\mathbf A}\colon A_{\mathbf s} \to A_sσA:As​→As​, where As=∏jAsjA_{\mathbf s} = \prod_{j} A_{s_j}As​=∏j​Asj​​. A homomorphism commutes with all operations sortwise.

The free Σ\SigmaΣ-algebra TΣ(X)\mathbf T_\Sigma(X)TΣ​(X) on an SSS-sorted set XXX of variables has as its sort-sss carrier TΣ(X)s\mathrm T_\Sigma(X)_sTΣ​(X)s​ the set of (X,s)(X,s)(X,s)-terms; every SSS-sorted map X→AX \to AX→A extends uniquely to a homomorphism TΣ(X)→A\mathbf T_\Sigma(X) \to \mathbf ATΣ​(X)→A. Following automata-theoretic tradition, subsets of TΣ(X)\mathrm T_\Sigma(X)TΣ​(X) are called languages. For a sort sss, a language L⊆TΣ(X)sL \subseteq \mathrm T_\Sigma(X)_sL⊆TΣ​(X)s​ is sss-recognizable when there are a finite Σ\SigmaΣ-algebra N\mathbf NN, a homomorphism f ⁣:TΣ(X)→Nf\colon \mathbf T_\Sigma(X) \to \mathbf Nf:TΣ​(X)→N, and a subset M⊆NsM \subseteq N_sM⊆Ns​ with L=fs−1[M]L = f_s^{-1}[M]L=fs−1​[M]. Write Recs(TΣ(X))\mathrm{Rec}_s(\mathbf T_\Sigma(X))Recs​(TΣ​(X)) for the set of all such LLL.

Two operations on languages, both performed sortwise, generate the regular expressions. Given a variable z∈Xuz \in X_uz∈Xu​ and a language L⊆TΣ(X)uL \subseteq \mathrm T_\Sigma(X)_uL⊆TΣ​(X)u​, zzz-substitution ( ⁣zL ⁣)s♯p\left(\!\begin{smallmatrix}z\\ L\end{smallmatrix}\!\right)^{\sharp\mathsf p}_s(zL​)s♯p​ replaces, in every term of an input language of sort sss, each occurrence of zzz independently by a term of LLL. The zzz-iteration is L⋆z=⋃i∈NLi zL^{\star z} = \bigcup_{i\in\mathbb N} L^{i\,z}L⋆z=⋃i∈N​Liz, where L0 z={z}L^{0\,z} = \{z\}L0z={z} and Li+1 z=Li z∪( ⁣zLiz ⁣)s♯p(L)L^{i+1\,z} = L^{i\,z} \cup \left(\!\begin{smallmatrix}z\\ L^{i\,z}\end{smallmatrix}\!\right)^{\sharp\mathsf p}_s(L)Li+1z=Liz∪(zLiz​)s♯p​(L). For a finite SSS-sorted set ZZZ, the regular signature Reg(S,Σ,Z)\mathrm{Reg}(S,\Sigma,Z)Reg(S,Σ,Z) expands Σ\SigmaΣ by an empty constant ∅s\varnothing_s∅s​, a binary sum +s+_s+s​, a unary zzz-iteration (⋅)⋆z(\cdot)^{\star z}(⋅)⋆z for each z∈Zsz\in Z_sz∈Zs​, and a zzz-substitution operation for each z∈Ztz\in Z_tz∈Zt​. Its terms are the regular expressions over (S,Σ,Z)(S,\Sigma,Z)(S,Σ,Z); the power algebra TΣ(Z)℘\mathbf T_\Sigma(Z)^\wpTΣ​(Z)℘ carries a canonical Reg(S,Σ,Z)\mathrm{Reg}(S,\Sigma,Z)Reg(S,Σ,Z)-algebra structure, and interpreting a regular expression there yields a language {R}sZ♯\{R\}^{Z\sharp}_s{R}sZ♯​. A language L⊆TΣ(X)sL\subseteq \mathrm T_\Sigma(X)_sL⊆TΣ​(X)s​ is sss-regular when L={R}sZ♯L = \{R\}^{Z\sharp}_sL={R}sZ♯​ for some finite Z⊇XZ\supseteq XZ⊇X and some regular expression RRR of type sss; write Regs(TΣ(X))\mathrm{Reg}_s(\mathbf T_\Sigma(X))Regs​(TΣ​(X)).

Formalization targets

Goal — the many-sorted Kleene theorem

∀ s∈S,Recs(TΣ(X))  =  Regs(TΣ(X)).\forall\, s\in S,\qquad \mathrm{Rec}_s(\mathbf T_\Sigma(X)) \;=\; \mathrm{Reg}_s(\mathbf T_\Sigma(X)).∀s∈S,Recs​(TΣ​(X))=Regs​(TΣ​(X)).

The statement fixes no automaton model and no normal form for regular expressions: it asserts only that the two classes of languages coincide, at every sort, for every finite SSS, every finite SSS-sorted signature Σ\SigmaΣ, and every finite SSS-sorted set XXX. It splits into Regs⊆Recs\mathrm{Reg}_s \subseteq \mathrm{Rec}_sRegs​⊆Recs​ (Corollary 4.8) and Recs⊆Regs\mathrm{Rec}_s \subseteq \mathrm{Reg}_sRecs​⊆Regs​ (Proposition 4.10).

Significance

The result completes the Kleene–Myhill–Nerode correspondence on the side of universal algebra, uniformly over an arbitrary finite many-sorted signature: it names the exact operations — those of Σ\SigmaΣ, plus empty language, union, sortwise substitution, and sortwise iteration — that generate precisely the finite-state behaviours. Over non-free structures the correspondence is known to fail (recognizable but non-rational subsets of a monoid, Eilenberg 1974), which is what makes the free many-sorted algebra the natural home for an exact statement. The forward direction organizes the regular languages into a Reg\mathrm{Reg}Reg-algebra and instantiates the closure properties of CVCL20; the converse gives a constructive, syntactic procedure — from a recognizing homomorphism it builds a regular expression denoting the language — generalizing Lemma 2.5.7 of Gécseg–Steinby, itself descended from McNaughton–Yamada.

The paper is new (June 2026) and has no machine-checked proof. This mission produces the first formalization: a reusable Lean development of finite many-sorted universal algebra — signatures, algebras, free term algebras and their universal property, the Artinian subterm order, power algebras, recognizability, and the substitution/iteration calculus — together with the two inclusions and the state-elimination argument. Everything below the §4 headline results is infrastructure of independent value for many-sorted formal language theory.

Difficulty

The converse inclusion is the substance. The single-sorted proof eliminates automaton states one at a time along a single axis; the naive port to the many-sorted case — fix a linear order on all states and eliminate — loses track of the sort at which each elimination happens and does not terminate cleanly. The argument instead carries a sortwise budget: an SSS-sorted family K≤NK \le NK≤N recording, for each sort ttt, the set KtK_tKt​ of state values still admissible at internal subterms. The induction is on ∥∥K∥∥=∑s∈Sks\lVert\lVert K\rVert\rVert = \sum_{s\in S} k_s∥∥K∥∥=∑s∈S​ks​, and each step removes the top state of one chosen sort, so the recursion branches over the sorts whose budget is nonzero and the key identity (Equation (E)) is a union over those sorts. The inductive invariant — the family of auxiliary languages Lu(C,K,l)L_u(C,K,l)Lu​(C,K,l) with its budget bookkeeping — is what separates the many-sorted argument from its ancestor; it is also the part Gécseg–Steinby declare "obvious from the construction" and this proof spells out in full (Claims C1–C6).

Formalization scope

Proposed Lean representation: SSS a type with [Fintype S]; an SSS-sorted set as S → Type; a signature as a family List S → S → Type with finiteness where the theorems need it; the free algebra as an inductive term type; the power algebra with sort-sss carrier Set (T_Σ Z s); sss-recognizability as the existence of a finite Σ\SigmaΣ-algebra, a homomorphism, and a subset whose sortwise preimage is the language. Committed conventions: SSS finite throughout; Σ\SigmaΣ finite and XXX finite for the §4 results (so that only finitely many basic terms exist and the budget induction is well-founded); the regular operations are exactly {∅,+,(⋅)⋆z,z-subst}\{\varnothing, +, (\cdot)^{\star z}, z\text{-subst}\}{∅,+,(⋅)⋆z,z-subst} together with the operations of Σ\SigmaΣ — not an unrestricted Boolean or closure algebra, which would trivialize the statement.

A complete development needs: the many-sorted UA core (sorted sets and maps, signature, algebra, homomorphism, subalgebra, congruence); the free algebra with unique readability (Proposition 3.4) and universal property (Proposition 3.5); the Artinian subterm order (Proposition 3.6); the power algebra; recognizability and sss-recognizability with the CVCL20 closure results (Propositions 3.29, 3.30, 3.33); the substitution and iteration calculus (Lemmas 3.23, 3.25, 3.28, Corollary 3.17, Lemma 3.18); and the §4 regular-expression layer (Definition 4.1, Proposition 4.3, Corollary 4.4, Definition 4.6). The UA core and the substitution calculus are reusable beyond this mission. Contributions are welcome at every level — the definitions, the closure results, the auxiliary claims C1–C6, and either inclusion.

Selected references

  • L. Gong, R. Ruiz Mora, N. Sanmartín Vich, E. Cosme Llópez, A Kleene theorem for free many-sorted algebras, 2026.
  • J. Climent Vidal, E. Cosme Llópez, Congruence-based proofs of the recognizability theorems for free many-sorted algebras, Journal of Logic and Computation 30(2) (2020), 561–633. https://arxiv.org/abs/1808.08217
  • F. Gécseg, M. Steinby, Tree Automata, Akadémiai Kiadó, Budapest, 1984.
  • R. McNaughton, H. Yamada, Regular expressions and state graphs for automata, IRE Transactions on Electronic Computers EC-9 (1960), 39–47.
  • S. C. Kleene, Representation of events in nerve nets and finite automata, in Automata Studies, Princeton University Press, 1956, 3–42.
  • J. Mezei, J. Wright, Algebraic automata and context-free sets, Information and Control 11 (1967), 3–29.
  • S. Eilenberg, Automata, Languages, and Machines, Vol. A, Academic Press, New York, 1974.
32 thms1 active userReviewed
Operations Research·Captain: Shuze Chen

The 4/3 Conjecture for Metric TSPOpen Problem

Motivation

The traveling salesman problem — visit nnn cities by the cheapest round trip — is the most widely known problem in combinatorial optimization, and its central open question concerns a linear program. The subtour-elimination relaxation (the Held–Karp bound) replaces tours by fractional edge weights, and both in theory and in practice (it powers the lower bounds inside the Concorde solver) it is remarkably close to the true optimum. How close, in the worst case, is the integrality gap of the relaxation: the supremum of OPT/LP\mathrm{OPT}/\mathrm{LP}OPT/LP over metric instances. Explicit instance families push the gap up to 4/34/34/3; the best proven upper bound sits just barely below 3/23/23/2. The 4/3 conjecture — the gap is exactly 4/34/34/3 — has been the benchmark question of approximation algorithms for four decades.

Timeline

  • 1954. Dantzig, Fulkerson, and Johnson solve a 49-city instance by hand with the cutting planes that become the subtour-elimination LP.
  • 1970–1971. Held and Karp introduce the 1-tree/Lagrangian bound and show it equals the subtour LP value — since then, "the Held–Karp bound".
  • 1976/1978. Christofides, and independently Serdyukov, give the 3/23/23/2-approximation: minimum spanning tree plus a matching on odd-degree vertices.
  • 1980. Wolsey (Math. Prog. Study 13) shows Christofides' analysis goes through against the LP: OPT≤32 LP\mathrm{OPT} \le \frac{3}{2}\,\mathrm{LP}OPT≤23​LP, so the integrality gap is at most 3/23/23/2. Shmoys and Williamson (IPL 1990) rediscover this via a monotonicity property.
  • 1995. Goemans (Math. Programming 69) analyzes the worst-case ratios of TSP relaxations and states the 4/34/34/3 conjecture explicitly; the 4/34/34/3 lower-bound families (three parallel paths) are by then folklore.
  • 2011–2014. For graph metrics (shortest-path metrics of unweighted graphs) the barrier breaks: Oveis Gharan–Saberi–Singh and Mömke–Svensson beat 3/23/23/2, and Sebő–Vygen (Combinatorica 2014) reach 7/57/57/5 — the conjectured-optimal shape of progress, but only for a special class.
  • 2020–2022. Karlin, Klein, and Oveis Gharan prove a 3/2−ε3/2 - \varepsilon3/2−ε approximation for general metric TSP (STOC 2021) and then an integrality-gap bound γ≤3/2−ε\gamma \le 3/2 - \varepsilonγ≤3/2−ε with ε>10−36\varepsilon > 10^{-36}ε>10−36 (FOCS 2022), via max-entropy sampling of spanning trees and strongly Rayleigh distributions — the first general improvement over Wolsey in forty years, by an astronomically small margin.
  • Today. The gap between the 4/34/34/3 lower bound and the 3/2−10−363/2 - 10^{-36}3/2−10−36 upper bound is the conjecture. For half-integral LP solutions — where the conjectured extremal instances live — the bound has been pushed to 1.49831.49831.4983 (Gupta, Lee, Li, Mucha, Newman, and Sarkar, via matroid-based rounding).

Setting

An instance on n≥3n \ge 3n≥3 cities is a cost function ccc assigning to each ordered pair of cities u,vu, vu,v a real cost c(u,v)c(u,v)c(u,v), required to be a metric cost: symmetric (c(u,v)=c(v,u)c(u,v) = c(v,u)c(u,v)=c(v,u)), zero on the diagonal (c(v,v)=0c(v,v) = 0c(v,v)=0), and satisfying the triangle inequality c(u,w)≤c(u,v)+c(v,w)c(u,w) \le c(u,v) + c(v,w)c(u,w)≤c(u,v)+c(v,w). Nonnegativity follows; distinct cities at distance zero are allowed, as usual for metric TSP.

A tour visits every city exactly once and returns to its start. Formally a tour is given by an ordering: a permutation π\piπ of the cities, traversed as π(0),π(1),…,π(n−1)\pi(0), \pi(1), \dots, \pi(n-1)π(0),π(1),…,π(n−1) and back to π(0)\pi(0)π(0); its cost tourCost(c,π)\mathrm{tourCost}(c, \pi)tourCost(c,π) is the sum of the costs of consecutive steps, and OPT(c)\mathrm{OPT}(c)OPT(c) — written tspOpt c — is the minimum over all orderings.

The subtour-elimination (Held–Karp) relaxation replaces the tour by a fractional edge weight x(u,v)x(u,v)x(u,v) for each pair of cities. A weight vector xxx is feasible (IsHeldKarp x) when it is symmetric with zero diagonal, has entries in [0,1][0,1][0,1], gives every city fractional degree two (∑ux(v,u)=2\sum_u x(v,u) = 2∑u​x(v,u)=2), and crosses every nontrivial cut at least twice: for every set SSS of cities other than ∅\emptyset∅ and all cities, ∑u∈S∑v∉Sx(u,v)≥2\sum_{u \in S} \sum_{v \notin S} x(u,v) \ge 2∑u∈S​∑v∈/S​x(u,v)≥2. The Held–Karp bound hkValue c is the infimum of 12∑u∑vc(u,v) x(u,v)\frac{1}{2}\sum_u \sum_v c(u,v)\,x(u,v)21​∑u​∑v​c(u,v)x(u,v) over feasible xxx (the double sum counts each edge twice, hence the 12\frac1221​). The incidence vector of any tour is feasible, so LP≤OPT\mathrm{LP} \le \mathrm{OPT}LP≤OPT always.

Formalization targets

Goal — the 4/3 conjecture

OPT(c)  ≤  43 LP(c)for every n≥3 and every metric cost c.\mathrm{OPT}(c) \;\le\; \tfrac{4}{3}\,\mathrm{LP}(c) \qquad \text{for every } n \ge 3 \text{ and every metric cost } c.OPT(c)≤34​LP(c)for every n≥3 and every metric cost c.

Together with the known lower-bound families this says the integrality gap is exactly 4/34/34/3. The goal carries no algorithm and no constant to improve: it is the terminal statement of the ladder, open in both directions (a proof or a counterexample instance would each settle it).

Milestones — the known ladder

Five results over the same definitions: the relaxation is valid (LP≤OPT\mathrm{LP} \le \mathrm{OPT}LP≤OPT); instance families force the gap arbitrarily close to 4/34/34/3; tree doubling gives OPT≤2 LP\mathrm{OPT} \le 2\,\mathrm{LP}OPT≤2LP; Wolsey's theorem gives OPT≤32 LP\mathrm{OPT} \le \frac{3}{2}\,\mathrm{LP}OPT≤23​LP, the classical upper bound; and the Karlin–Klein–Oveis Gharan record OPT≤(32−ε) LP\mathrm{OPT} \le (\frac{3}{2} - \varepsilon)\,\mathrm{LP}OPT≤(23​−ε)LP for some ε>10−36\varepsilon > 10^{-36}ε>10−36 (FOCS 2022). The last milestone is a statement-level target: its known proof (max-entropy sampling, strongly Rayleigh polynomials) is far beyond current formalization practice, so the mission's usable proving frontier remains Wolsey — the milestone records the state of the art as a formal statement.

Significance

The 4/3 conjecture is the reference open problem of approximation algorithms: the quality of the subtour LP calibrates every algorithmic advance on TSP, and the conjectured extremal instances guide the search for better rounding schemes. The bound is also what practical solvers actually compute — branch-and-cut on this LP solves instances with tens of thousands of cities — so the conjecture is a statement about the observed tightness of the world's most-used combinatorial lower bound.

Nothing in this circle exists in any proof assistant: Mathlib has no TSP, no LP relaxations, no polyhedral combinatorics of tours. The mission's milestones force the base layer into existence — tours over Equiv.Perm, cut constraints over Finset, and, for the upper bounds, the parity and tree arguments (spanning trees against the LP, T-joins for the 3/23/23/2 bound) whose infrastructure is reusable for matching theory and network design far beyond TSP.

Difficulty

The naive plan — round the LP solution to a tour — has no known analysis losing less than 3/23/23/2 in general, and the half-integral extremal instances show the hard cases are structured and simple-looking at once. Christofides' matching argument is provably stuck at 3/23/23/2 against the LP; forty years of work moved the constant by 10−3610^{-36}10−36, and that advance needed an entirely new probabilistic toolkit. On the other side, no instance family with ratio above 4/34/34/3 has ever been found despite extensive computational search over small instances (Benoit–Boyd and successors). Both directions of the goal are genuinely open territory.

Formalization scope

The Lean model commits to: cities Fin n; costs c : Fin n → Fin n → ℝ with IsMetricCost (symmetry, zero diagonal, triangle inequality — nonnegativity is derived, and semimetrics are included as in the standard statement of the conjecture); tours as orderings π : Equiv.Perm (Fin n) traversed cyclically via finRotate, so every permutation denotes a Hamiltonian cycle and every Hamiltonian cycle is denoted; both optimal values as sInf over nonempty, bounded-below sets of reals, so they are genuine minima for n ≥ 3. The hypothesis 3 ≤ n is load-bearing: for n ≤ 2 the degree-2 constraints are infeasible, sInf ∅ = 0 by convention, and the bounds would be false — every theorem therefore carries it.

Welcome contributions: the milestones in any order — held_karp_le_opt is the natural entry point (the tour's incidence vector crosses every cut at least twice); integrality_gap_lower_bound needs the three-path instance family and a case analysis on its tours; tree_doubling_bound needs spanning trees against the LP; wolsey_bound adds the T-join/parity argument and is the summit. Reusable infrastructure — spanning tree polytopes, T-joins, Eulerian traversals, cut lemmas — is welcome as platform theorems. Graph-TSP (7/57/57/5), path TSP, and asymmetric TSP are deliberately left to future missions; the Karlin–Klein–Oveis Gharan bound is stated as a milestone, but its sampling machinery is expected to arrive, if ever, as shared infrastructure built over many contributions.

Selected references

  • G. Dantzig, R. Fulkerson, S. Johnson, Solution of a large-scale traveling-salesman problem, Oper. Res. 2 (1954).
  • M. Held, R. Karp, The traveling-salesman problem and minimum spanning trees, Oper. Res. 18 (1970); Part II, Math. Programming 1 (1971).
  • N. Christofides, Worst-case analysis of a new heuristic for the travelling salesman problem, CMU report (1976); A. Serdyukov, Upravlyaemye Sistemy 17 (1978).
  • L. Wolsey, Heuristic analysis, linear programming and branch and bound, Math. Prog. Study 13 (1980). doi:10.1007/BFb0120913
  • D. Shmoys, D. Williamson, Analyzing the Held-Karp TSP bound: a monotonicity property with application, Inf. Process. Lett. 35 (1990). doi:10.1016/0020-0190(90)90028-V
  • M. Goemans, Worst-case comparison of valid inequalities for the TSP, Math. Programming 69 (1995). doi:10.1007/BF01585563
  • A. Sebő, J. Vygen, Shorter tours by nicer ears, Combinatorica 34 (2014). arXiv:1201.1870
  • A. Karlin, N. Klein, S. Oveis Gharan, A (slightly) improved approximation algorithm for metric TSP, STOC 2021. arXiv:2007.01409
  • A. Karlin, N. Klein, S. Oveis Gharan, A (slightly) improved bound on the integrality gap of the subtour LP for TSP, FOCS 2022. arXiv:2105.10043
  • V. Traub, J. Vygen, Approximation Algorithms for Traveling Salesman Problems, Cambridge University Press, 2024. book page
23 thms1 active userReviewed
🏆Completed
CombinatoricsNumber Theory·Captain: ShouqiaoWang

Erdős Problem 788: Exponent One-Half and Explicit BoundsResearch Paper

Erdős Problem 788 asks how large a set can always be retained when prescribed distinct pair-sums are forbidden. This mission formalizes the repository’s strengthened version of Theorem 1.1: an explicit lower bound valid for every n≥3n\ge 3n≥3, an eventual quantitative upper bound, the conclusion f(n)=n1/2+o(1)f(n)=n^{1/2+o(1)}f(n)=n1/2+o(1), and the exact affirmative answer to the original upper-bound question.

6 thms1 active userReviewed
🏆Completed
Captain: intro_user0735

Schönhage's Bound: omega < 2.55Research Paper

Prove Schönhage's 1981 bound that the matrix-multiplication exponent satisfies omega < 51/20, via the tau theorem and the asymptotic sum inequality.

0 thms0 active usersReviewed
PreviousPage 19 of 19Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me