Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in
← Collections

The OR Formalization Drive

Help us formalize the operations research literature in Lean.

399 open missions

Missions

341–360 of 399
OpenCompletedAll
Algorithmic Game TheoryFunctional AnalysisOperations Research+1·Captain: mikedeng1

A Variational Inequality Formulation of the Dynamic Network User Equilibrium Problem I: Route-Departure Equilibria Are Exactly the Solutions of the Path-Integral Variational InequalityResearch Paper

Motivation

Commuters choose not only a route but also a departure time, trading travel delay against the penalty of arriving early or late. Static traffic assignment, in the tradition of Wardrop's user-equilibrium principle, ignores the time dimension; dynamic traffic assignment adds it, and its central modelling question is what "equilibrium" means when flows, delays and costs all vary over a time horizon. Friesz, Bernstein, Smith, Tobin and Wie (Oper. Res. 41(1), 1993) proposed the simultaneous route-departure (SRD) equilibrium of a path-based dynamic model and showed that it is equivalent to an infinite-dimensional variational inequality. That equivalence is the starting point of a large literature on dynamic user equilibrium: existence theory, solution algorithms and differential-variational formulations all take the variational inequality as their definition of the problem.

Timeline, as far as this mission is concerned:

  • 1952: Wardrop states the static user-equilibrium criterion (equal and minimal travel times on used routes).
  • 1979–1980: Smith and Dafermos formulate static user equilibrium as a finite-dimensional variational inequality.
  • 1989: Friesz, Luque, Tobin and Wie treat dynamic route choice with a fixed departure schedule as an optimal-control problem.
  • 1993: Friesz et al. (this paper) formulate simultaneous route and departure-time equilibrium and prove its equivalence with a variational inequality on (L2[0,T])∣P∣(L^2[0,T])^{|P|}(L2[0,T])∣P∣ (Theorem 2, p. 187).

Setting

A traffic network has a finite set PPP of paths. Each path ppp connects exactly one origin–destination (OD) pair klklkl; PklP_{kl}Pkl​ denotes the paths of pair klklkl. Travellers depart during the horizon [0,T][0,T][0,T], T>0T>0T>0, which carries Lebesgue measure ν\nuν; "∀ν(t)\forall_\nu(t)∀ν​(t)" means "for ν\nuν-almost every t∈[0,T]t\in[0,T]t∈[0,T]".

A vector of departure-time densities h=(hp)p∈Ph=(h_p)_{p\in P}h=(hp​)p∈P​ assigns to each path a square-integrable, almost everywhere nonnegative function hph_php​ on [0,T][0,T][0,T]: hp(t)h_p(t)hp​(t) is the rate at which travellers depart at time ttt on path ppp. The set of such vectors is H+H_+H+​. Each OD pair has a fixed travel demand QklQ_{kl}Qkl​, and the feasible set is

Λ={h∈H+:∑p∈Pkl∫0Thp(t) dν(t)=Qkl for every OD pair kl}.(38)\Lambda=\Big\{h\in H_+ : \sum_{p\in P_{kl}}\int_0^T h_p(t)\,d\nu(t)=Q_{kl}\ \text{for every OD pair } kl\Big\}.\qquad(38)Λ={h∈H+​:p∈Pkl​∑​∫0T​hp​(t)dν(t)=Qkl​ for every OD pair kl}.(38)

A cost operator gives the effective delay Cp(t,h)≥0C_p(t,h)\ge 0Cp​(t,h)≥0 of departing at time ttt on path ppp when the densities are hhh: travel time plus a penalty for early or late arrival (13). Because densities are defined only up to null sets, the relevant lowest achievable cost on a path is an essential infimum,

μp(h)=ess inf⁡{Cp(t,h):t∈[0,T]}=sup⁡{x∈R: ν{t:Cp(t,h)<x}=0},\mu_p(h)=\operatorname{ess\,inf}\{C_p(t,h):t\in[0,T]\}=\sup\{x\in\mathbb R:\ \nu\{t: C_p(t,h)<x\}=0\},μp​(h)=essinf{Cp​(t,h):t∈[0,T]}=sup{x∈R: ν{t:Cp​(t,h)<x}=0},

and the lowest achievable cost for pair klklkl is μkl(h)=min⁡p∈Pklμp(h)\mu_{kl}(h)=\min_{p\in P_{kl}}\mu_p(h)μkl​(h)=minp∈Pkl​​μp​(h).

Definition 3. For h∈Λh\in\Lambdah∈Λ and a nonnegative vector μ=(μkl)\mu=(\mu_{kl})μ=(μkl​), the pair (h,μ)(h,\mu)(h,μ) is an SRD equilibrium if for every OD pair klklkl and every p∈Pklp\in P_{kl}p∈Pkl​:

hp(t)>0 ⇒ Cp(t,h)=μkl∀ν(t),Cp(t,h)≥μkl∀ν(t).h_p(t)>0\ \Rightarrow\ C_p(t,h)=\mu_{kl}\quad\forall_\nu(t),\qquad C_p(t,h)\ge\mu_{kl}\quad\forall_\nu(t).hp​(t)>0 ⇒ Cp​(t,h)=μkl​∀ν​(t),Cp​(t,h)≥μkl​∀ν​(t).

No positive-measure set of travellers can lower its cost by switching route or departure time.

Formalization targets

Goal: Theorem 2 (PIE VIP)

For h∗h^*h∗ with nonnegative, square-integrable costs Cp(⋅,h∗)C_p(\cdot,h^*)Cp​(⋅,h∗):

(∃ μ∗: (h∗,μ∗) SRD equilibrium) ⟹ h∗∈Λ and ∑p∈P∫0TCp(t,h∗) [hp(t)−hp∗(t)] dν(t)≥0  ∀h∈Λ,(39)\big(\exists\,\mu^*:\ (h^*,\mu^*)\ \text{SRD equilibrium}\big)\ \Longrightarrow\ h^*\in\Lambda\ \text{and}\ \sum_{p\in P}\int_0^T C_p(t,h^*)\,[h_p(t)-h^*_p(t)]\,d\nu(t)\ge 0\ \ \forall h\in\Lambda,\qquad(39)(∃μ∗: (h∗,μ∗) SRD equilibrium) ⟹ h∗∈Λ and p∈P∑​∫0T​Cp​(t,h∗)[hp​(t)−hp∗​(t)]dν(t)≥0  ∀h∈Λ,(39)

and conversely, if h∗∈Λh^*\in\Lambdah∗∈Λ solves (39), then (h∗,μ(h∗))(h^*,\mu(h^*))(h∗,μ(h∗)) with μkl∗=μkl(h∗)\mu^*_{kl}=\mu_{kl}(h^*)μkl∗​=μkl​(h∗) is an SRD equilibrium. The formal goal states the two directions as two conjuncts; the second names the equilibrium cost vector explicitly, which is stronger than an equivalence with an existential μ∗\mu^*μ∗.

Milestones

  1. Lemma 2: a measurable function positive on a set of positive measure exceeds some ε0>0\varepsilon_0>0ε0​>0 on a set of positive measure.
  2. The pointwise inequality (42) at an equilibrium, and the necessity half of Theorem 2.
  3. Condition (17) holds by construction for μ∗=μ(h∗)\mu^*=\mu(h^*)μ∗=μ(h∗).
  4. The positive-measure sets (44)–(46) and (47) produced by a failure of (16).
  5. Feasibility (50) of the mass-shifted vector (48)–(49), the value bound (54), and the sufficiency half of Theorem 2.

Significance

The result. Theorem 2 converts an equilibrium defined by almost-everywhere complementarity conditions into a single variational inequality over a convex subset of a Hilbert space. This is what makes dynamic user equilibrium accessible to the general theory of variational inequalities: existence via monotonicity or compactness arguments, and projection-type algorithms in function space or after time discretization. The sufficiency half also identifies the equilibrium cost levels: they are the essential infima μkl(h∗)\mu_{kl}(h^*)μkl​(h∗), so the multiplier μ∗\mu^*μ∗ need not be found separately.

Formalizing it. The theorem is proved in the paper; no machine-checked version is known. A formal proof requires essential infima, the shifting of mass between paths on sets of prescribed measure (the paper cites Halmos, Proposition 41.2, for the nonatomicity of Lebesgue measure), and careful integrability bookkeeping. The development is a self-contained template for "complementarity conditions a.e. ⇔ variational inequality in L2L^2L2" arguments, which recur in continuous-time equilibrium models.

Difficulty

Necessity is routine once integrability is in place, though the paper's text asserts the per-path identity ∫0T[hp−hp∗] dν=0\int_0^T[h_p-h^*_p]\,d\nu=0∫0T​[hp​−hp∗​]dν=0, which is false; only the sum over PklP_{kl}Pkl​ vanishes, and that suffices. Sufficiency is the substantive half. The obvious approach, testing (39) against a perturbation that moves flow from an expensive to a cheap route, has to be carried out with sets rather than points: the costs are only defined almost everywhere, the minimal cost is an essential infimum that need not be attained at any time, and the perturbation must keep the demand constraints exact. This forces the choice of sets of exactly equal positive measure inside the positive-measure sets Sp(ε,δ)S_p(\varepsilon,\delta)Sp​(ε,δ) and Tq(ε)T_q(\varepsilon)Tq​(ε), a nonatomicity argument that a pointwise proof would miss.

Formalization scope

Densities are plain functions R→R\mathbb R\to\mathbb RR→R with a square-integrability condition with respect to ν=\nu=ν= Lebesgue measure restricted to [0,T][0,T][0,T], not L2L^2L2 equivalence classes; every pointwise condition is ν\nuν-almost everywhere, and values outside [0,T][0,T][0,T] are unconstrained. Paths and OD pairs are finite types, with a map sending each path to its OD pair. The essential infimum is the literal formula (12), a real supremum; it is not the pointwise infimum, which changes when CCC is altered on a null set and makes sufficiency false. μkl\mu_{kl}μkl​ is a real infimum over PklP_{kl}Pkl​; for a pair with no paths it is an unused default value.

The cost operator C is abstract, with the paper's measurability assumption strengthened to square-integrability so that every integral in (39) is a genuine Lebesgue integral. The network dynamics (3)–(11) that produce C in the paper are not formalized. Nonnegativity (the codomain R+\mathbb R_+R+​ of (13)) and square-integrability are assumed only at h∗h^*h∗, which makes the formal statements stronger than the paper's. Without integrability, Lean's integral of a non-integrable function is 000, so (39) could hold vacuously; the added hypothesis excludes that trivialization. The goal quantifies over every cost operator satisfying these hypotheses and never fixes one. In the milestones, the reduction from p=qp=qp=q to p≠qp\ne qp=q (p. 188) is taken as the hypothesis p≠qp\ne qp=q.

A complete development needs: properties of the real essential infimum (12) on a finite measure space; Lemma 2 (continuity of measure from below); the existence of measurable subsets of prescribed measure in Lebesgue measure (nonatomicity, available in Mathlib in some form); and integral bookkeeping for products of L2L^2L2 functions on a finite measure. The essential-infimum and mass-shift lemmas are reusable for other continuous-time equilibrium models. Proofs of any milestone, and cleaner restatements of the essential-infimum API, are welcome.

Selected references

  • T. L. Friesz, D. Bernstein, T. E. Smith, R. L. Tobin and B. W. Wie, A variational inequality formulation of the dynamic network user equilibrium problem, Operations Research 41(1):179–191, 1993. https://doi.org/10.1287/opre.41.1.179
  • J. G. Wardrop, Some theoretical aspects of road traffic research, Proceedings of the Institution of Civil Engineers 1(3):325–362, 1952. https://doi.org/10.1680/ipeds.1952.11259
  • M. J. Smith, The existence, uniqueness and stability of traffic equilibria, Transportation Research B 13(4):295–304, 1979. https://doi.org/10.1016/0191-2615(79)90022-5
  • S. Dafermos, Traffic equilibrium and variational inequalities, Transportation Science 14(1):42–54, 1980. https://doi.org/10.1287/trsc.14.1.42
  • T. L. Friesz, J. Luque, R. L. Tobin and B. W. Wie, Dynamic network traffic assignment considered as a continuous time optimal control problem, Operations Research 37(6):893–901, 1989. https://doi.org/10.1287/opre.37.6.893
  • P. R. Halmos, Measure Theory, Van Nostrand, 1950 (Proposition 41.2, nonatomicity of Lebesgue measure).
11 thms2 active usersReviewed
AnalysisOperations Research·Captain: mikedeng1

A Variational Inequality Formulation of the Dynamic Network User Equilibrium Problem II: Under Linear Arc Delay αx(t) + β the Arc Exit Time Is Strictly Increasing (FIFO Holds)Research Paper

Motivation

Dynamic traffic assignment models how commuters choose routes and departure times when travel times change over the day. In the model of Friesz, Bernstein, Smith, Tobin and Wie (Oper. Res. 41 (1993)), the time to traverse a path is built recursively from arc exit-time functions: a vehicle that enters an arc at time ttt leaves it at time τ(t)\tau(t)τ(t). The equilibrium conditions of that model refer to the inverses of these functions, so the model is only well defined when every arc exit-time function is invertible.

Invertibility has a direct traffic meaning. A strictly increasing exit time is the first-in-first-out (FIFO) property: a vehicle that enters later cannot leave earlier, so no overtaking occurs on the arc. Whether a given delay model respects FIFO was an active question in the early 1990s, because several delay functions used in practice violate it for some inflow patterns.

Timeline:

  • 1969. Vickrey's bottleneck model introduces deterministic queueing at a single bottleneck (Vickrey 1969).
  • 1986. Ben-Akiva and De Palma show (Trans. Sci. 20 (1986)), for uniform entry rates and deterministic queueing delays, that it is not possible to "arrive earlier by departing later".
  • 1993. Friesz et al. prove (Theorem 1, p. 185) that for every linear arc delay D=αx+βD = \alpha x + \betaD=αx+β the exit time is strictly increasing, extending the 1986 result to all continuous entry-rate patterns (remark, p. 186).

Setting

Consider one arc. Vehicles enter it at the entry rate u(t)≥0u(t) \ge 0u(t)≥0, a continuous function of time t≥0t \ge 0t≥0; the first vehicle enters at time 000. For an exit-time function τ\tauτ, the arc volume at time t≥0t \ge 0t≥0 is the inflow mass of the vehicles that entered during [0,t][0,t][0,t] and have not left by time ttt:

x(t)=∫{s∈[0,t] : τ(s)>t}u(s) ds.x(t) = \int_{\{s \in [0,t]\,:\,\tau(s) > t\}} u(s)\,ds .x(t)=∫{s∈[0,t]:τ(s)>t}​u(s)ds.

The linear delay function (18) of the paper is

D(t)=α x(t)+β,α,β>0,D(t) = \alpha\, x(t) + \beta, \qquad \alpha, \beta > 0,D(t)=αx(t)+β,α,β>0,

a fixed free-flow travel time β\betaβ plus a queueing time determined by the service rate 1/α1/\alpha1/α. The exit time is entry time plus delay, so τ\tauτ is pinned by the exit-time equation

τ(t)=t+α x(t)+β(t≥0).\tau(t) = t + \alpha\, x(t) + \beta \qquad (t \ge 0).τ(t)=t+αx(t)+β(t≥0).

The equation is implicit: τ\tauτ appears on the right through the volume. The proof partitions time at t0=0t_0 = 0t0​=0, tn+1=τ(tn)t_{n+1} = \tau(t_n)tn+1​=τ(tn​); in particular t1=τ(0)=βt_1 = \tau(0) = \betat1​=τ(0)=β is the exit time of the first vehicle. In Lean these objects are linearDelay, arcVolume, IsLinearExitTime and tSeq in FrieszDUE.FIFO.

Formalization targets

Goal: Theorem 1 (p. 185)

For α,β>0\alpha, \beta > 0α,β>0 and a nonnegative continuous entry rate uuu, every τ\tauτ satisfying the exit-time equation is strictly increasing on [0,∞)[0, \infty)[0,∞):

0≤s<t  ⟹  τ(s)<τ(t),0 \le s < t \implies \tau(s) < \tau(t),0≤s<t⟹τ(s)<τ(t),

and hence injective there, so τ−1\tau^{-1}τ−1 exists.

Milestones

  1. Lemma 1 (19): for a differentiable invertible fff, [f−1]′(z)=1/f′[f−1(z)][f^{-1}]'(z) = 1/f'[f^{-1}(z)][f−1]′(z)=1/f′[f−1(z)].
  2. First interval (21)–(24): t1=βt_1 = \betat1​=β; on [0,t1][0, t_1][0,t1​], x(t)=∫0tux(t) = \int_0^t ux(t)=∫0t​u, τ(t)=t+α∫0tu+β\tau(t) = t + \alpha\int_0^t u + \betaτ(t)=t+α∫0t​u+β, and τ′=1+αu>0\tau' = 1 + \alpha u > 0τ′=1+αu>0.
  3. Second interval (25)–(28): on [t1,t2][t_1, t_2][t1​,t2​], τ(t)=t+α∫τ−1(t)tu+β\tau(t) = t + \alpha\int_{\tau^{-1}(t)}^t u + \betaτ(t)=t+α∫τ−1(t)t​u+β and τ′(t)=αu(t)+1/(1+αu[τ−1(t)])>αu(t)\tau'(t) = \alpha u(t) + 1/(1 + \alpha u[\tau^{-1}(t)]) > \alpha u(t)τ′(t)=αu(t)+1/(1+αu[τ−1(t)])>αu(t).
  4. Induction (29)–(34): the same representation and τ′(t)>αu(t)\tau'(t) > \alpha u(t)τ′(t)>αu(t) on every [tn+1,tn+2][t_{n+1}, t_{n+2}][tn+1​,tn+2​], with τ\tauτ strictly increasing there.
  5. Covering: tn+1−tn≥βt_{n+1} - t_n \ge \betatn+1​−tn​≥β and R+=⋃n≥0[tn,tn+1]\mathbb R_+ = \bigcup_{n \ge 0}[t_n, t_{n+1}]R+​=⋃n≥0​[tn​,tn+1​].

A supporting, non-milestone item states that the exit-time equation has a solution for every admissible uuu.

Significance

The result makes the path exit-time functions of the dynamic network model invertible whenever the arc delays are linear in volume. That invertibility is what allows the path costs, and through them the variational inequality of Theorem 2 of the same paper, to be written down. In traffic terms it certifies that linear volume-based delays never let a later entrant overtake an earlier one, whatever the continuous inflow profile.

The theorem is proved in the paper. As far as is known it has no machine-checked proof. The mission produces one, together with a formal model of a single arc whose exit time is defined implicitly through the volume, which is reusable for other delay functions and for FIFO questions in dynamic traffic assignment.

Difficulty

The obvious argument differentiates τ(t)=t+αx(t)+β\tau(t) = t + \alpha x(t) + \betaτ(t)=t+αx(t)+β and bounds the outflow rate. But the volume can only be written as ∫τ−1(t)tu\int_{\tau^{-1}(t)}^t u∫τ−1(t)t​u once τ\tauτ is known to be invertible, which is the conclusion. The paper breaks the circularity by working forward in time: on [tn,tn+1][t_n, t_{n+1}][tn​,tn+1​] the volume depends only on τ\tauτ restricted to the earlier interval, whose invertibility is already established. A formal proof must make this forward dependence rigorous for an exit time given only by the implicit equation, handle one-sided derivatives at the junctions tnt_ntn​, where τ\tauτ is generally not differentiable, and show that the junctions do not accumulate.

Formalization scope

Time is real; the entry rate is a function u:R→Ru : \mathbb R \to \mathbb Ru:R→R with u(t)≥0u(t) \ge 0u(t)≥0 and uuu continuous on [0,∞)[0, \infty)[0,∞). Both are added hypotheses: Theorem 1 names none, nonnegativity is implicit in "entry rate", and the remark after the proof covers "all continuous entry rate patterns". Integrals are Lebesgue integrals. Monotonicity is claimed on [0,∞)[0,\infty)[0,∞) only, the entry times that the equation constrains. Derivative claims in the milestones are taken within the closed interval [tn,tn+1][t_n, t_{n+1}][tn​,tn+1​]. The paper's separate pieces τk\tau_kτk​ are one global function here, so the junction identities (27), (30), (33) are automatic. Lemma 1 adds the hypothesis f′[f−1(z)]≠0f'[f^{-1}(z)] \ne 0f′[f−1(z)]=0, without which it is false.

The exit time τ is pinned by the implicit equation τ(t) = t + αx(t) + β, where x(t) is the inflow mass of vehicles that entered by time t and have not exited by time t; no monotonicity or invertibility of τ is assumed. A formalization that defined the volume through τ−1\tau^{-1}τ−1 or assumed τ\tauτ monotone would assume the conclusion and is ruled out.

The development needs one-sided derivatives of parametric integrals, the inverse-function derivative on an interval, and a forward induction over the partition. Contributions of proofs for any milestone, of the existence item, and of a uniqueness result for the exit-time equation are welcome.

Selected references

  • T. L. Friesz, D. Bernstein, T. E. Smith, R. L. Tobin and B. W. Wie, A variational inequality formulation of the dynamic network user equilibrium problem, Operations Research 41(1):179–191, 1993. https://doi.org/10.1287/opre.41.1.179
  • M. Ben-Akiva and A. de Palma, Some circumstances in which vehicles will reach their destinations earlier by starting later: revisited, Transportation Science 20(1):52–55, 1986. https://doi.org/10.1287/trsc.20.1.52
  • M. Ben-Akiva, A. de Palma and P. Kanaroglou, Dynamic model of peak period traffic congestion with elastic arrival rates, Transportation Science 20(3):164–181, 1986. https://doi.org/10.1287/trsc.20.3.164
  • W. S. Vickrey, Congestion theory and transport investment, American Economic Review 59(2):251–261, 1969. https://www.jstor.org/stable/1823678
7 thms1 active userReviewed
CombinatoricsOperations ResearchOptimization·Captain: mikedeng1

One-Processor Scheduling with Symmetric Earliness and Tardiness Penalties 2: For a Fixed Task Order, the Block-Shifting Algorithm Minimizes the Total DiscrepancyResearch Paper

Motivation

A task may have a preferred execution time because a material delivery, external event, or downstream operation is timed to it. Starting early can be as costly as starting late. Garey, Tarjan, and Wilfong study this situation on one processor, where tasks cannot overlap but idle time between tasks is permitted. Their total-discrepancy problem is hard when the execution order is free; fixing the order leaves a substantial timing problem because each start can still move and can force changes to earlier starts. The paper gives an explicit scheduling procedure for that case and proves that it minimizes the sum of deviations from preferred starts (Garey, Tarjan, and Wilfong, 1988, §§1–2).

This mission targets that procedure and its correctness theorem. It also records the paper's equal-length result: when task lengths are identical, a minimum-cost schedule exists in preferred-start order, so the fixed-order procedure applies after sorting. These are two precise claims about total discrepancy, distinct from the paper's separate maximum-discrepancy problem.

Setting

There are nnn tasks, indexed i=0,…,n−1i=0,\ldots,n-1i=0,…,n−1. Task iii has a nonnegative length lil_ili​, a nonnegative preferred starting time aia_iai​, and an actual starting time sis_isi​. Once started, it occupies the one processor until si+lis_i+l_isi​+li​. Each start must be nonnegative. For the fixed-order problem, task iii must finish before task i+1i+1i+1 starts, so si+li≤si+1s_i+l_i\le s_{i+1}si​+li​≤si+1​. This permits idle time when the inequality is strict. The task's discrepancy is ∣si−ai∣|s_i-a_i|∣si​−ai​∣; because its preferred completion is ai+lia_i+l_iai​+li​, this is also its absolute completion-time discrepancy. The total discrepancy is

cost⁡n(s)=∑i=0n−1∣si−ai∣.\operatorname{cost}_n(s)=\sum_{i=0}^{n-1}|s_i-a_i|.costn​(s)=i=0∑n−1​∣si​−ai​∣.

A block is a maximal consecutive set of tasks with no idle time between neighboring tasks. Within a block, Decrease counts tasks whose actual starts are later than preferred, and Increase counts tasks whose actual starts are no later than preferred. These names describe the effect of moving the entire block earlier: the discrepancy of a Decrease task falls initially, whereas that of an Increase task rises. The algorithm's state is a schedule SnS_nSn​ for the first nnn tasks. It inserts the next task at its preferred start when the previous task has finished, and at that finish time otherwise. In the latter case it may move the final block earlier until one of the paper's stopping events occurs: the block reaches time zero, a late task reaches its preferred start, or the block meets its predecessor (§2.2, p. 337).

For the equal-length result, schedules may execute tasks in any order. Two distinct tasks are feasible together when one completes before the other starts; meeting at endpoints is allowed. The objective remains the same sum of absolute discrepancies.

Formalization targets

Fixed-order optimality

The main target is the paper's Theorem 2. For all nonnegative task data and every nnn, the actual schedule SnS_nSn​ produced by the block-shifting algorithm is feasible and satisfies

cost⁡n(Sn)≤cost⁡n(s)for every feasible fixed-order schedule s.\operatorname{cost}_n(S_n)\le\operatorname{cost}_n(s) \qquad\text{for every feasible fixed-order schedule }s.costn​(Sn​)≤costn​(s)for every feasible fixed-order schedule s.

This includes the empty schedule and schedules with idle time. The milestone list follows the paper's own assertions: a balanced final block can move earlier without changing cost; every block of SnS_nSn​ has more Increase tasks than Decrease tasks or begins at zero (Lemma 7); and the two claims in Case 2 of the proof record the cost of adding a late task and the comparison with schedules that place it earlier (Theorem 2 and Lemma 7, p. 338).

Equal-length schedules

The companion target is Theorem 3. If every task has a common length L≥0L\ge0L≥0 and the preferred starts are indexed so that ai≤ai+1a_i\le a_{i+1}ai​≤ai+1​, then among all feasible schedules, including those with another task order, at least one minimum-cost schedule starts the tasks in index order:

∃s  [cost⁡n(s)≤cost⁡n(t) for every feasible t]with si≤si+1 whenever i+1<n.\exists s\;\bigl[ \operatorname{cost}_n(s)\le\operatorname{cost}_n(t) \text{ for every feasible }t \bigr] \quad\text{with }s_i\le s_{i+1}\text{ whenever }i+1<n.∃s[costn​(s)≤costn​(t) for every feasible t]with si​≤si+1​ whenever i+1<n.

The paper uses this statement to connect free-order equal-length scheduling to its fixed-order procedure (Theorem 3, p. 340).

Significance

Theorem 2 certifies an explicit schedule, not just the existence of an optimum. It fixes the objective value for a prescribed execution order and gives a baseline against which any other legal timing of the same tasks can be compared. Theorem 3 supplies the ordering fact needed to use that result when all lengths agree. Together they explain why a problem that is difficult for unrestricted task lengths still has these structured solvable cases (Garey, Tarjan, and Wilfong, 1988, abstract and §2.5).

The paper proves both theorems on paper. The work here is to formalize its schedule construction, cost, block boundaries, and comparison classes in Lean, then obtain machine-checked proofs of the stated targets. The draft theorem declarations compile with proof placeholders; this proposal does not claim that they are already machine-checked results. A completed development would make the model and the algorithm available for later formal work on scheduling with idle time and symmetric earliness and tardiness penalties.

Difficulty

Moving a task closer to its preferred start can move neighboring tasks farther from theirs. A simple task-by-task choice therefore does not establish global optimality. Nor does a count of late and early tasks in one block, by itself, justify arbitrary earlier movements of individual tasks. The difficult comparison in the paper is between the algorithm's schedule and a competing feasible schedule whose new task starts earlier: the whole final block and its constrained relative movements matter. The proof also has to account for the boundary at time zero and for blocks that merge when shifted. These are the reasons the explicit procedure and its block invariant need careful statements (§§2.2–2.3, pp. 337–338).

Formalization scope

The Lean development represents task data and starts as functions from natural-number indices to real numbers; only indices below nnn count. Task iii in Lean is the paper's Ti+1T_{i+1}Ti+1​. Preferred times, lengths, and legal starting times are nonnegative. The start-time condition is a standing convention used by the paper's algorithm, especially its zero-boundary stopping rule. Fixed-order feasibility requires successive tasks to be separated by at least the earlier task's length; unrestricted feasibility uses pairwise nonoverlap. An empty schedule is legal and has cost zero. The representation allows zero-length tasks, as does the paper's li≥0l_i\ge0li​≥0 model.

The algorithm is defined by its stated insertion and single-block-shift operations. Defining SnS_nSn​ as a chosen minimizer would erase the content of Theorem 2; the goal also explicitly asserts feasibility so that an illegal low-cost function cannot qualify. Theorem 3 compares with every feasible unrestricted-order schedule, not just schedules already in preferred-start order. The core definitions, the block invariant, and the cost comparisons are useful beyond this particular proof. Formalizing the paper's running-time bounds and heap implementation is outside this mission.

Selected references

  • Michael R. Garey, Robert E. Tarjan, and Gordon T. Wilfong, One-Processor Scheduling with Symmetric Earliness and Tardiness Penalties, Mathematics of Operations Research 13(2), 330–348, 1988. DOI: 10.1287/moor.13.2.330.
6 thms1 active userReviewed
Graph TheoryOperations ResearchProbability·Captain: mikedeng1

Expected Critical Path Lengths in PERT Networks: With Bundle-Independent Arc Lengths, the Mean-Length Estimate g, Fulkerson's Recursion f and the Expected Critical Path Length e Satisfy g ≤ f ≤ eResearch Paper

Motivation

PERT (Program Evaluation and Review Technique) and the critical path method model a project as a directed acyclic network whose arcs are jobs and whose nodes are events; the duration of the project is the length of a longest path from the origin to the terminal. When job durations are random, the quantity a planner wants is the expected duration. Computing it exactly requires solving one longest-path problem for every joint outcome of the job durations: with mmm jobs each taking two values, 2m2^m2m deterministic problems. Classical PERT practice replaced every random duration by its mean and reported the longest path for the mean durations. That figure is known to be optimistically biased.

D. R. Fulkerson, Expected Critical Path Lengths in PERT Networks (RAND Memorandum RM-3075-PR, 1962; Operations Research 10(6):808–817, 1962, doi:10.1287/opre.10.6.808), proposed a second estimate, computed node by node with work exponential only in the size of a single node's bundle of incoming arcs, and proved that it lies between the classical mean-length figure and the true expectation.

Setting

A project network has events 0,1,…,n0,1,\dots,n0,1,…,n with n≥1n\ge1n≥1, origin 000 and terminal nnn. Its arcs are ordered pairs (i,j)(i,j)(i,j) with i<ji<ji<j, at most one per pair, and every event lies on a directed path from the origin to the terminal. Fulkerson numbers his nodes 1,…,n1,\dots,n1,…,n; his node iii is event i−1i-1i−1 here. The bundle BjB_jBj​ of an event jjj is the set of arcs entering jjj, and pred⁡(j)\operatorname{pred}(j)pred(j) the set of their tails; the origin's bundle is empty.

For arc lengths ttt, let ℓi(t)\ell_i(t)ℓi​(t) be the length of a longest (critical) path from the origin to iii; equivalently ℓ0=0\ell_0=0ℓ0​=0 and ℓj=max⁡i∈pred⁡(j)(ℓi+tij)\ell_j=\max_{i\in\operatorname{pred}(j)}(\ell_i+t_{ij})ℓj​=maxi∈pred(j)​(ℓi​+tij​).

The lengths of the arcs of each bundle BjB_jBj​ form a random vector with a finite distribution: a finite set SjS_jSj​ of bundle vectors vvv, where viv_ivi​ is the length of arc (i,j)(i,j)(i,j), with probabilities pj(v)≥0p_j(v)\ge 0pj​(v)≥0 summing to 111. Arcs within a bundle may be correlated; distinct bundles are independent, so an assignment ω=(ωj)j\omega=(\omega_j)_jω=(ωj​)j​ of one bundle vector per event has probability p(ω)=∏jpj(ωj)p(\omega)=\prod_j p_j(\omega_j)p(ω)=∏j​pj​(ωj​). Three numbers are attached to each event iii:

  1. the expected critical path length ei=∑ωp(ω) ℓi(t(ω))e_i=\sum_\omega p(\omega)\,\ell_i(t(\omega))ei​=∑ω​p(ω)ℓi​(t(ω));
  2. the mean-length estimate gi=ℓi(tˉ)g_i=\ell_i(\bar t)gi​=ℓi​(tˉ), where tˉij=∑v∈Sjpj(v) vi\bar t_{ij}=\sum_{v\in S_j}p_j(v)\,v_itˉij​=∑v∈Sj​​pj​(v)vi​ is the expected length of arc (i,j)(i,j)(i,j);
  3. Fulkerson's numbers f0=0f_0=0f0​=0 and, for j≠0j\neq0j=0,
fj=∑v∈Sjpj(v) max⁡i∈pred⁡(j)(fi+vi).f_j=\sum_{v\in S_j}p_j(v)\,\max_{i\in\operatorname{pred}(j)}\bigl(f_i+v_i\bigr).fj​=v∈Sj​∑​pj​(v)i∈pred(j)max​(fi​+vi​).

Formalization targets

Goal: (4.4)

gi  ≤  fi  ≤  eifor every event i.g_i\;\le\;f_i\;\le\;e_i\qquad\text{for every event } i .gi​≤fi​≤ei​for every event i.

Milestones

In the order of Fulkerson's induction (pp. 10–12):

  1. the recursion for ℓ\ellℓ computes the greatest path length (§3, (3.6), and the display on p. 11);
  2. ℓi(t)\ell_i(t)ℓi​(t) depends only on the arcs of the bundles B0,…,BiB_0,\dots,B_iB0​,…,Bi​ (p. 6);
  3. (4.8): max⁡i∈pred⁡(j)(fi+tˉij)≤fj\max_{i\in\operatorname{pred}(j)}(f_i+\bar t_{ij})\le f_jmaxi∈pred(j)​(fi​+tˉij​)≤fj​;
  4. (4.5)/(4.9): if gk≤fkg_k\le f_kgk​≤fk​ for all k<jk<jk<j, then gj≤fjg_j\le f_jgj​≤fj​;
  5. (4.13): ∑v∈Sjpj(v)max⁡i∈pred⁡(j)(ei+vi)≤ej\sum_{v\in S_j}p_j(v)\max_{i\in\operatorname{pred}(j)}(e_i+v_i)\le e_j∑v∈Sj​​pj​(v)maxi∈pred(j)​(ei​+vi​)≤ej​;
  6. (4.10)/(4.14): if fk≤ekf_k\le e_kfk​≤ek​ for all k<jk<jk<j, then fj≤ejf_j\le e_jfj​≤ej​.

Companion statements

  • gi≤eig_i\le e_igi​≤ei​ under an arbitrary joint distribution of all arc lengths (remark, p. 12).
  • Fig. 4.2: with correlated bundles, e3=g3=1e_3=g_3=1e3​=g3​=1 but f3=5/4f_3=5/4f3​=5/4, so (4.4) fails without bundle independence.
  • (4.17): an independent example with g3=f3=1<e3=5/4g_3=f_3=1<e_3=5/4g3​=f3​=1<e3​=5/4.
  • Fig. 4.1: explicit values g4=3/2g_4=3/2g4​=3/2, f2=1/2f_2=1/2f2​=1/2, f3=9/8f_3=9/8f3​=9/8, f4=55/32f_4=55/32f4​=55/32, and fi=eif_i=e_ifi​=ei​.

Significance

The chain (4.4) says that the classical PERT estimate ggg never overstates the expected project duration, and that the numbers fff are a lower bound at least as tight. The fff computation visits each node once and sums over the support of that node's bundle only, so its cost grows exponentially with bundle size rather than with network size, while the exact expectation eee requires the whole product space. The Fig. 4.2 example shows that the bundle-independence hypothesis cannot be dropped for the upper inequality, while the lower inequality g≤eg\le eg≤e survives arbitrary dependence.

The result has a complete published proof. This mission seeks a machine-checked proof of (4.4) for finite distributions, with the longest-path characterisation of the earliest-event-time recursion and the locality of critical path lengths as reusable lemmas, and machine-checkable versions of the paper's numerical examples, including the counterexample showing the role of independence.

Difficulty

The left inequality compares an average of maxima with a maximum of averages. The right inequality requires more: fjf_jfj​ averages over the bundle entering jjj, while eje_jej​ averages over assignments to every bundle. Taking expectations in ℓj=max⁡i(ℓi+tij)\ell_j=\max_i(\ell_i+t_{ij})ℓj​=maxi​(ℓi​+tij​) yields ej≥max⁡i(ei+tˉij)e_j\ge\max_i(e_i+\bar t_{ij})ej​≥maxi​(ei​+tˉij​), which gives the weaker bound g≤eg\le eg≤e. Fig. 4.2 shows that f≤ef\le ef≤e can fail when the bundles are dependent. In Lean, eee is a sum over a dependent product of finite supports (Fintype.piFinset); its interaction with the local recurrence for fff is the central technical difficulty.

Formalization scope

  • Network: the published CriticalPath.Events.ProjectNetwork (Kelley–Walker 1959): events Fin (n + 1), arcs a Finset of ordered pairs with strictly increasing labels, origin preceding and terminal following every event. This requires n≥1n\ge1n≥1. Fulkerson's numbering condition "i≤ji\le ji≤j" on p. 3 is read as the strict i<ji<ji<j (arcs join distinct nodes of an acyclic network). There is one arc per ordered pair, Fulkerson's own convention in (3.13).
  • Critical path length: the published CriticalPath.Events.earliest, a recursion with Finset.sup' over the nonempty set of incoming arcs. This is the paper's convention that terms of missing arcs are ignored. Nothing uses a default value of 000 or −∞-\infty−∞.
  • Distributions: finite, given as data (a support Finset and a weight function per bundle) plus a predicate IsProb (nonnegative weights on the support, summing to 111, for every event including the origin). Bundle vectors are functions on all events, and coordinates outside pred⁡(j)\operatorname{pred}(j)pred(j) are never read.
  • Arc lengths are arbitrary reals. §3 assumes nonnegative lengths, but its footnote on p. 4 states that nonnegativity "is not essential in this or the following section"; the statements are given in this more general form.
  • No trivialization: eie_iei​ is the sum over every assignment of bundle vectors, weighted by the product probability (3.5). It is not defined by a recursion, and the goal assumes none of the milestones. fff at node jjj uses only the distribution of the bundle of jjj.

Infrastructure that a full development needs, and that is reusable elsewhere, includes the longest-path characterisation of the earliest-event-time recursion, the locality lemma, and the factorisation of sums over Fintype.piFinset along one coordinate. Proofs of any milestone or companion are welcome. Out of scope here: §5 (computational examples) and the general-network analogues of §6.

Selected references

  • D. R. Fulkerson, Expected Critical Path Lengths in PERT Networks, RAND Memorandum RM-3075-PR, March 1962; published in Operations Research 10(6):808–817, 1962. doi:10.1287/opre.10.6.808
  • J. E. Kelley Jr. and M. R. Walker, Critical-Path Planning and Scheduling, Proceedings of the Eastern Joint Computer Conference, 1959, pp. 160–173. doi:10.1145/1460299.1460318
  • D. G. Malcolm, J. H. Roseboom, C. E. Clark and W. Fazar, Application of a Technique for Research and Development Program Evaluation, Operations Research 7(5):646–669, 1959. doi:10.1287/opre.7.5.646
11 thms1 active userReviewed
Graph TheoryLinear OptimizationOperations Research·Captain: mikedeng1

A Suggested Computation for Maximal Multi-Commodity Network Flows: With Nonnegative Simplex Multipliers, Shortest-Chain Labels Prove the Arc-Chain Basis Optimal or Find an Entering ChainResearch Paper

Motivation

The maximal multi-commodity flow problem asks how much total flow several commodities, each travelling from its own sources to its own sinks, can send through a network whose arcs have shared capacities. It arises in communication and transportation planning: Kalaba and Juncosa's 1956 study of communication networks (Management Science 3(1)) leads to linear programs of this form. For a single commodity the problem has a clean combinatorial theory: the max-flow min-cut theorem of Ford and Fulkerson (1956, doi:10.4153/CJM-1956-045-5) and the labeling algorithm. With several commodities both fail: the min-cut equality is false, and simplex bases are no longer triangular.

In a short note received in October 1957 and published in Management Science in 1958, L. R. Ford Jr. and D. R. Fulkerson proposed a way to solve the multi-commodity problem with the simplex method anyway (doi:10.1287/mnsc.1040.0269, reprinted 2004). They use the arc-chain formulation, which has one variable per chain from a source to a sink of a commodity. That formulation has far too many variables to write down. The note's point is that the simplex method never needs them explicitly. The "pricing" step (finding a variable to enter the basis, or recognizing that none exists) can be carried out by one shortest-chain computation per commodity, with the simplex multipliers as arc lengths.

Timeline. Ford (1956, RAND P-923) gave the label-correcting shortest-chain procedure the note uses. Ford and Fulkerson (1958) applied it to price the columns of the arc-chain program. Dantzig and Wolfe (1960) generalized the idea into the decomposition principle. Gilmore and Gomory (1961) applied the same pattern to the cutting-stock problem, and it is now called column generation.

Setting

A network has finitely many nodes P1,…,PNP_1,\dots,P_NP1​,…,PN​ and arcs A1,…,AmA_1,\dots,A_mA1​,…,Am​. Each arc ArA_rAr​ joins two nodes, has a capacity brb_rbr​, and is either directed (traversable one way only) or undirected (traversable both ways). There are finitely many commodities; commodity kkk has a set of sources SkS_kSk​ and a set of sinks TkT_kTk​.

A chain from uuu to www is the arc set of a path u=v0,v1,…,vp=wu = v_0, v_1, \dots, v_p = wu=v0​,v1​,…,vp​=w with distinct nodes, each arc traversable from vi−1v_{i-1}vi−1​ to viv_ivi​. A commodity chain of kkk is a chain from a node of SkS_kSk​ to a node of TkT_kTk​. List the commodity chains, for all commodities, as C1,…,CnC_1,\dots,C_nC1​,…,Cn​, and let A=(ars)A = (a_{rs})A=(ars​) be the incidence matrix: ars=1a_{rs} = 1ars​=1 if CsC_sCs​ contains ArA_rAr​ and 000 otherwise. With xsx_sxs​ the flow along CsC_sCs​ and xn+rx_{n+r}xn+r​ the slack of arc ArA_rAr​, the problem is the linear program

maximize ∑s=1nxssubject to∑s=1narsxs+xn+r=br,x1,…,xn+m≥0.(2–3)\text{maximize } \sum_{s=1}^{n} x_s \quad\text{subject to}\quad \sum_{s=1}^{n} a_{rs}x_s + x_{n+r} = b_r,\qquad x_1,\dots,x_{n+m} \ge 0. \tag{2–3}maximize s=1∑n​xs​subject tos=1∑n​ars​xs​+xn+r​=br​,x1​,…,xn+m​≥0.(2–3)

A basis is a set of mmm columns of [A∣I][A \mid I][A∣I] forming an invertible matrix B=(brj)B = (b_{rj})B=(brj​). Its simplex multipliers α1,…,αm\alpha_1,\dots,\alpha_mα1​,…,αm​ satisfy, for every basic column jjj,

∑r=1mαrbrj={1j≤n,0j>n.(4)\sum_{r=1}^{m} \alpha_r b_{rj} = \begin{cases} 1 & j \le n,\\ 0 & j > n.\end{cases} \tag{4}r=1∑m​αr​brj​={10​j≤n,j>n.​(4)

Read as arc lengths, the αr\alpha_rαr​ give each chain CsC_sCs​ the length ∑rαrars\sum_r \alpha_r a_{rs}∑r​αr​ars​. The labeling process for a source set SSS starts with labels πi=0\pi_i = 0πi​=0 on SSS and πi=∞\pi_i = \inftyπi​=∞ elsewhere. It repeatedly finds an arc traversable from PiP_iPi​ to PjP_jPj​ with πi+lij<πj\pi_i + l_{ij} < \pi_jπi​+lij​<πj​ and replaces πj\pi_jπj​ by πi+lij\pi_i + l_{ij}πi​+lij​. In Lean the labels are lab : V → WithTop ℝ, the multipliers are α : E → ℝ, and all objects live in the namespace FordFulkerson58.ArcChain.

Formalization targets

Goal: the shortest-chain pricing test (§3, pp. 1779–1780)

Let BBB be a basis with basic feasible solution zzz and multipliers α≥0\alpha \ge 0α≥0. Then:

(a) for every commodity, every run of the labeling process with lengths α is finite;(b) if all final sink labels are ≥1, then ∑sxs≤∑szs for every feasible x;(c) if a final sink label πt<1, some non-basic chain column to t has length πt and 1−∑rαrars>0.\begin{aligned} &\text{(a) for every commodity, every run of the labeling process with lengths } \alpha \text{ is finite;}\\ &\text{(b) if all final sink labels are } \ge 1, \text{ then } \textstyle\sum_s x_s \le \sum_s z_s \text{ for every feasible } x;\\ &\text{(c) if a final sink label } \pi_t < 1, \text{ some non-basic chain column to } t \text{ has length } \pi_t \text{ and } 1 - \textstyle\sum_r \alpha_r a_{rs} > 0. \end{aligned}​(a) for every commodity, every run of the labeling process with lengths α is finite;(b) if all final sink labels are ≥1, then ∑s​xs​≤∑s​zs​ for every feasible x;(c) if a final sink label πt​<1, some non-basic chain column to t has length πt​ and 1−∑r​αr​ars​>0.​

Milestones (§3, the labeling process and the test)

  1. Termination of the labeling process for non-negative lengths (p. 1780).
  2. Final labels are shortest-chain lengths from SSS; the smallest label on TTT is the SSS-to-TTT distance (p. 1780).
  3. The trace-back: a chain of tight arcs from SSS to every labeled node, of length its label (p. 1780).
  4. If α≥0\alpha \ge 0α≥0 and every commodity chain has length ≥1\ge 1≥1, the basis is optimal (p. 1779).

Further items state the remarks of §3–§4: a negative multiplier lets a slack enter; the slack basis is a feasible start; dominated chains can be ignored; limited supplies reduce to the same problem by adding new directed source arcs; Figure 2 is the incidence matrix of Figure 1; with negative lengths the labeling process may not terminate.

Significance

The result. The test turns a linear program with exponentially many columns into one whose pricing step costs one shortest-path computation per commodity. Only the m×mm \times mm×m basis is ever stored. This is the first instance of column generation, which now underlies solvers for multi-commodity flow, cutting stock, vehicle routing, crew scheduling and many other set-partitioning models, typically inside branch-and-price. Part (a) together with milestones 2–3 also gives the correctness of Ford's label-correcting algorithm with non-negative lengths, started from a source set and with any order of arc scans.

Formalizing it. The results are classical and proved in the paper's informal style. None of them is formalized: the platform has no arc-chain LP, no column pricing, and no formal statement of Ford's label-correcting process. The general LP facts are on the platform (the simplex optimality criterion and weak duality, both proved) and are included as references. This mission adds the network-specific layer: chains as arc sets of simple paths, the labeling process as a relation on labelings, and the link from final labels to reduced costs. One sentence of the paper is corrected. The trace-back "eventually" reaches SSS only along some backward path, because zero-length cycles can trap a naive backward search, and milestone 3 states the true version.

Difficulty

The obvious argument for termination says each step lowers a label and there are finitely many chains. It fails: labels are lengths of walks, not chains, and with zero-length arcs (multipliers are often 000) there are infinitely many walks. Termination needs the finiteness of the set of walk lengths below a bound, not positivity. The correctness of the final labels needs both properties of the labeling: it is produced by the process (so every label is the length of a walk from SSS), and it is terminal. A terminal labeling alone, such as all labels 000, is not a distance labeling. Finally, the optimality claim is an LP statement about the full, never-enumerated column set. It must be derived from (4), α≥0\alpha \ge 0α≥0 and the shortest-chain lengths, with the chain columns indexed abstractly.

Formalization scope

Nodes, arcs and commodities are finite types V, E, ι. Each arc has tail, head, a per-arc directed flag and a capacity b : E → ℝ; commodities have src snk : ι → Finset V. Parallel arcs and mixed directed/undirected networks are allowed. No sign of the capacities and no disjointness of sources and sinks is assumed, except 0 ≤ b in the zero-flow item, where it is disclosed. Chains are arc sets of simple paths. The null chain at a source is a chain, so sources have distance 000. Columns are pairs (commodity, chain), so one arc set used by two commodities gives two columns. The columns of [A∣I][A \mid I][A∣I] are indexed by Col N ⊕ E. A basis is β : E → Col N ⊕ E with IsUnit (basisMatrix N β).det; its basic feasible solution and multipliers (4) are hypotheses about this β. Labels are in WithTop ℝ with ⊤ for ∞\infty∞. Shortest-chain lengths are finite infima (Finset.inf), equal to ⊤ when there is no chain. The process scans arcs, not node pairs, which handles parallel arcs and the undirected case lij=ljil_{ij} = l_{ji}lij​=lji​.

The standing assumption of §3 ("a stage has been reached in the computation where all αr\alpha_rαr​ are non-negative", p. 1779) is a hypothesis of the goal and of milestones 1–4. Milestones 1–3 are stated for any non-negative length function. The paper has no numbered theorems; every milestone is an unnumbered sentence of §3, cited by page and position.

A trivializing formalization is ruled out: the goal does not assume shortest-chain lengths, the trace-back, or any reduced-cost fact beyond (4). Statements about final labels require labelings that are both reachable from the initial labels and terminal, and part (a) shows such labelings exist.

Reusable beyond this mission: the chain and labeling layer (a label-correcting shortest-path algorithm from a source set over mixed networks) and the arc-chain LP. Contributions to the LP layer, which can import the referenced Matoušek–Gärtner results after reindexing, are particularly welcome.

Selected references

  • L. R. Ford Jr., D. R. Fulkerson, A suggested computation for maximal multi-commodity network flows, Management Science 5(1):97–101, 1958; reprinted Management Science 50(12S):1778–1780, 2004. https://doi.org/10.1287/mnsc.1040.0269
  • L. R. Ford Jr., D. R. Fulkerson, Maximal flow through a network, Canadian Journal of Mathematics 8:399–404, 1956. https://doi.org/10.4153/CJM-1956-045-5
  • L. R. Ford Jr., Network Flow Theory, RAND Corporation Paper P-923, 1956. https://www.rand.org/pubs/papers/P923.html
  • G. B. Dantzig, P. Wolfe, Decomposition principle for linear programs, Operations Research 8(1):101–111, 1960. https://doi.org/10.1287/opre.8.1.101
  • P. C. Gilmore, R. E. Gomory, A linear programming approach to the cutting-stock problem, Operations Research 9(6):849–859, 1961. https://doi.org/10.1287/opre.9.6.849
  • J. Matoušek, B. Gärtner, Understanding and Using Linear Programming, Springer, 2007. https://doi.org/10.1007/978-3-540-30717-4
12 thms2 active usersReviewed
CombinatoricsOperations ResearchTheoretical Computer Science·Captain: mikedeng1

One-Processor Scheduling with Symmetric Earliness and Tardiness Penalties 1: Minimizing the Total Discrepancy from Preferred Times Is NP-CompleteResearch Paper

Motivation

Scheduling with earliness and tardiness penalties asks for schedules in which a job finishing early is as undesirable as a job finishing late. The model fits production planned for just-in-time delivery, where finished goods held before their due date cost money, and sequences of experiments tied to fixed external events. It departs from classical scheduling, in which finishing early is never penalized.

Garey, Tarjan and Wilfong (Math. Oper. Res. 13 (1988) 330–348) study the symmetric version on one processor: each task has a preferred starting time, and the penalty is the absolute deviation from it. Their §2.1 settles the complexity of the most natural objective, the sum of these deviations, by proving it NP-complete. The result explains why the rest of their paper, and much of the later literature, turns to special cases that can be solved efficiently: a fixed task order, equal task lengths, or the maximum deviation instead of the sum.

A short history of the model:

  • Kanet (1981) minimized total absolute deviation from a common due date that is large enough not to constrain the schedule, by a sorting rule. The special case in the middle of §2.1 is the midtime version of this problem.
  • Garey, Tarjan and Wilfong (1988) proved the problem with arbitrary preferred times NP-complete (THEOREM 1, this mission), and gave an O(Nlog⁡N)O(N\log N)O(NlogN) algorithm for a fixed task order.
  • Hall, Kubiak and Sethi (1991) proved that the common-due-date problem becomes NP-hard when the due date is restrictive. The reduction of THEOREM 1 already uses a common preferred midtime that is not large, together with one extra task that pins the right end.

Setting

There are NNN tasks T1,…,TNT_1,\dots,T_NT1​,…,TN​. Task TiT_iTi​ has a length lil_ili​ and a preferred midtime MiM_iMi​. A schedule SSS assigns every task a starting time si≥0s_i\ge0si​≥0 such that no two tasks overlap on the single processor: for i≠ji\ne ji=j, either si+li≤sjs_i+l_i\le s_jsi​+li​≤sj​ or sj+lj≤sis_j+l_j\le s_isj​+lj​≤si​. Idle time is allowed. The actual midtime of TiT_iTi​ is mi(S)=si+li/2m_i(S)=s_i+l_i/2mi​(S)=si​+li​/2, and the total discrepancy of SSS is

cost(S)=∑i=1N∣mi(S)−Mi∣.\mathrm{cost}(S)=\sum_{i=1}^N |m_i(S)-M_i| .cost(S)=i=1∑N​∣mi​(S)−Mi​∣.

The paper works with midtimes because the special case below is then symmetric. Preferred midtimes and preferred starting times aia_iai​ are interchangeable through ai=Mi−li/2a_i=M_i-l_i/2ai​=Mi​−li​/2.

Total discrepancy (the decision problem). Given N,k∈Z+N,k\in\mathbb Z^+N,k∈Z+ and Mi,li∈Z+M_i,l_i\in\mathbb Z^+Mi​,li​∈Z+, is there a schedule with cost(S)≤k\mathrm{cost}(S)\le kcost(S)≤k?

Even-odd partition. Given positive integers x1<x2<⋯<x2nx_1<x_2<\dots<x_{2n}x1​<x2​<⋯<x2n​, can they be split into two sets of equal sum so that each set contains exactly one of x2i−1,x2ix_{2i-1},x_{2i}x2i−1​,x2i​ for every iii?

The special case. For tasks T0,…,T2nT_0,\dots,T_{2n}T0​,…,T2n​ with 0<l0<l1<⋯<l2n0<l_0<l_1<\dots<l_{2n}0<l0​<l1​<⋯<l2n​ and one common preferred midtime M>∑iliM>\sum_i l_iM>∑i​li​, write A(S)={Ti:mi(S)<M}A(S)=\{T_i: m_i(S)<M\}A(S)={Ti​:mi​(S)<M} and B(S)={Ti:mi(S)>M}B(S)=\{T_i:m_i(S)>M\}B(S)={Ti​:mi​(S)>M}. A schedule is ordered if, on each side of MMM, shorter tasks lie nearer to MMM. The bracket [An,…,A1,T0@M,B1,…,Bn][A_n,\dots,A_1,T_0@M,B_1,\dots,B_n][An​,…,A1​,T0​@M,B1​,…,Bn​] is the schedule that puts T0T_0T0​ at midtime MMM and packs the listed tasks against it in the listed order.

Formalization targets

Goal: THEOREM 1

Partition is NP-complete ⟹ Total discrepancy is NP-complete.\text{Partition is NP-complete}\ \Longrightarrow\ \text{Total discrepancy is NP-complete.}Partition is NP-complete ⟹ Total discrepancy is NP-complete.

The hypothesis is the one result the paper imports (Garey and Johnson, 1979). The conclusion includes membership in NP and polynomial-time many-one reductions from every NP language, with Turing machines as the model of computation.

Milestones, in attack order

  1. Even-odd partition is in NP; the instance x1=1x_1=1x1​=1, x2i=x2i−1+yix_{2i}=x_{2i-1}+y_ix2i​=x2i−1​+yi​, x2i+1=x2i+1x_{2i+1}=x_{2i}+1x2i+1​=x2i​+1 built from a Partition instance YYY is a yes-instance if and only if YYY is; and LEMMA 1, even-odd partition is NP-complete.
  2. The special case: a minimum cost schedule has no gaps and is ordered; LEMMA 2 (some mi(S)=Mm_i(S)=Mmi​(S)=M), LEMMA 3 (∣A(S)∣=∣B(S)∣|A(S)|=|B(S)|∣A(S)∣=∣B(S)∣), LEMMA 4 (m0(S)=Mm_0(S)=Mm0​(S)=M), LEMMA 5 (swapping AiA_iAi​ and BiB_iBi​ in a bracket keeps the cost), LEMMA 6 ({Ai,Bi}={T2i,T2i−1}\{A_i,B_i\}=\{T_{2i},T_{2i-1}\}{Ai​,Bi​}={T2i​,T2i−1​} in a minimum cost bracket), and the minimum cost
k=∑i=1n(l2i+l2i−1)(n−i+12)+l0 n.k=\sum_{i=1}^n(l_{2i}+l_{2i-1})\left(n-i+\tfrac12\right)+l_0\,n .k=i=1∑n​(l2i​+l2i−1​)(n−i+21​)+l0​n.
  1. At the midtime M=12∑i=02nliM=\frac12\sum_{i=0}^{2n}l_iM=21​∑i=02n​li​ used in the reduction, every schedule of T0,…,T2nT_0,\dots,T_{2n}T0​,…,T2n​ costs at least kkk; equality forces the ordered, gap-free form in item 2.
  2. The reduction: the instance D with l0=x1−1l_0=x_1-1l0​=x1​−1, li=xil_i=x_ili​=xi​, l2n+1=2l_{2n+1}=2l2n+1​=2, Mj=M=∑i≤2nli/2M_j=M=\sum_{i\le 2n}l_i/2Mj​=M=∑i≤2n​li​/2, M2n+1=2M+1M_{2n+1}=2M+1M2n+1​=2M+1 has a schedule of cost at most kkk if and only if XXX has an even-odd partition. Total discrepancy is in NP.

Significance

THEOREM 1 is the hardness boundary for one-processor scheduling with symmetric earliness–tardiness penalties and arbitrary preferred times. It is the reason exact algorithms for this objective are enumerative, and the reason polynomial results are sought under extra structure, such as the fixed-order algorithm of the same paper. The special-case lemmas characterize every optimal schedule for a common, unrestrictive midtime, not just one of them: shortest task centered at MMM, the iii-th pair of lengths in the iii-th positions on either side, either member on either side. This characterization holds independently of the reduction.

The result has been proved since 1988, and no machine-checked version of it is known to us. A formalization adds three things. First, the parts the paper calls "straightforward" or "a simple exercise", membership of both problems in NP. Second, the two places where the published argument is imprecise. The instance D has half-integer midtimes and threshold although the decision problem asks for integers, so a correct reduction must rescale. And the special-case lemmas are proved for a large midtime but applied with M=∑ili/2M=\sum_i l_i/2M=∑i​li​/2, so they must be restated for every MMM. Third, a reusable formal treatment of absolute-deviation scheduling objectives and of reductions between number problems written in binary.

Difficulty

The obvious argument fails at the step from the special case to the instance D. The lemmas on pp. 333–336 assume the common midtime is large, so that the constraint si≥0s_i\ge0si​≥0 never binds. In D the midtime is M=∑i=02nli/2M=\sum_{i=0}^{2n}l_i/2M=∑i=02n​li​/2, exactly half the total length, and the reduction works because the constraint binds. The tasks before MMM must fit in [0,M−l0/2][0,M-l_0/2][0,M−l0​/2], and the extra task T2n+1T_{2n+1}T2n+1​ must sit at [2M,2M+2][2M,2M+2][2M,2M+2]. Together these force the two sides to have equal total length. A proof that only cites the large-MMM lemmas proves nothing about D. Conversely, dropping si≥0s_i\ge 0si​≥0 makes the reduction false: put the shorter element of every pair after MMM.

The other obstacle is the complexity bookkeeping. NP-completeness here means Turing machines, binary codes, and polynomial bounds, and a full proof must compute D from the code of XXX, double the times to clear the half-integers, and certify membership in NP for a problem whose schedules have real starting times. The certificate cannot be the real starting times themselves.

Formalization scope

  • Everything is real-valued except the instance codes. Schedules have real starting times si≥0s_i\ge0si​≥0, and integer data are cast to R\mathbb RR. Restricting to integer starting times would be a different problem and is not what is stated.
  • Nonnegative starting times are a standing assumption. The paper uses them ("scheduled between 0 and M−l0/2M-l_0/2M−l0​/2", p. 336) without writing them into the model. Nonoverlap is "one task finishes before the other starts", the reading of "intersect only at their endpoints".
  • Tasks are indexed by Fin N from 000. In the special case TiT_iTi​ is index iii, and the paper's T2i−1,T2iT_{2i-1},T_{2i}T2i−1​,T2i​ (1≤i≤n1\le i\le n1≤i≤n) are the indices 2k+1,2k+22k+1,2k+22k+1,2k+2 for k=i−1k=i-1k=i−1.
  • Languages use the published CookPvsNP_defs (Cook's one-tape Turing machines, NP, NPComplete) and the published ProjSchedTW.Complexity.Encoding (four-letter alphabet and binary codes). This mission defines positivePartitionLang by restricting the imported equal-sum predicate to nonempty lists of positive integers, as on p. 333. Only codes of well-formed instances belong to the even-odd and total discrepancy languages.
  • The goal is not the combinatorial equivalence of milestone 4. It states NP-completeness, so it contains the polynomial-time computation of the reduction and membership in NP. Taking NPComplete evenOddLang as the hypothesis instead would drop LEMMA 1 and is not what is asked.
  • Running times of the algorithms of §2.2–§2.4 are out of scope for this mission, as are all results after §2.1.

Contributions welcome: proofs of any milestone, and reusable lemmas on Turing-machine computability of arithmetic on binary codes, which the two membership results and both reductions need.

Selected references

  • M. R. Garey, R. E. Tarjan, G. T. Wilfong, One-Processor Scheduling with Symmetric Earliness and Tardiness Penalties, Mathematics of Operations Research 13(2):330–348, 1988. https://doi.org/10.1287/moor.13.2.330
  • M. R. Garey, D. S. Johnson, Computers and Intractability: A Guide to the Theory of NP-Completeness, W. H. Freeman, 1979.
  • J. J. Kanet, Minimizing the average deviation of job completion times about a common due date, Naval Research Logistics Quarterly 28(4):643–651, 1981. https://doi.org/10.1002/nav.3800280411
  • N. G. Hall, W. Kubiak, S. P. Sethi, Earliness–tardiness scheduling problems, II: Deviation of completion times about a restrictive common due date, Operations Research 39(5):847–856, 1991. https://doi.org/10.1287/opre.39.5.847
  • S. Cook, The P versus NP problem, Clay Mathematics Institute Millennium Problems, 2000. https://www.claymath.org/wp-content/uploads/2022/06/pvsnp.pdf
19 thms2 active usersReviewed
Algorithmic Game TheoryConvex OptimizationOperations Research+1·Captain: mikedeng1

Cooperative Fuzzy Games 1: A Balanced Game without Side Payments Has a Nonempty Core Containing the Core of Its Fuzzy ExtensionResearch Paper

Motivation

A game without side payments (an NTU game) describes cooperation in which utility cannot be transferred between players: each coalition AAA of players is assigned the set V(A)V(A)V(A) of payoff vectors it can secure on its own. The core is the set of payoffs to the grand coalition that no coalition can improve upon. Whether the core is nonempty is the basic stability question of cooperative game theory. For games with side payments the answer is the Bondareva–Shapley theorem. For NTU games it is Scarf's theorem (Scarf 1967): a balanced game has a nonempty core. Billera (1970) gave a convex version, in which the payoff sets are convex and balancedness is stated with weighted Minkowski sums.

Aubin's paper (Aubin 1981) obtains Billera's version of the theorem by a different route. Players may join coalitions at fractional rates of participation, and the paper first proves a core existence theorem for these fuzzy games. The game on ordinary coalitions is then embedded into a fuzzy game whose core lies inside the core of the original game.

Setting

The players are N={1,…,n}N = \{1,\dots,n\}N={1,…,n}. A coalition A⊆NA \subseteq NA⊆N is identified with its characteristic vector τA∈{0,1}n\tau^A \in \{0,1\}^nτA∈{0,1}n, and τN=(1,…,1)\tau^N = (1,\dots,1)τN=(1,…,1). A fuzzy coalition is a vector τ∈[0,1]n\tau \in [0,1]^nτ∈[0,1]n of participation rates with support Aτ={i:τi>0}A_\tau = \{i : \tau_i > 0\}Aτ​={i:τi​>0}. Write (τ⋅c)i=τici(\tau\cdot c)_i = \tau_i c_i(τ⋅c)i​=τi​ci​, Rτ=τ⋅Rn\mathbb{R}^\tau = \tau\cdot\mathbb{R}^nRτ=τ⋅Rn for the vectors vanishing off AτA_\tauAτ​, R+τ\mathbb{R}^\tau_+R+τ​ for its nonnegative part, and R˚+τ\mathring{\mathbb{R}}^\tau_+R˚+τ​ for the vectors strictly positive on AτA_\tauAτ​.

A fuzzy game without side payments assigns to each τ≥0\tau \ge 0τ≥0 a nonempty, closed, convex set V(τ)⊆RτV(\tau)\subseteq\mathbb{R}^\tauV(τ)⊆Rτ. Each V(τ)V(\tau)V(τ) is comprehensive, meaning V(τ)=V(τ)−R+τV(\tau) = V(\tau)-\mathbb{R}^\tau_+V(τ)=V(τ)−R+τ​, and bounded above, meaning V(τ)⊆C−R+τV(\tau)\subseteq C-\mathbb{R}^\tau_+V(τ)⊆C−R+τ​ for some CCC. The map is positively homogeneous: V(tτ)=tV(τ)V(t\tau) = tV(\tau)V(tτ)=tV(τ) for every t>0t>0t>0. Its core is the set of c∈V(τN)c\in V(\tau^N)c∈V(τN) such that τ⋅c∉V(τ)−R˚+τ\tau\cdot c\notin V(\tau)-\mathring{\mathbb{R}}^\tau_+τ⋅c∈/V(τ)−R˚+τ​ for every fuzzy coalition τ≠0\tau\neq 0τ=0. With the support function v(τ,λ)=sup⁡c∈V(τ)∑iλiciv(\tau,\lambda)=\sup_{c\in V(\tau)}\sum_i\lambda_i c_iv(τ,λ)=supc∈V(τ)​∑i​λi​ci​ and the simplex MnM^nMn, a weak (resp. strong) canonical cooperative equilibrium is a c∈V(τN)c\in V(\tau^N)c∈V(τN) together with a λˉ∈Mn\bar\lambda\in M^nλˉ∈Mn (resp. λˉ\bar\lambdaλˉ with all coordinates positive) satisfying ∑iλˉiτici≥v(τ,λˉ)\sum_i\bar\lambda^i\tau_ic_i\ge v(\tau,\bar\lambda)∑i​λˉiτi​ci​≥v(τ,λˉ) for every τ∈[0,1]n\tau\in[0,1]^nτ∈[0,1]n.

A usual NTU game lives on a family C\mathcal{C}C of coalitions that contains NNN and every singleton. For each A∈CA\in\mathcal{C}A∈C, the set V(A)⊆RAV(A)\subseteq\mathbb{R}^AV(A)⊆RA is nonempty, closed, convex, comprehensive and bounded above. A balance of τ\tauτ is a vector of weights m≥0m\ge 0m≥0 on C\mathcal{C}C with ∑A∋im(A)=τi\sum_{A\ni i}m(A)=\tau_i∑A∋i​m(A)=τi​ for every iii, and C(τ)\mathcal{C}(\tau)C(τ) is the set of balances of τ\tauτ. The fuzzy extension of the game is

πV(τ)=⋃m∈C(τ) ∑A∈Cm(A) V(A),\pi V(\tau)=\bigcup_{m\in\mathcal{C}(\tau)}\ \sum_{A\in\mathcal{C}} m(A)\,V(A),πV(τ)=m∈C(τ)⋃​ A∈C∑​m(A)V(A),

and the game is balanced if V(N)=πV(τN)V(N)=\pi V(\tau^N)V(N)=πV(τN).

Formalization targets

Goal: Theorem 7.1

For a balanced game without side payments,

∅≠core⁡(πV)⊆core⁡(V),CCEstrong(V)⊆core⁡(πV)⊆CCEweak(V),\emptyset\neq\operatorname{core}(\pi V)\subseteq\operatorname{core}(V),\qquad \mathrm{CCE}_{\rm strong}(V)\subseteq\operatorname{core}(\pi V)\subseteq\mathrm{CCE}_{\rm weak}(V),∅=core(πV)⊆core(V),CCEstrong​(V)⊆core(πV)⊆CCEweak​(V),

and in particular core⁡(V)≠∅\operatorname{core}(V)\neq\emptysetcore(V)=∅.

Milestones

  • Proposition 3.1: c∈V(τN)c\in V(\tau^N)c∈V(τN) is in the core iff the maximum complaint α(c)=sup⁡τ≠0inf⁡λ∈Mτ[v(τ,λ)−∑iλiτici]\alpha(c)=\sup_{\tau\neq0}\inf_{\lambda\in M^\tau}[v(\tau,\lambda)-\sum_i\lambda^i\tau_ic_i]α(c)=supτ=0​infλ∈Mτ​[v(τ,λ)−∑i​λiτi​ci​] is ≤0\le 0≤0.
  • Proof of Theorem 3.1(b): if VVV is superadditive, V(τ)+V(σ)⊆V(τ+σ)V(\tau)+V(\sigma)\subseteq V(\tau+\sigma)V(τ)+V(σ)⊆V(τ+σ), then τ↦v(τ,λ)\tau\mapsto v(\tau,\lambda)τ↦v(τ,λ) is concave on R+n\mathbb{R}^n_+R+n​.
  • Theorem 3.1: strong equilibria lie in the core, and for a superadditive game the core lies in the set of weak equilibria.
  • Theorem 5.1: a superadditive fuzzy game has a nonempty core.
  • §7, (6), (7), (11): πV\pi VπV is a superadditive fuzzy game that extends VVV, and its support function is πv(τ,λ)=sup⁡m∈C(τ)∑Am(A)v(A,λ)\pi v(\tau,\lambda)=\sup_{m\in\mathcal{C}(\tau)}\sum_A m(A)v(A,\lambda)πv(τ,λ)=supm∈C(τ)​∑A​m(A)v(A,λ).
  • §7 and the proof of Theorem 7.1: under balancedness, core⁡(πV)⊆core⁡(V)\operatorname{core}(\pi V)\subseteq\operatorname{core}(V)core(πV)⊆core(V), and the equilibria of VVV coincide with those of πV\pi VπV.

Significance

Theorem 7.1 gives the core existence result for convex NTU games under Billera's balancedness condition. Its proof goes through a statement about fuzzy coalitions, Theorem 5.1, which uses no combinatorial pivoting. That theorem also has independent uses. Its fuzzy core is the solution concept that §4 of the paper identifies with Walras equilibria of exchange economies. The canonical cooperative equilibria give a price-like certificate, a common rate of transfer λˉ\bar\lambdaλˉ, that sandwiches the core.

The results are classical and proved. Prove2Me holds no statement of Scarf's or Billera's theorem, of NTU cores, or of balancedness for games without side payments, and Mathlib has none of these notions. The mission produces faithful statements of the paper's chain of results, and their proofs once solvers close them. It also builds reusable infrastructure: support functions of comprehensive sets, Minkowski combinations indexed by balances, and positively homogeneous set-valued maps.

Difficulty

Most of §7 is bookkeeping with Minkowski sums. The hard part is Theorem 5.1, the existence of a point in the fuzzy core. The core is defined by infinitely many exclusion conditions, one for each τ∈[0,1]n\tau\in[0,1]^nτ∈[0,1]n, so a finite intersection argument does not apply directly. The paper's route works with prices: it uses the superdifferential of the concave map τ↦v(τ,λ)\tau\mapsto v(\tau,\lambda)τ↦v(τ,λ) at τN\tau^NτN, Ky Fan's inequality on a truncated simplex where all λi≥ε\lambda_i\ge\varepsilonλi​≥ε, and a limit as ε→0\varepsilon\to0ε→0. That limit requires compactness of the approximating payoffs, and at the boundary of the simplex the superdifferential map is not upper semicontinuous. Theorem 3.1(b) needs a minisup theorem for a function that is concave in τ\tauτ and convex and lower semicontinuous in λ\lambdaλ. Mathlib has neither Ky Fan's inequality nor this minimax theorem in that form.

Formalization scope

All statements import one definitions file, FuzzyGames.NTUCore.Basic. The formalization commits to the following conventions.

  • Players are Fin n, and payoffs, fuzzy coalitions and rates of transfer are Fin n → ℝ, ordered coordinatewise. Rτ\mathbb{R}^\tauRτ is encoded as "vanishes where τi=0\tau_i=0τi​=0", which equals τ⋅Rn\tau\cdot\mathbb{R}^nτ⋅Rn for τ≥0\tau\ge0τ≥0.
  • Fuzzy games are defined directly on the orthant τ≥0\tau\ge0τ≥0, the paper's extension of VVV from [0,1]n[0,1]^n[0,1]n by homogeneity. Homogeneity holds for every t>0t>0t>0, and superadditivity holds on R+n\mathbb{R}^n_+R+n​.
  • Support functions, α\alphaα and πv\pi vπv take values in EReal, so an unbounded supremum is +∞+\infty+∞ and never a junk 000.
  • The supremum defining α(c)\alpha(c)α(c) ranges over τ≠0\tau\neq0τ=0. Since M0=∅M^0=\emptysetM0=∅, including τ=0\tau=0τ=0 would make α≡+∞\alpha\equiv+\inftyα≡+∞ and Proposition 3.1 false. Blocking coalitions are likewise τ≠0\tau\neq0τ=0, as in §3 (4).
  • C\mathcal{C}C is a finite family of nonempty coalitions that contains NNN and every singleton. "∀A≠∅\forall A\neq\emptyset∀A=∅" in §7 ranges over C\mathcal{C}C.
  • The paper leaves n≥1n\ge1n≥1 implicit. Theorem 3.1(b) and Theorem 5.1 carry 0<n0<n0<n: for n=0n=0n=0 the simplex is empty while the core is not.
  • In §7 (11), πv(τ,λ)\pi v(\tau,\lambda)πv(τ,λ), which the paper uses without defining it, is taken to be the extension §6 (2) applied to A↦v(A,λ)A\mapsto v(A,\lambda)A↦v(A,λ), for λ≥0\lambda\ge0λ≥0.
  • The §7 sentence after (5) is stated with two extra conclusions: πV(τ)\pi V(\tau)πV(τ) is nonempty and contained in Rτ\mathbb{R}^\tauRτ. These are the remaining requirements of §3 (3) that are needed to apply Theorem 5.1.
  • Sums and scalings of sets are Mathlib's pointwise operations.

The fuzzy-game axioms are a Prop-valued structure and are hypotheses of every theorem. The core and the equilibria are defined for an arbitrary set-valued map, so the theorems about πV\pi VπV do not presuppose that it is a fuzzy game. That fact is the content of the §7 milestones and is not assumed. Non-vacuity has been checked locally on a concrete instance: V(τ)={c∈Rτ:c≤τ}V(\tau)=\{c\in\mathbb{R}^\tau: c\le\tau\}V(τ)={c∈Rτ:c≤τ} is a superadditive fuzzy game, and V(A)={c∈RA:c≤τA}V(A)=\{c\in\mathbb{R}^A:c\le\tau^A\}V(A)={c∈RA:c≤τA} is a balanced game on every admissible C\mathcal{C}C, with (1,…,1)(1,\dots,1)(1,…,1) in both cores.

Contributions are welcome at every level: the §7 Minkowski-sum lemmas, the support-function identities, and a minisup or Ky Fan theorem in the form the proofs need. Reusable pieces include support functions of comprehensive sets and Sion-type minimax.

Selected references

  • J.-P. Aubin, Cooperative Fuzzy Games, Mathematics of Operations Research 6(1) (1981) 1–13. https://doi.org/10.1287/moor.6.1.1
  • H. E. Scarf, The Core of an N Person Game, Econometrica 35(1) (1967) 50–69. https://doi.org/10.2307/1909888
  • L. J. Billera, Some Theorems on the Core of an n-Person Game without Side-Payments, SIAM Journal on Applied Mathematics 18(3) (1970) 567–579. https://doi.org/10.1137/0118053
  • K. Fan, A Minimax Inequality and Applications, in O. Shisha (ed.), Inequalities III, Academic Press (1972) 103–113.
12 thms1 active userReviewed
CombinatoricsOperations ResearchOptimization·Captain: mikedeng1

One-Processor Scheduling with Symmetric Earliness and Tardiness Penalties 3: For Maximum Discrepancy, Some Optimum Schedule Is in Standard Form and Has the Release Time PropertyResearch Paper

Motivation

In just-in-time scheduling each job has a preferred time, and finishing it early is as undesirable as finishing it late. Garey, Tarjan and Wilfong (Math. Oper. Res. 13 (1988), 330–348) study the one-processor version in which task TiT_iTi​ has a length li≥0l_i \ge 0li​≥0 and a preferred starting time ai≥0a_i \ge 0ai​≥0, and the discrepancy of a task started at time sis_isi​ is ∣si−ai∣|s_i - a_i|∣si​−ai​∣. The penalty is symmetric: earliness and tardiness cost the same. The paper shows that minimizing the total discrepancy is NP-complete, gives an O(Nlog⁡N)O(N \log N)O(NlogN) algorithm for a fixed task order, and, in §3, gives an efficient algorithm for minimizing the maximum discrepancy max⁡i∣si−ai∣\max_i |s_i - a_i|maxi​∣si​−ai​∣: a linear-time test for a given bound γ\gammaγ after an O(Nlog⁡N)O(N \log N)O(NlogN) sort, combined with a search over γ\gammaγ.

This mission formalizes the structural core of §3: the normal-form theorems (Theorem 4, Corollaries 1 and 2) on which the paper's algorithm for maximum discrepancy is built. The two companion missions of the series cover the NP-completeness result (THEOREM 1) and the fixed-order algorithm (THEOREMS 2 and 3).

Setting

Fix a bound γ≥0\gamma \ge 0γ≥0. A schedule has maximum discrepancy at most γ\gammaγ exactly when every task starts no earlier than its release time ri=max⁡{0,ai−γ}r_i = \max\{0, a_i - \gamma\}ri​=max{0,ai​−γ} and finishes no later than its deadline di=ai+li+γd_i = a_i + l_i + \gammadi​=ai​+li​+γ (p. 342). These release times and deadlines are in special form: with α=2γ\alpha = 2\gammaα=2γ, for every task

di−ri=li+αor(ri=0 and di<li+α).d_i - r_i = l_i + \alpha \quad\text{or}\quad \big(r_i = 0 \text{ and } d_i < l_i + \alpha\big).di​−ri​=li​+αor(ri​=0 and di​<li​+α).

From here on the data are arbitrary reals li≥0l_i \ge 0li​≥0, ri≥0r_i \ge 0ri​≥0, did_idi​ in special form for some α≥0\alpha \ge 0α≥0.

A schedule is an execution order σ\sigmaσ (σ(p)\sigma(p)σ(p) is the task in position ppp) with starting times sis_isi​, such that a task finishes no later than any later-positioned task starts: sσ(p)+lσ(p)≤sσ(q)s_{\sigma(p)} + l_{\sigma(p)} \le s_{\sigma(q)}sσ(p)​+lσ(p)​≤sσ(q)​ for p<qp < qp<q. It is feasible if ri≤sir_i \le s_iri​≤si​ and si+li≤dis_i + l_i \le d_isi​+li​≤di​ for every iii. Its makespan is max⁡i(si+li)\max_i (s_i + l_i)maxi​(si​+li​), and it is optimum if it is feasible and no feasible schedule has a smaller makespan.

Let TNT_NTN​ be a task of largest deadline. A schedule has the release time property if every task executed after TNT_NTN​ has release time strictly later than the starting time of TNT_NTN​. When the tasks are indexed with d1≤⋯≤dNd_1 \le \dots \le d_Nd1​≤⋯≤dN​, a schedule is in standard form with split index jjj, 0≤j≤N−10 \le j \le N-10≤j≤N−1, if it begins with an optimum schedule of T1,…,TjT_1, \dots, T_jT1​,…,Tj​, followed by TNT_NTN​ started at the maximum of rNr_NrN​ and the completion time of that first part, followed by Tj+1,…,TN−1T_{j+1}, \dots, T_{N-1}Tj+1​,…,TN−1​ in this order without idle time.

Formalization targets

Goal: Corollary 2 (p. 344)

∃ a feasible schedule  ⟹  ∃ an optimum schedule that is in standard form and has the release time property.\exists\ \text{a feasible schedule} \;\Longrightarrow\; \exists\ \text{an optimum schedule that is in standard form and has the release time property.}∃ a feasible schedule⟹∃ an optimum schedule that is in standard form and has the release time property.

Milestones

  1. Theorem 4 (pp. 342–343): if a feasible schedule exists, some optimum schedule has the release time property with respect to any task of largest deadline.
  2. The deadline split (proof of Corollary 1, p. 344): in every feasible schedule with the release time property, a task Ti≠TNT_i \neq T_NTi​=TN​ precedes TNT_NTN​ if and only if di≤sN+αd_i \le s_N + \alphadi​≤sN​+α.
  3. Corollary 1 (p. 344): some optimum schedule executes before TNT_NTN​ exactly the tasks of deadline at most β\betaβ, for some β≥0\beta \ge 0β≥0.
  4. Release before finish (p. 344): every task executed after TNT_NTN​ has ri≤sN+lNr_i \le s_N + l_Nri​≤sN​+lN​.
  5. Normalization after TNT_NTN​ (p. 344): an optimum schedule with the release time property can be changed, without moving TNT_NTN​ later and without touching the tasks before it, so that there is no idle time from the start of TNT_NTN​ on and the later tasks run in deadline order.

Two companion items state the reformulation of the maximum-discrepancy bound as release times and deadlines, and the special form with α=2γ\alpha = 2\gammaα=2γ.

Significance

Corollary 2 reduces the search for an optimum schedule of T1,…,TnT_1, \dots, T_nT1​,…,Tn​ to nnn candidates, one per split index, each assembled from an optimum schedule of a shorter prefix. This is the dynamic program of §3.2, which the paper implements in O(N)O(N)O(N) time after an O(Nlog⁡N)O(N \log N)O(NlogN) sort; combined with a search over γ\gammaγ it minimizes the maximum discrepancy. Without the special form, deciding whether one processor can meet arbitrary release times and deadlines is NP-complete (reference [4] of the paper, Garey and Johnson 1979), so the normal form is what separates the tractable case from the general one.

The results are proved in the paper; no machine-checked proof of them is known on Prove2Me. A formal proof of Corollary 2 would certify the correctness of the split-index recursion and, together with the companions, of the reduction from maximum discrepancy to this release-time/deadline problem.

Difficulty

The obvious argument fails in Theorem 4. Exchanging a straggler (a task after TNT_NTN​ released no later than TNT_NTN​ starts) with TNT_NTN​ shifts the tasks between them, and for general release times and deadlines those tasks can become infeasible. The paper's argument uses the special form at every step: a task released after TNT_NTN​ starts has ri>0r_i > 0ri​>0, hence di−ri=li+αd_i - r_i = l_i + \alphadi​−ri​=li​+α exactly, and this equality is what bounds how far tasks may move. It also needs an extremal choice of the optimum schedule (fewest tasks after TNT_NTN​, then fewest tasks between TNT_NTN​ and the first straggler), which requires showing that optimum schedules exist over the reals. The passage to standard form then combines this with an earliest-deadline exchange for the tasks after TNT_NTN​ and the replacement of the first part by an optimum sub-schedule without losing feasibility of the later tasks.

Formalization scope

Tasks are indexed by Fin N (0-based: the paper's T1,…,TNT_1, \dots, T_NT1​,…,TN​ are 0,…,N−10, \dots, N-10,…,N−1; the paper's TNT_NTN​ in Corollary 2 is the index N−1N-1N−1). All data are real. A schedule is a permutation σ : Fin N ≃ Fin N with starting times s : Fin N → ℝ; "executed before/after" refers to σ, not to a comparison of starting times, because zero-length tasks may share a starting time. Execution intervals meet at most at endpoints. The makespan is a supremum over Fin N; "optimum" quantifies over all feasible schedules, not only standard-form ones.

The standing hypotheses on every structural item are α≥0\alpha \ge 0α≥0, ri≥0r_i \ge 0ri​≥0, li≥0l_i \ge 0li​≥0 (from γ≥0\gamma \ge 0γ≥0, the max⁡{0,⋅}\max\{0, \cdot\}max{0,⋅} in rir_iri​, and nonnegative lengths); since si≥ris_i \ge r_isi​≥ri​, start times are nonnegative, as the paper assumes throughout. The special form is a hypothesis of every structural item and cannot be dropped. The paper's dummy task T0T_0T0​ (r0=d0=l0=0r_0 = d_0 = l_0 = 0r0​=d0​=l0​=0) is not a task; an empty first part completes at time 000. Corollary 1's "the set of all tasks with deadline β\betaβ or less" is read as excluding TNT_NTN​, the only reading under which it is true. The page's "(which can be assumed optimum)" is part of the standard form. The deadline-split and release-before-finish milestones are stated for every feasible schedule, as their arguments allow.

A trivializing formalization is excluded: the standard form pins TNT_NTN​'s start to max⁡(rN,C)\max(r_N, C)max(rN​,C) and the later tasks to consecutive positions in index order, so the goal is not Corollary 1 restated with an unconstrained split.

Running times (O(Nlog⁡N)O(N \log N)O(NlogN), O(N)O(N)O(N)) and the algorithm of §3.2 are out of scope. The development needs only finite permutations, finite suprema and the exchange arguments of §3.1; the existence of an optimum schedule (minimum makespan over finitely many orders, earliest-start schedules) is reusable for other single-machine problems with release times and deadlines. Proofs of any milestone, and a sorry-free proof of the existence of optimum schedules, are welcome.

Selected references

  • M. R. Garey, R. E. Tarjan, G. T. Wilfong, One-Processor Scheduling with Symmetric Earliness and Tardiness Penalties, Mathematics of Operations Research 13(2):330–348, 1988. https://doi.org/10.1287/moor.13.2.330
  • M. R. Garey, D. S. Johnson, Computers and Intractability: A Guide to the Theory of NP-Completeness, W. H. Freeman, 1979 (reference [4] of the paper, cited on p. 342 for the NP-completeness of one-processor scheduling with release times and deadlines). ISBN 0-7167-1045-5
7 thms1 active userReviewed
Linear OptimizationOperations ResearchOptimization·Captain: mikedeng1

A Linear Programming Approach to the Cutting Stock Problem—Part II 2: For a Linear-Fractional Objective, a Basic Feasible Solution with No Improving Edge Is a Global MinimumResearch Paper

Motivation

In the cutting stock problem, stock rolls of length LLL are cut into pieces of lengths l1,…,lml_1,\dots,l_ml1​,…,lm​ to fill orders. Part I of Gilmore and Gomory's work (Opns. Res. 9 (1961)) solved its linear programming relaxation by the simplex method with column generation: the columns (cutting patterns) are too many to list, so each simplex iteration finds an improving column by solving a knapsack problem. Part II (Opns. Res. 11 (1963)) extends the method in several directions. One of them, customer tolerances, lets the amount produced of each length lie in a range [Ni′,Ni′′][N_i',N_i''][Ni′​,Ni′′​] instead of matching a fixed demand. Total roll usage then stops being a good measure of quality, because overproducing within the tolerance is free. The natural objective becomes the fraction of waste: total waste divided by total material cut. This objective is a ratio of two linear functions, not a linear one.

The paper's answer, on p. 882, is that the ordinary simplex method still works for such an objective. It moves from vertex to vertex, at each vertex asks whether some edge improves the objective, and stops when none does. Ratio objectives of this kind, called linear-fractional programs, were studied in the same years by Isbell and Marlow (1956), Martos (1960–61, in Hungarian; in English in 1964), Charnes and Cooper (1962) and Dinkelbach (1962; see also 1967). Gilmore and Gomory say that their method is closest to Martos's. They derive the edge test for the ratio and show that, for cutting stock, choosing the entering column is again a knapsack problem.

Setting

Let AAA be a real m×nm\times nm×n matrix, b∈Rmb\in\mathbb R^mb∈Rm and c,d∈Rnc,d\in\mathbb R^nc,d∈Rn. The linear-fractional program is

minimizeζ(x)=z1(x)z2(x)=∑icixi∑idixisubject toAx=b, x≥0.\text{minimize}\quad \zeta(x)=\frac{z_1(x)}{z_2(x)}=\frac{\sum_i c_ix_i}{\sum_i d_ix_i}\qquad\text{subject to}\quad Ax=b,\ x\ge 0 .minimizeζ(x)=z2​(x)z1​(x)​=∑i​di​xi​∑i​ci​xi​​subject toAx=b, x≥0.

In the cutting stock instance (p. 881), column jjj is either a cutting pattern aj∈Z≥0ma_j\in\mathbb Z^m_{\ge0}aj​∈Z≥0m​ with ∑iaijli≤L\sum_ia_{ij}l_i\le L∑i​aij​li​≤L or a slack column −ei-e_i−ei​. The right-hand side is bi=Ni′b_i=N_i'bi​=Ni′​. The numerator coefficient of a pattern is its waste wj=L−∑iaijliw_j=L-\sum_ia_{ij}l_iwj​=L−∑i​aij​li​ (eq. (4)), and dj=1d_j=1dj​=1 on patterns and 000 on slacks, so ζ\zetaζ is waste per roll cut. The paper drops the upper bounds si≤Ni′′−Ni′s_i\le N_i''-N_i'si​≤Ni′′​−Ni′​ on the slacks from the discussion (p. 882), and so does this mission.

A basis is a set BBB of mmm column indices whose columns of AAA are linearly independent. A basic feasible solution xˉ\bar xxˉ with basis BBB is a feasible point with xˉk=0\bar x_k=0xˉk​=0 for every k∉Bk\notin Bk∈/B. For a nonbasic j∉Bj\notin Bj∈/B, the edge direction of xjx_jxj​ is the vector vvv with Av=0Av=0Av=0, vj=1v_j=1vj​=1 and vk=0v_k=0vk​=0 for the other nonbasic kkk. This is "the edge that would be traced out if xjx_jxj​ were increased, but all other nonbasic variables kept zero" (p. 883). The quantity the simplex test inspects is the rate of change along the edge,

dζdxj=ddτ ζ(xˉ+τv)∣τ=0.\frac{d\zeta}{dx_j}=\frac{d}{d\tau}\,\zeta(\bar x+\tau v)\Big|_{\tau=0}.dxj​dζ​=dτd​ζ(xˉ+τv)​τ=0​.

Formalization targets

Goal: the edge criterion (p. 882)

Assume ∑idixi>0\sum_id_ix_i>0∑i​di​xi​>0 for every feasible xxx. Let xˉ\bar xxˉ be a basic feasible solution with basis BBB, and suppose dζ/dxj≥0d\zeta/dx_j\ge0dζ/dxj​≥0 for every j∉Bj\notin Bj∈/B and every edge direction of xjx_jxj​. Then

ζ(xˉ)≤ζ(x)for every x≥0 with Ax=b.\zeta(\bar x)\le\zeta(x)\qquad\text{for every } x\ge0 \text{ with } Ax=b .ζ(xˉ)≤ζ(x)for every x≥0 with Ax=b.

Milestones (p. 882–883)

  1. Monotonicity along lines. On an interval where the denominator does not vanish, τ↦ζ(x+τv)\tau\mapsto\zeta(x+\tau v)τ↦ζ(x+τv) is strictly increasing, strictly decreasing or constant. Moreover f′(τ) D(τ)2f'(\tau)\,D(\tau)^2f′(τ)D(τ)2 is constant, where DDD is the denominator.
  2. Equation (5), first line.
dζdxj=z2 (dz1/dxj)−z1 (dz2/dxj)z22.\frac{d\zeta}{dx_j}=\frac{z_2\,(dz_1/dx_j)-z_1\,(dz_2/dx_j)}{z_2^2}.dxj​dζ​=z22​z2​(dz1​/dxj​)−z1​(dz2​/dxj​)​.
  1. The edge test. If dζ/dxj<0d\zeta/dx_j<0dζ/dxj​<0, increasing xjx_jxj​ strictly decreases ζ\zetaζ along any segment where the denominator does not vanish. Otherwise ζ\zetaζ does not decrease anywhere on that segment.
  2. Column choice is a knapsack problem. With k=Lz2−z1k=Lz_2-z_1k=Lz2​−z1​ and Πˉi=−(z1Πi2−z2Πi1−z2li)\bar\Pi_i=-(z_1\Pi^2_i-z_2\Pi^1_i-z_2l_i)Πˉi​=−(z1​Πi2​−z2​Πi1​−z2​li​), the numerator of dζ/dxjd\zeta/dx_jdζ/dxj​ for pattern aaa equals k−∑iΠˉiaik-\sum_i\bar\Pi_ia_ik−∑i​Πˉi​ai​. Hence, for z2≠0z_2\ne0z2​=0, the most negative dζ/dxjd\zeta/dx_jdζ/dxj​ is attained exactly by the patterns maximizing ∑iΠˉiai\sum_i\bar\Pi_ia_i∑i​Πˉi​ai​ subject to ∑iaili≤L\sum_ia_il_i\le L∑i​ai​li​≤L.

Significance

The result. The edge criterion turns a nonconvex problem into one the simplex method solves. A ratio of linear functions is neither convex nor concave, so a point where no feasible direction improves the objective locally is not obviously a global minimum. The criterion says that, on a polyhedron where the denominator keeps its sign, this local test at a vertex certifies global optimality, exactly as for a linear objective. It underlies the convergence of Martos's method and of every simplex-type algorithm for linear-fractional programming. Together with milestone 4, it is what makes column generation with a knapsack pricing step applicable to the waste-fraction objective of cutting stock.

Formalizing it. The result is classical and proved; no machine-checked version is known to exist. The published platform items closest to it are Derman's Charnes–Cooper transformation of a linear-fractional program into a linear program and Matoušek's reduced-cost optimality criterion for a linear objective. Neither states an edge criterion for a ratio. A formal proof here also settles the paper's own imprecisions (see below), and yields reusable lemmas about ratios of affine functions along lines.

Difficulty

The obvious argument does not reach the goal. Along any single segment the objective is monotone (milestone 1), so a nonnegative derivative at xˉ\bar xxˉ in the direction of the segment would settle it. But the test at xˉ\bar xxˉ inspects only the n−mn-mn−m edge directions, while a feasible point xxx lies in the direction x−xˉx-\bar xx−xˉ, which is in general not an edge. Monotonicity along each edge says nothing directly about other directions, and ζ\zetaζ is neither convex nor concave, so local optimality along a few lines does not by itself transfer to the whole polyhedron. The step that has to be supplied is the passage from the edges to all feasible directions at a basic solution. It fails without the basis: at a feasible point that is not basic, or with linearly dependent columns, the edge directions need not reach every feasible point. At a degenerate vertex some edge directions leave the feasible set at once, and a test restricted to the feasible edges does not certify optimality.

Formalization scope

The feasible set and the objective are the published definitions DermanSeqDecisions.LinProg.IsFeasible11 (x≥0x\ge0x≥0, Ax=bAx=bAx=b) and DermanSeqDecisions.LinProg.fracObj ((∑cixi)/(∑dixi)(\sum c_ix_i)/(\sum d_ix_i)(∑ci​xi​)/(∑di​xi​)). The basis is the published MatousekLP.BFS.IsBasis. Indices are 0-based. A mission definition adds the basic feasible solution and the relational edge direction. The edge direction is given by its defining equations, not through a basis inverse, and is not required to be feasible.

Committed conventions and disclosed choices:

  • The goal is stated for minimization, the paper's problem; the paper's sentence says "maximize", which is the same statement for −c-c−c.
  • "In a domain where the denominator does not vanish" is the hypothesis ∑idixi>0\sum_id_ix_i>0∑i​di​xi​>0 for every feasible xxx (the paper's footnote: ∑jxj>0\sum_jx_j>0∑j​xj​>0). It is not required on all of Rn\mathbb R^nRn, where it would be unsatisfiable for the cutting stock ddd.
  • The derivative in the test is Mathlib's deriv of τ↦ζ(xˉ+τv)\tau\mapsto\zeta(\bar x+\tau v)τ↦ζ(xˉ+τv) at 000: the actual rate of change, not a formula assumed to equal it.
  • The page says that along a line the derivative "will have the same value". This is false when the denominator varies along the line. Milestone 1 states the correct version: the derivative times the squared denominator is constant, so the sign is constant.
  • In the formula after substituting (4), the page prints the coefficient −li-l_i−li​ where −z2li-z_2l_i−z2​li​ is meant. Milestone 4 uses the corrected coefficient.
  • The slack upper bounds are dropped, as on p. 882.

The following would trivialize the goal and are excluded: an edge hypothesis over all directions vvv instead of the edge directions, which turns the goal into quasi-convexity along segments; an edge hypothesis stated as the global inequality; a positivity hypothesis on the denominator over all of Rn\mathbb R^nRn; and dropping the basis, under which the goal is false.

The development needs elementary real calculus (derivatives of quotients, monotonicity from the sign of the derivative) and the linear algebra of a basis (existence, uniqueness and spanning of the edge directions). The lemmas about ratios of affine functions along lines and about edge directions of a basis are reusable for any simplex-type method. Contributions of proofs of the milestones, and of auxiliary lemmas on edge directions, are welcome.

Selected references

  • P. C. Gilmore and R. E. Gomory, A linear programming approach to the cutting stock problem—Part II, Operations Research 11(6), 863–888, 1963. https://doi.org/10.1287/opre.11.6.863
  • P. C. Gilmore and R. E. Gomory, A linear programming approach to the cutting stock problem, Operations Research 9(6), 849–859, 1961. https://doi.org/10.1287/opre.9.6.849
  • B. Martos, Hyperbolic programming, Naval Research Logistics Quarterly 11(2), 135–155, 1964. https://doi.org/10.1002/nav.3800110204
  • A. Charnes and W. W. Cooper, Programming with linear fractional functionals, Naval Research Logistics Quarterly 9(3–4), 181–186, 1962. https://doi.org/10.1002/nav.3800090303
  • W. Dinkelbach, Die Maximierung eines Quotienten zweier linearer Funktionen unter linearen Nebenbedingungen, Zeitschrift für Wahrscheinlichkeitstheorie 1, 141–145, 1962 (cited by the paper as [11]).
  • W. Dinkelbach, On nonlinear fractional programming, Management Science 13(7), 492–498, 1967. https://doi.org/10.1287/mnsc.13.7.492
  • J. R. Isbell and W. H. Marlow, Attrition games, Naval Research Logistics Quarterly 3, 71–94, 1956 (cited by the paper as [9]).
8 thms2 active usersReviewed
Operations ResearchProbabilityStatistics·Captain: mikedeng1

Simulation Output Analysis Using Standardized Time Series 1: For Every g in the Class 𝓜, (Ȳₙ(1) − μ)/g(Ȳₙ) ⇒ B(1)/g(B) Under the FCLT (2.1)Research Paper

Motivation

A discrete-event simulation of a queue, an inventory system or a communication network produces an output process Y={Y(t):t≥0}Y = \{Y(t) : t \ge 0\}Y={Y(t):t≥0}, and the quantity of interest is usually its steady-state mean μ\muμ, the long-run average of YYY. The natural estimator is the time average Yˉn(1)=1n∫0nY(s) ds\bar Y_n(1) = \frac1n\int_0^n Y(s)\,dsYˉn​(1)=n1​∫0n​Y(s)ds of a run of length nnn. A confidence interval for μ\muμ needs the scale of the fluctuations of Yˉn(1)\bar Y_n(1)Yˉn​(1), the variance constant σ2\sigma^2σ2 of the central limit theorem n1/2(Yˉn(1)−μ)⇒σN(0,1)n^{1/2}(\bar Y_n(1) - \mu) \Rightarrow \sigma N(0,1)n1/2(Yˉn​(1)−μ)⇒σN(0,1). For correlated simulation output, σ2\sigma^2σ2 is a sum of autocovariances at all lags and is hard to estimate consistently.

The method of standardized time series (STS), introduced by Schruben (Schruben 1983), avoids estimating σ\sigmaσ: it divides the centred time average by a functional of the whole observed path that scales like σ\sigmaσ, so that σ\sigmaσ cancels. Batch means, the standardized sum, and the standardized maximum are all of this form.

Glynn and Iglehart (Glynn & Iglehart 1990) put the method on a general footing. They require only a functional central limit theorem (FCLT) for YYY, and they identify an abstract class M\mathcal MM of standardizing functionals for which the cancellation works. This mission formalizes their basic limit theorem, Theorem 2.4, and the four claims of its proof. Two companion results of §2, display (2.2) and the weak law Yˉn(1)⇒μ\bar Y_n(1) \Rightarrow \muYˉn​(1)⇒μ, are included as further targets.

Setting

C[0,1]C[0,1]C[0,1] is the space of continuous real functions on [0,1][0,1][0,1] with the uniform norm and its Borel σ\sigmaσ-algebra; k∈C[0,1]k \in C[0,1]k∈C[0,1] is the identity path k(t)=tk(t) = tk(t)=t. For g:C[0,1]→Rg : C[0,1] \to \mathbb Rg:C[0,1]→R, D(g)D(g)D(g) is the discontinuity set of ggg, the set of xxx at which ggg is not continuous. A standard Brownian motion BBB on a probability space (Ω,F,P)(\Omega, \mathcal F, P)(Ω,F,P) is a random element of C[0,1]C[0,1]C[0,1] with Gaussian finite-dimensional laws, B(0)=0B(0) = 0B(0)=0 and Cov⁡(B(s),B(t))=min⁡(s,t)\operatorname{Cov}(B(s), B(t)) = \min(s,t)Cov(B(s),B(t))=min(s,t).

The output YYY is a real-valued measurable process. Its scaled partial-integral process and its centred, rescaled version are

Yˉn(t)=1n∫0ntY(s) ds,Xn(t)=n1/2(Yˉn(t)−μt),0≤t≤1.\bar Y_n(t) = \frac1n\int_0^{nt} Y(s)\,ds, \qquad X_n(t) = n^{1/2}\bigl(\bar Y_n(t) - \mu t\bigr), \qquad 0 \le t \le 1 .Yˉn​(t)=n1​∫0nt​Y(s)ds,Xn​(t)=n1/2(Yˉn​(t)−μt),0≤t≤1.

Assumption (2.1) asks for finite constants μ\muμ and σ>0\sigma > 0σ>0 such that Xn⇒σBX_n \Rightarrow \sigma BXn​⇒σB as n→∞n \to \inftyn→∞, weak convergence of random elements of C[0,1]C[0,1]C[0,1]. It holds for ϕ\phiϕ-mixing, strongly mixing, associated and regenerative output processes, among others.

The class M\mathcal MM of (2.3) consists of the measurable g:C[0,1]→Rg : C[0,1] \to \mathbb Rg:C[0,1]→R with

  1. g(αx)=αg(x)g(\alpha x) = \alpha g(x)g(αx)=αg(x) for α>0\alpha > 0α>0 (positive homogeneity);
  2. g(x−βk)=g(x)g(x - \beta k) = g(x)g(x−βk)=g(x) for β∈R\beta \in \mathbb Rβ∈R (invariance under subtracting a linear drift);
  3. P{g(B)>0}=1P\{g(B) > 0\} = 1P{g(B)>0}=1;
  4. P{B∈D(g)}=0P\{B \in D(g)\} = 0P{B∈D(g)}=0.

The proof uses the auxiliary map h(x)=x(1)/g(x)h(x) = x(1)/g(x)h(x)=x(1)/g(x) for g(x)≠0g(x) \ne 0g(x)=0 and h(x)=0h(x) = 0h(x)=0 otherwise.

Formalization targets

Goal: Theorem 2.4

For every g∈Mg \in \mathcal Mg∈M, under Assumption (2.1),

Yˉn(1)−μg(Yˉn)⇒B(1)g(B)(n→∞).(2.5)\frac{\bar Y_n(1) - \mu}{g(\bar Y_n)} \Rightarrow \frac{B(1)}{g(B)} \qquad (n \to \infty). \tag{2.5}g(Yˉn​)Yˉn​(1)−μ​⇒g(B)B(1)​(n→∞).(2.5)

Milestones: the four claims of the proof (p. 3)

  1. P{σB∈D(h)}=0P\{\sigma B \in D(h)\} = 0P{σB∈D(h)}=0.
  2. h(Xn)⇒h(σB)h(X_n) \Rightarrow h(\sigma B)h(Xn​)⇒h(σB).
  3. h(σB)=B(1)/g(B)h(\sigma B) = B(1)/g(B)h(σB)=B(1)/g(B), by (2.3i).
  4. h(Xn)=(Yˉn(1)−μ)/g(Yˉn)h(X_n) = (\bar Y_n(1) - \mu)/g(\bar Y_n)h(Xn​)=(Yˉn​(1)−μ)/g(Yˉn​) for n≥1n \ge 1n≥1, by (2.3i) and (2.3ii).

Companions

n1/2(Yˉn(1)−μ)⇒σB(1)(2.2)n^{1/2}\bigl(\bar Y_n(1) - \mu\bigr) \Rightarrow \sigma B(1) \tag{2.2}n1/2(Yˉn​(1)−μ)⇒σB(1)(2.2)

and Yˉn(1)⇒μ\bar Y_n(1) \Rightarrow \muYˉn​(1)⇒μ.

Significance

Theorem 2.4 is the limit theorem behind every STS confidence interval. The limit B(1)/g(B)B(1)/g(B)B(1)/g(B) is free of σ\sigmaσ and of the output process, so with zzz chosen so that P{−z≤B(1)/g(B)≤z}P\{-z \le B(1)/g(B) \le z\}P{−z≤B(1)/g(B)≤z} equals a prescribed level, the interval Yˉn(1)±z g(Yˉn)\bar Y_n(1) \pm z\,g(\bar Y_n)Yˉn​(1)±zg(Yˉn​) has asymptotically exact coverage for μ\muμ. Each choice of g∈Mg \in \mathcal Mg∈M gives a method: batch means with a fixed number of batches, Schruben's standardized sum, the standardized maximum. The later sections of the paper compare the lengths of these intervals with those of consistent-estimation intervals, and those comparisons start from Theorem 2.4.

The theorem is classical and its proof is short on paper. What is missing is a machine-checked version. The formal proof needs a continuous mapping theorem for maps that are continuous only almost surely at the limit, on the non-locally-compact space C[0,1]C[0,1]C[0,1]; Mathlib has the version for continuous maps only. A formal Theorem 2.4 also makes the class M\mathcal MM and the C[0,1]-valued FCLT available for the other results of the paper, the expected-length lower bound and its non-attainment, which are formalized in sibling missions.

Difficulty

The algebra (milestones 3 and 4) is elementary. The difficulty is the continuous-mapping step. The map hhh is in general not continuous: it can be discontinuous wherever ggg is and wherever ggg vanishes, and ggg itself may be discontinuous on a large set (the standardized maximum is). The continuous mapping theorem for continuous maps does not apply. One needs its almost-sure form: if Xn⇒XX_n \Rightarrow XXn​⇒X and P{X∈D(h)}=0P\{X \in D(h)\} = 0P{X∈D(h)}=0, then h(Xn)⇒h(X)h(X_n) \Rightarrow h(X)h(Xn​)⇒h(X). The class M\mathcal MM controls D(g)D(g)D(g) only along the law of BBB, and the hypothesis of the almost-sure theorem is about D(h)D(h)D(h) at the scaled limit σB\sigma BσB, so the conditions (2.3iii) and (2.3iv) have to be transported from BBB to σB\sigma BσB and from ggg to hhh.

Formalization scope

C[0,1]C[0,1]C[0,1] is C(unitInterval, ℝ) with its sup-norm topology; the Borel MeasurableSpace instance is declared in the mission's definition file, since Mathlib has none at this commit. Weak convergence is Mathlib's TendstoInDistribution, for the C[0,1]C[0,1]C[0,1]-valued FCLT and for the real-valued conclusions. The standard Brownian motion is a measurable C[0,1]C[0,1]C[0,1]-valued map whose coordinates agree, for every ω\omegaω, with a process satisfying Mathlib's IsBrownianReal. D(g)D(g)D(g) is the set of points where ContinuousAt g fails, and P{B∈D(g)}P\{B \in D(g)\}P{B∈D(g)} is an outer measure, so no measurability of D(g)D(g)D(g) is assumed.

Yˉn\bar Y_nYˉn​ is a C[0,1]C[0,1]C[0,1]-valued parameter pinned pointwise by Yˉn(t)=1n∫0ntY(s) ds\bar Y_n(t) = \frac1n\int_0^{nt}Y(s)\,dsYˉn​(t)=n1​∫0nt​Y(s)ds, so it is determined by YYY. Assumption (2.1) carries joint measurability of YYY and local integrability of each path; the second is implicit in the paper and makes Yˉn\bar Y_nYˉn​ defined. The index nnn runs over N\mathbb NN, and milestone 4 assumes n≥1n \ge 1n≥1 because (2.3i) is applied with α=n1/2\alpha = n^{1/2}α=n1/2. Real division by zero returns 000 in Lean, which agrees with the paper's convention for hhh; it matters only on events of probability zero in the limit. Condition (2.3iii) is printed "P{g(b)>0}=1P\{g(b) > 0\} = 1P{g(b)>0}=1" and is read as P{g(B)>0}=1P\{g(B) > 0\} = 1P{g(B)>0}=1.

Condition (2.3iv) is stated with the discontinuity set, not as continuity of ggg: requiring ggg continuous everywhere would exclude the standardized maximum of Example 3.10 and would make the continuous-mapping step trivial. The goal assumes nothing about hhh, D(h)D(h)D(h) or any mapping theorem; these appear only in the milestones.

Contributions welcome: the almost-sure continuous mapping theorem for TendstoInDistribution on a metric space (reusable well beyond this mission), the cone property of D(g)D(g)D(g) under positive homogeneity, and evaluation at a point as a continuous map on C[0,1]C[0,1]C[0,1]. Mathlib does not yet construct a Brownian motion with continuous paths as a C[0,1]C[0,1]C[0,1]-valued random element, so the hypotheses cannot be instantiated inside Lean; this is a hypothesis on BBB, not a vacuity.

Selected references

  • P. W. Glynn and D. L. Iglehart, Simulation output analysis using standardized time series, Mathematics of Operations Research 15(1):1–16, 1990. https://doi.org/10.1287/moor.15.1.1
  • L. Schruben, Confidence interval estimation using standardized time series, Operations Research 31(6):1090–1108, 1983. https://doi.org/10.1287/opre.31.6.1090
  • P. Billingsley, Convergence of Probability Measures, Wiley, 1968 (Theorem 5.1, the continuous mapping theorem).
  • K. L. Chung, A Course in Probability Theory, 2nd ed., Academic Press, 1974 (p. 93, converging-together lemma).
6 thms1 active userReviewed
Operations ResearchProbabilityStatistics·Captain: mikedeng1

Residual Life Time at Great Age 1: Every Nondegenerate Limit Law of the Normed Residual Life Time Is of Type Π, Π_γ, Γ_α or Γ_{γ,α}Research Paper

Motivation

A component with a random lifetime XXX that has survived to age ttt still has a random residual life time X−tX - tX−t. Reliability engineering, actuarial science and the statistics of exceedances over high thresholds all ask how the conditional law of X−tX - tX−t given X>tX > tX>t behaves when the age ttt is large. If XXX is exponential, the residual life has the same law at every age (lack of memory). In general it changes with ttt, and the natural question, as in the limit theory of sample maxima, is which laws can arise as limits once the residual life is suitably rescaled and shifted.

A. A. Balkema and L. de Haan answered this question in Residual Life Time at Great Age (The Annals of Probability 2, 1974). The answer — a short list of limit types — later underlies the peaks-over-threshold method of extreme value statistics, where the continuous limit laws reappear as the generalized Pareto family (Pickands, 1975). This mission formalizes the classification theorem of the paper, Theorem 1, together with the steps of its proof in §1.

Setting

Let XXX be a real random variable with distribution function FFF and distribution tail R(x)=1−F(x)=P{X>x}R(x) = 1 - F(x) = P\{X > x\}R(x)=1−F(x)=P{X>x}. Throughout, R(x)>0R(x) > 0R(x)>0 for every xxx (equivalently F(x)<1F(x) < 1F(x)<1 for all xxx), so that the conditioning event {X>t}\{X > t\}{X>t} never has probability zero. The residual life distribution function at age ttt is

Ft(x)=P{X−t≤x∣X>t},(1)F_t(x) = P\{X - t \le x \mid X > t\}, \tag{1}Ft​(x)=P{X−t≤x∣X>t},(1)

which vanishes for x<0x < 0x<0.

A family of distribution functions HtH_tHt​ converges weakly to GGG as t→∞t \to \inftyt→∞ if Ht(x)→G(x)H_t(x) \to G(x)Ht​(x)→G(x) at every continuity point xxx of GGG. A distribution function GGG is nondegenerate if it is not the distribution function of a point mass. GGG is of type KKK if G(x)=K(ax+b)G(x) = K(ax + b)G(x)=K(ax+b) for all xxx, with a>0a > 0a>0 and bbb real.

The limit laws are the following distribution functions, all equal to 000 for x<0x < 0x<0; for x≥0x \ge 0x≥0,

Π(x)=1−e−x,Γα(x)=1−(1+x)−α,\Pi(x) = 1 - e^{-x}, \qquad \Gamma_\alpha(x) = 1 - (1+x)^{-\alpha},Π(x)=1−e−x,Γα​(x)=1−(1+x)−α, Πγ(x)=1−exp⁡(−γ [1+x]),Γγ,α(x)=1−exp⁡(−γ [1+αlog⁡(1+x)]),\Pi_\gamma(x) = 1 - \exp\big(-\gamma\,[1 + x]\big), \qquad \Gamma_{\gamma,\alpha}(x) = 1 - \exp\big(-\gamma\,[1 + \alpha\log(1+x)]\big),Πγ​(x)=1−exp(−γ[1+x]),Γγ,α​(x)=1−exp(−γ[1+αlog(1+x)]),

with α,γ>0\alpha, \gamma > 0α,γ>0 and [a][a][a] the integer part of aaa. The first two are continuous; the last two are discrete, with jumps where 1+x1 + x1+x, respectively 1+αlog⁡(1+x)1 + \alpha\log(1+x)1+αlog(1+x), crosses an integer.

The lemmas of §1 use a second normalization, which shifts XXX instead of X−tX - tX−t:

P(X−b(t)a(t)>x  ∣  X>t)=min⁡(1,R(b(t)+xa(t))R(t))→S(x)weakly,(2–3)P\Big(\frac{X - b(t)}{a(t)} > x \;\Big|\; X > t\Big) = \min\Big(1, \frac{R(b(t) + x a(t))}{R(t)}\Big) \to S(x) \quad \text{weakly}, \tag{2–3}P(a(t)X−b(t)​>x​X>t)=min(1,R(t)R(b(t)+xa(t))​)→S(x)weakly,(2–3)

where 1−S1 - S1−S is a nondegenerate distribution function. The two normalizations differ by b(t)↦b(t)+tb(t) \mapsto b(t) + tb(t)↦b(t)+t.

Formalization targets

Goal: Theorem 1 (p. 796)

If F(x)<1F(x) < 1F(x)<1 for all xxx, a(t)>0a(t) > 0a(t)>0, and

Ft(b(t)+xa(t))→G(x)weakly as t→∞F_t\big(b(t) + x a(t)\big) \to G(x) \quad \text{weakly as } t \to \inftyFt​(b(t)+xa(t))→G(x)weakly as t→∞

for a nondegenerate distribution function GGG, then GGG is of type Π\PiΠ, Πγ\Pi_\gammaΠγ​, Γα\Gamma_\alphaΓα​ or Γγ,α\Gamma_{\gamma,\alpha}Γγ,α​ for some α,γ>0\alpha, \gamma > 0α,γ>0.

Milestones (§1, pp. 794–797)

  1. Lemma 1. Under (2), for each continuity point yyy of SSS with 0<S(y)<10 < S(y) < 10<S(y)<1 there are A(y)≥1A(y) \ge 1A(y)≥1 and B(y)B(y)B(y) with
S(x) S(y)=S(B(y)+xA(y))whenever S(x)<1.(4)S(x)\,S(y) = S\big(B(y) + xA(y)\big) \quad \text{whenever } S(x) < 1. \tag{4}S(x)S(y)=S(B(y)+xA(y))whenever S(x)<1.(4)
  1. Corollary. S(x)>0S(x) > 0S(x)>0 for all xxx.
  2. Lemma 2. An unbounded non-increasing HHH on (x0,∞)(x_0, \infty)(x0​,∞) that agrees with SSS where S<1S < 1S<1 and solves H(x)H(y)=H(B(y)+xA(y))H(x)H(y) = H(B(y) + xA(y))H(x)H(y)=H(B(y)+xA(y)) agrees with SSS where H<1H < 1H<1.
  3. Case 1 of the proof: if A(y)=1A(y) = 1A(y)=1 for every yyy in the set YYY of continuity points with S(y)<1S(y) < 1S(y)<1, then 1−S1 - S1−S is of type Π\PiΠ or Πγ\Pi_\gammaΠγ​.
  4. The commutation identity of Case 2: B(y1)+A(y1)B(y2)=B(y2)+A(y2)B(y1)B(y_1) + A(y_1)B(y_2) = B(y_2) + A(y_2)B(y_1)B(y1​)+A(y1​)B(y2​)=B(y2​)+A(y2​)B(y1​) for y1,y2∈Yy_1, y_2 \in Yy1​,y2​∈Y.
  5. Case 2 of the proof: if A(y)>1A(y) > 1A(y)>1 for some y∈Yy \in Yy∈Y, then 1−S1 - S1−S is of type Γα\Gamma_\alphaΓα​ or Γγ,α\Gamma_{\gamma,\alpha}Γγ,α​.
  6. The closing display: each of the four laws G=1−SG = 1 - SG=1−S reproduces itself, min⁡(1,S(B(t)+xA(t))/S(t))=S(x)\min\big(1, S(B(t) + xA(t))/S(t)\big) = S(x)min(1,S(B(t)+xA(t))/S(t))=S(x) for every t>0t > 0t>0 and suitable A(t)>0A(t) > 0A(t)>0, B(t)B(t)B(t); so all four types occur as limits.

Significance

Theorem 1 is to residual lives what the extremal types theorem of Fisher–Tippett and Gnedenko is to maxima: it reduces the asymptotic analysis of the residual life to a four-type list, and with it the question of domains of attraction (§§2–3 of the paper) becomes well posed. The continuous types Π\PiΠ and Γα\Gamma_\alphaΓα​ are, after a change of parameters, the exponential and Pareto members of the generalized Pareto family used to model exceedances over high thresholds; the discrete types Πγ\Pi_\gammaΠγ​ and Γγ,α\Gamma_{\gamma,\alpha}Γγ,α​ show that once a shift is allowed, lattice-like tails produce limits with atoms, a phenomenon that the scale-only Theorem 2 excludes.

The theorem has been proved since 1974. It is not formalized in any proof assistant known to us, and Mathlib has neither weak convergence of distribution functions in the form used here, nor types, nor the residual-life limit laws. A formal development provides these objects, the functional equation (4) and its solution on a half line, and a checked proof that the four-type list is exactly right — including the discrete types, which are easy to lose in an informal treatment.

Difficulty

The obvious approach is to pass to the limit in the identity relating the residual lives at ages ttt and b(t)b(t)b(t), obtaining a Cauchy-type functional equation for SSS, and to solve it. Two features block a direct application of the classical solution. First, the limit is a minimum with 111, so convergence carries no information on the half line where S=1S = 1S=1: equation (4) holds only where S(x)<1S(x) < 1S(x)<1, and it does not determine SSS by itself (the paper exhibits S0(x)=e−xS_0(x) = e^{-x}S0​(x)=e−x for x≥1x \ge 1x≥1, S0=1S_0 = 1S0​=1 for x<1x < 1x<1, which satisfies (4) with A=1A = 1A=1, B(y)=yB(y) = yB(y)=y, yet 1−S01 - S_01−S0​ is of no limit type); Lemma 2 is needed to recover SSS where S=1S = 1S=1. Second, the solutions of the shifted equation φ(x)+φ(y)=φ(B(y)+x)\varphi(x) + \varphi(y) = \varphi(B(y) + x)φ(x)+φ(y)=φ(B(y)+x) for a monotone φ\varphiφ are not only linear: a periodic perturbation is possible, and its analysis produces the discrete laws through the integer part. A proof that assumes continuity of SSS misses Πγ\Pi_\gammaΠγ​ and Γγ,α\Gamma_{\gamma,\alpha}Γγ,α​.

Formalization scope

The law of XXX is a probability measure μ\muμ on R\mathbb RR; R(x)=μ((x,∞))R(x) = \mu((x,\infty))R(x)=μ((x,∞)) and Ft(x)=μ((t,t+x])/μ((t,∞))F_t(x) = \mu((t, t+x])/\mu((t,\infty))Ft​(x)=μ((t,t+x])/μ((t,∞)), with probabilities taken as real numbers. Every statement assumes μ((x,∞))>0\mu((x,\infty)) > 0μ((x,∞))>0 for all xxx, the paper's standing assumption; Lean's division by zero would otherwise make the conditional laws meaningless. The normalizations satisfy a(t)>0a(t) > 0a(t)>0 for all ttt (only large ttt matter). A limit distribution function is the distribution function of a probability measure ν\nuν on R\mathbb RR, so no mass escapes to ±∞\pm\infty±∞; nondegenerate means ν\nuν is not a point mass; the limit tail is S(x)=ν((x,∞))S(x) = \nu((x,\infty))S(x)=ν((x,∞)), which is right-continuous. Weak convergence is convergence at the continuity points of the limit and nowhere else. The integer part is Int.floor. Each limit law is defined to be 000 for x<0x < 0x<0.

Theorem 1 is stated in the normalization (1) of the theorem, the lemmas and cases in the normalization (2) of §1, as printed. Theorem 1 names its fourth family Γα,γ\Gamma_{\alpha,\gamma}Γα,γ​; it is the introduction's Γγ,α\Gamma_{\gamma,\alpha}Γγ,α​. In Lemma 2 the left endpoint x0x_0x0​ may be −∞-\infty−∞ (Case 1 applies the lemma on the whole line), and the condition that B(y)+xA(y)B(y) + xA(y)B(y)+xA(y) lies in (x0,∞)(x_0, \infty)(x0​,∞) for x>x0x > x_0x>x0​ is written out, since (8) presupposes it. "A pair (A(y),B(y))(A(y), B(y))(A(y),B(y)) in Lemma 1" and "A(y)=1A(y) = 1A(y)=1", "A(y)>1A(y) > 1A(y)>1" are stated through pairs satisfying (4); the proof of Lemma 1 shows the pair is unique. The commutation identity is posed without the Case 2 assumption, which its derivation does not use. No hypothesis of the paper is dropped and none is added beyond these readings.

The statement is not trivialized by dropping nondegeneracy (a point-mass limit is always attainable), by requiring convergence at every xxx (which would exclude the discrete types), or by defining the limit laws without the integer part (which would turn the discrete types into continuous ones); the formalization does none of these.

A complete development needs: the residual-life distribution function and the normed tail, weak convergence of distribution functions, types, the four limit laws; then monotone solutions of Cauchy-type functional equations on half lines, with their periodic perturbations. The functional-equation results and the closing-display computations are reusable beyond this mission, for instance for the scale-only Theorem 2 and for the domain-of-attraction results of §§2–3. Proofs of any milestone, of alternative routes to Theorem 1, and of the closing display for each family separately are welcome.

Selected references

  • A. A. Balkema, L. de Haan, Residual Life Time at Great Age, The Annals of Probability 2 (1974), no. 5, 792–804. https://doi.org/10.1214/aop/1176996548 (the source of every statement of this mission: the published article).
  • B. Gnedenko, Sur la distribution limite du terme maximum d'une série aléatoire, Annals of Mathematics 44 (1943), 423–453. https://doi.org/10.2307/1968974
  • J. Pickands III, Statistical Inference Using Extreme Order Statistics, The Annals of Statistics 3 (1975), 119–131. https://doi.org/10.1214/aos/1176343003
  • W. Feller, An Introduction to Probability Theory and Its Applications, Vol. II, Wiley, 1966.
10 thms2 active usersReviewed
CombinatoricsLinear OptimizationOperations Research+1·Captain: mikedeng1

An Additive Algorithm for Solving Linear Programs with Zero-One Variables: In Finitely Many Iterations the Additive Algorithm Yields an Optimal Solution or Proves InfeasibilityResearch Paper

Motivation

Binary decisions arise when a variable records whether a project is selected, a facility is opened, or an action is taken. Linear constraints then describe the resources or conditions those choices must satisfy. Egon Balas's 1965 paper gives a direct algorithm for a finite linear program with zero-one variables: it begins with all variables at zero, adds variables with value one, and uses explicit tests to discard assignments that cannot improve the best feasible assignment found so far. The paper states that the procedure eventually produces an optimal feasible solution or a conclusion that none exists. Its numbered convergence theorem is the target of this mission. Balas (1965)

The result is historically distinct from algorithms that solve a continuous relaxation and then enforce integrality. Balas describes his method as a direct combinatorial search over binary assignments, with additions and subtractions used to update costs and slacks. The theorem concerns the correctness and finite termination of the particular steps printed in the paper, including their backward scan and cancellation rules. The local catalog contains work on branch and bound for a biconvex program, but no existing platform item about a zero-one programming algorithm with these steps; the biconvex result concerns a different model and algorithm. Balas (1965)

Setting

Let NNN be a finite set of binary coordinates and MMM a finite set of constraints. The data are a real matrix A=(aij)i∈M,j∈NA=(a_{ij})_{i\in M,j\in N}A=(aij​)i∈M,j∈N​, a real vector b=(bi)i∈Mb=(b_i)_{i\in M}b=(bi​)i∈M​, and nonnegative objective coefficients cj≥0c_j\ge0cj​≥0. A binary assignment is represented by the set J⊆NJ\subseteq NJ⊆N of coordinates assigned one; all other coordinates are zero. Its slack and cost are

yi(J)=bi−∑j∈Jaij,z(J)=∑j∈Jcj.y_i(J)=b_i-\sum_{j\in J}a_{ij},\qquad z(J)=\sum_{j\in J}c_j.yi​(J)=bi​−j∈J∑​aij​,z(J)=j∈J∑​cj​.

The assignment is feasible when yi(J)≥0y_i(J)\ge0yi​(J)≥0 for every i∈Mi\in Mi∈M. It is optimal when it is feasible and has no greater cost than any other feasible assignment. These are Balas's problem PPP and solutions (1)–(8). The coefficients of AAA and bbb may have either sign; NNN and MMM may be empty. Balas (1965), pp. 519, 523

The algorithm generates assignments J0,J1,…,JsJ_0,J_1,\ldots,J_sJ0​,J1​,…,Js​, starting at J0=∅J_0=\varnothingJ0​=∅. Among the generated feasible assignments, their least cost is the ceiling z∗(s)z^{*(s)}z∗(s); if there are none, z∗(s)=+∞z^{*(s)}=+\inftyz∗(s)=+∞. Each generated assignment has an improving set NpN_pNp​ formed when it first appears. Later steps cancel candidate indices and keep records CksC_k^sCks​ of which values attached to an earlier assignment have been cancelled by the time JsJ_sJs​ is generated. The algorithm either processes the latest assignment, scans earlier strict subsets in descending order, or stops. Its value-based choice rule permits several choices when both value and cost tie. Balas (1965), pp. 523–528

Formalization targets

The paper's two lemmas and Theorem 1 establish the cancellation claims used by its convergence theorem. Lemma 1 says a feasible completion Jt⊃JsJ_t\supset J_sJt​⊃Js​ below the current ceiling adds no index in CsC^sCs; Lemma 2 makes the corresponding assertion for an earlier assignment under its stated complete-cancellation hypothesis. Theorem 1 says that an abandoned assignment has no better feasible completion. The two numbered parts of the convergence proof assert that a single iteration cannot continue indefinitely and that no assignment is generated twice. A remark after (16) records that a feasible generated assignment has an empty improving set. Balas (1965), pp. 529–533

The mission's goal is Convergence Theorem 2:

every run from J0=∅ stops after finitely many steps, with either an optimal feasible assignment or a valid infeasibility verdict.\text{every run from }J_0=\varnothing\text{ stops after finitely many steps, with either an optimal feasible assignment or a valid infeasibility verdict.}every run from J0​=∅ stops after finitely many steps, with either an optimal feasible assignment or a valid infeasibility verdict.

The finite-step assertion includes progress: every reachable state before a stopping situation has a successor. At a stop, z∗(s)=+∞z^{*(s)}=+\inftyz∗(s)=+∞ means no feasible binary assignment exists; if the ceiling is finite, a generated assignment attaining it exists and every generated assignment at that cost is optimal for PPP. These clauses make the paper's two possible outcomes explicit. Balas (1965), Convergence Theorem 2 and step 5a

Significance

The theorem certifies the algorithm as a complete decision and optimization procedure for the stated finite binary program. The infeasibility outcome concerns every possible binary assignment, not only the assignments the algorithm happened to visit. The optimality outcome similarly compares the reported assignment against all feasible assignments. Without these global claims, reaching a stopping situation would only show that the current search path has no remaining candidates. Balas (1965), pp. 526, 533

The result was proved in the 1965 paper. The work here is to state its algorithm and correctness claims in Lean and provide a target for a machine-checked proof; the submitted theorem files are open statements. The finite binary-program model, cost and slack functions, ceiling with infinity, and state-transition vocabulary can also support formal analyses of other exact enumeration procedures. The particular cancellation and backward-scan rules belong to Balas's algorithm. Balas (1965)

Difficulty

It is immediate that there are finitely many binary assignments. That alone does not show finite termination: the paper's step 5 may revisit earlier generated assignments, and the rules must prevent repeated work within one iteration as well as repeated generated assignments across iterations. It also does not justify pruning. When an improving set becomes empty, the remaining challenge is to show that no feasible assignment omitted by the search improves the ceiling. These are the separate claims recorded in parts (a) and (b), Lemmas 1–2, and Theorem 1. Balas (1965), pp. 529–533

Formalization scope

Lean uses Fin n and Fin m for the paper's one-based index sets. A binary assignment is a Finset (Fin n). A general finite zero-one linear program is its own definition; problem PPP adds the paper's standing assumption cj≥0c_j\ge0cj​≥0. There is no positive-size assumption on either index set. The algorithm stores generated assignments, each improving set as formed, cancellation snapshots, current cancellations, and its program point. Slack and cost are recomputed from the assignment by (6) and (21). Reachability is the reflexive transitive closure of the printed steps, and all milestone claims about states are restricted to reachable ones. The strict symbol ⊂\subset⊂ means proper inclusion as the paper's footnote specifies. Balas (1965), pp. 523–525

The ceiling is represented in WithTop ℝ, with ⊤\top⊤ for +∞+\infty+∞. The cost tests (14), (17), (24), and (29) are written additively so they retain the paper's meaning when no feasible assignment has yet been generated. The improving set NpN_pNp​ remains fixed after generation; the step-5 scan uses Nks=Nk−(Cks∪Dks)N_k^s=N_k-(C_k^s\cup D_k^s)Nks​=Nk​−(Cks​∪Dks​) with the stored snapshot CksC_k^sCks​, as in (18). Step 1a cancels the cost-bound indices for every earlier assignment, and steps 6a and 7b resume the scan below the index just checked. The final tie break permits any index still tied after minimizing its cost. “In a finite number of iterations” is encoded as no infinite run plus a next step at each reachable non-stopped state. “No feasible solution” quantifies over all binary assignments. “Abandoned” is the predicate specified before Theorem 1: uku^kuk is abandoned when the algorithm is instructed to stop, or to check some NpsN_p^sNps​ with p<k≤sp<k\le sp<k≤s, including the indices step 5 passes over because their remaining improving set is empty. Lemma 2 reads Cps+1C_p^{s+1}Cps+1​ either as the cancellations accumulated so far during iteration s+1s+1s+1 or as the cancellation records at the transition that obtains us+1u^{s+1}us+1. Balas (1965), pp. 525–533

The paper prints z∗(k)z^{*(k)}z∗(k) in Theorem 1, but its algorithm and proof use the ceiling at the abandonment iteration, z∗(s)z^{*(s)}z∗(s); the Lean theorem states that corrected version and retains the original wording in the milestone record. A transition system that is stuck before a declared stopping situation, a ceiling encoded as a finite real sentinel, or a verdict quantified only over generated assignments would make the goal weaker than the paper's claim. Contributions toward the milestone proofs, state invariants, and reusable finite-search lemmas are in scope. The preliminary reduction of a general binary program to PPP, the efficiency remarks, numerical examples, and the modified algorithm of Remark II are outside this mission. Balas (1965), pp. 519, 528–533

Selected references

  • Egon Balas, An Additive Algorithm for Solving Linear Programs with Zero-One Variables, Operations Research 13(4), 517–546, 1965. DOI: 10.1287/opre.13.4.517
10 thms2 active usersReviewed
Linear OptimizationOperations ResearchProbability·Captain: mikedeng1

A Re-solving Heuristic with Uniformly Bounded Loss for Network Revenue Management 2: Frequent Re-solving Loses at Most O(√T) Against the Deterministic LP, Uniformly in the CapacitiesResearch Paper

Motivation

Network revenue management is the problem of selling several limited, perishable resources (seats on flight legs, hotel room-nights, machine hours) to customers who arrive over time and each want a fixed bundle of them. A seller who accepts every request early may run out of the resources that the most valuable later customers need, and a seller who is too cautious leaves capacity unsold at the end of the horizon. Airlines, hotels and car-rental firms solve instances of this problem daily (Talluri and van Ryzin, 2004).

The exact optimal policy is a dynamic program over the vector of remaining capacities, which is intractable for realistic networks. The standard remedy replaces the random demand by its mean, which gives a linear program, the deterministic LP (DLP), and turns its solution into an admission rule. Its value is an upper bound on what any policy can earn (Gallego and van Ryzin, 1997). Solving the LP once, at time zero, loses O(T)O(\sqrt{T})O(T​) against that bound over a horizon of length TTT. A natural improvement is to re-solve the LP as capacity is consumed.

Timeline of the re-solving question, as the source surveys it (Sec. 1, pp. 3–4):

  • 1997: Gallego and van Ryzin: static policies built from the DLP lose Θ(T)\Theta(\sqrt{T})Θ(T​).
  • 2002: Cooper gives an example in which re-solving the DLP makes booking-limit control worse.
  • 2008: Reiman and Wang re-solve exactly once, at an endogenous random time, with probabilistic allocation, and obtain o(T)o(\sqrt{T})o(T​) loss.
  • 2012: Jasin and Kumar prove that re-solving after every unit of time with probabilistic allocation (the policy FR below) loses O(1)O(1)O(1), provided the DLP solution is nondegenerate. Wu et al. (2015) obtain O(1)O(1)O(1) for one resource, with a constant that blows up as the solution approaches degeneracy.
  • 2018: Bumpensanti and Wang (arXiv:1802.06192) show that FR can lose Ω(T)\Omega(\sqrt{T})Ω(T​) against the hindsight optimum on a degenerate instance, propose a modified policy with O(1)O(1)O(1) loss in all cases, and prove that FR never loses more than O(T)O(\sqrt{T})O(T​) against the DLP. This mission formalizes the last of these results.

Setting

There are nnn customer classes j∈[n]j \in [n]j∈[n] and mmm resources l∈[m]l \in [m]l∈[m]. Over the horizon [0,T][0, T][0,T], class-jjj customers arrive according to independent Poisson processes with rates λj>0\lambda_j > 0λj​>0. Accepting a class-jjj customer earns rj≥0r_j \ge 0rj​≥0 and consumes alj≥0a_{lj} \ge 0alj​≥0 units of each resource lll; A=(alj)A = (a_{lj})A=(alj​) is the bill-of-materials matrix and AjA_jAj​ its jjj-th column. The initial capacity vector is C≥0C \ge 0C≥0. A customer can be accepted only if Aj≤C′A_j \le C'Aj​≤C′ componentwise, where C′C'C′ is the capacity remaining at its arrival.

For a capacity-per-unit-time vector b≥0b \ge 0b≥0, let

v(b)=max⁡{∑j=1nrjxj : ∑j=1nAjxj≤b, 0≤xj≤λj}.v(b) = \max\Big\{ \sum_{j=1}^n r_j x_j \ :\ \sum_{j=1}^n A_j x_j \le b,\ 0 \le x_j \le \lambda_j \Big\}.v(b)=max{j=1∑n​rj​xj​ : j=1∑n​Aj​xj​≤b, 0≤xj​≤λj​}.

The DLP value is vDLP(T,C)=T v(C/T)v^{\mathrm{DLP}}(T, C) = T\, v(C/T)vDLP(T,C)=Tv(C/T).

The Frequent Re-solving policy (FR) divides the horizon into TTT unit periods [t,t+1)[t, t+1)[t,t+1). At the start of period ttt, with remaining capacity C(t)C(t)C(t), it sets b(t)=C(t)/(T−t)b(t) = C(t)/(T - t)b(t)=C(t)/(T−t), computes an optimal solution x(t)x(t)x(t) of the LP with right-hand side b(t)b(t)b(t), and during the period accepts each class-jjj arrival with probability xj(t)/λjx_j(t)/\lambda_jxj​(t)/λj​, subject to the capacity check. Its expected revenue is vFR(T,C)v^{\mathrm{FR}}(T, C)vFR(T,C). The LP may have several optimal solutions; the results hold for every rule choosing among them.

Formalization targets

Goal: Proposition 3

There is a constant MMM, depending only on λ\lambdaλ, rrr and AAA, such that for every integer T≥1T \ge 1T≥1, every capacity C≥0C \ge 0C≥0 and every choice of optimal LP solutions,

vDLP(T,C)−vFR(T,C)≤MT.v^{\mathrm{DLP}}(T, C) - v^{\mathrm{FR}}(T, C) \le M \sqrt{T}.vDLP(T,C)−vFR(T,C)≤MT​.

The content is the uniformity: MMM does not depend on CCC, so the bound holds whether capacity is scarce, abundant, or degenerate for the LP.

Milestones, in the order the proof uses them

  1. Eq. (32), p. 35. The capacity check costs FR at most ∑jrj(log⁡T+1)+∑jrjλj\sum_j r_j(\log T + 1) + \sum_j r_j \lambda_j∑j​rj​(logT+1)+∑j​rj​λj​ relative to the LP revenue it targets:
vFR≥E[∑t=0T−1∑j=1nrjxj(t)]−∑j=1nrj(log⁡T+1)−∑j=1nrjλj.v^{\mathrm{FR}} \ge \mathbb{E}\Big[\sum_{t=0}^{T-1} \sum_{j=1}^n r_j x_j(t)\Big] - \sum_{j=1}^n r_j (\log T + 1) - \sum_{j=1}^n r_j \lambda_j .vFR≥E[t=0∑T−1​j=1∑n​rj​xj​(t)]−j=1∑n​rj​(logT+1)−j=1∑n​rj​λj​.
  1. Eq. (33), p. 35. LP sensitivity in the right-hand side: v(b)−v(b′)≤∑lrmax⁡l(bl−bl′)+v(b) - v(b') \le \sum_l r^l_{\max} (b_l - b'_l)^+v(b)−v(b′)≤∑l​rmaxl​(bl​−bl′​)+ with rmax⁡l=max⁡jrjI(alj>0)/aljr^l_{\max} = \max_j r_j \mathbb{I}(a_{lj} > 0)/a_{lj}rmaxl​=maxj​rj​I(alj​>0)/alj​.
  2. Lemma 8, p. 43 (corrected). E[(bl−bl(t))+]≤Kl∑i=0t−1(T−i−1)−2\mathbb{E}[(b_l - b_l(t))^+] \le K_l \sqrt{\sum_{i=0}^{t-1} (T-i-1)^{-2}}E[(bl​−bl​(t))+]≤Kl​∑i=0t−1​(T−i−1)−2​ with Kl=∑jalj2λjK_l = \sqrt{\sum_j a_{lj}^2 \lambda_j}Kl​=∑j​alj2​λj​​.
  3. p. 36. ∑t=0T−1∑i=0t−1(T−i−1)−2≤2T+2\sum_{t=0}^{T-1} \sqrt{\sum_{i=0}^{t-1} (T-i-1)^{-2}} \le 2\sqrt{T} + \sqrt{2}∑t=0T−1​∑i=0t−1​(T−i−1)−2​≤2T​+2​.
  4. p. 36, explicit bound.
vDLP−vFR≤∑l=1mrmax⁡lKl(2T+2)+n rmax⁡(log⁡T+1)+n rmax⁡λmax⁡.v^{\mathrm{DLP}} - v^{\mathrm{FR}} \le \sum_{l=1}^m r^l_{\max} K_l (2\sqrt{T} + \sqrt{2}) + n\, r_{\max} (\log T + 1) + n\, r_{\max} \lambda_{\max} .vDLP−vFR≤l=1∑m​rmaxl​Kl​(2T​+2​)+nrmax​(logT+1)+nrmax​λmax​.

Significance

The result. Because vDLPv^{\mathrm{DLP}}vDLP bounds the expected revenue of every admissible policy, Proposition 3 says that FR loses at most O(T)O(\sqrt{T})O(T​) against the optimal policy in every instance, degenerate or not. Re-solving therefore never does worse, in order, than solving once. Together with the Ω(T)\Omega(\sqrt{T})Ω(T​) lower bound on a degenerate instance (Proposition 2 of the same paper), it shows that the order T\sqrt{T}T​ is exact for FR. The nondegeneracy assumption of the earlier O(1)O(1)O(1) analysis cannot be dropped. The explicit form (milestone 5) bounds the loss by constants computable from (λ,r,A)(\lambda, r, A)(λ,r,A).

Formalizing it. The result is proved in the source; no part of it is machine-checked. A formalization adds three things. It gives a precise model of an adaptive, randomized admission policy in a Poisson network, which other results on re-solving and bid-price policies can reuse. It gives a checked LP sensitivity bound. And it checks the paper's constants: the printed constant of Lemma 8 is wrong (see Formalization scope), and the mission states the corrected one.

Difficulty

The obvious argument compares FR with the DLP period by period: the LP that FR solves at time ttt differs from the original only in its right-hand side, so the loss should be controlled by how far b(t)b(t)b(t) drifts below b=C/Tb = C/Tb=C/T. Two things break a naive version of this. First, b(t)b(t)b(t) is a ratio whose denominator T−tT - tT−t shrinks to 111, so fluctuations late in the horizon are amplified; a crude bound on the drift at each ttt sums to more than T\sqrt{T}T​. Second, FR's realized consumption is not the LP's target: the capacity check rejects customers, and the LP solutions x(i)x(i)x(i) depend on the whole past, so the consumption in different periods is not independent.

Uniformity in CCC is the whole point. Arguments that rely on a margin between C/TC/TC/T and the degenerate points of the LP, as in the nondegenerate analysis, give constants that blow up as that margin vanishes.

Formalization scope

The source is arXiv:1802.06192v3, whose printed page numbers equal the PDF page numbers. Everything lives in the namespace ResolvingNRM.FRUpper.

  • LP value. v(b)v(b)v(b) is the published piValue A r b lam of RLPBidPrice.Unbiased.Model (a real supremum, equal to the LP maximum for b≥0b \ge 0b≥0).
  • Optimal solutions. The "arg⁡max⁡\arg\maxargmax" of Algorithm 2 is an arbitrary optimal-solution selector sel; every theorem quantifies over all selectors, with constants chosen before the selector.
  • Randomness. Within a period the acceptance probabilities are fixed, so the period's arrivals are represented exactly as a Poisson number of customers in arrival order, with i.i.d. classes of law λj/∑iλi\lambda_j / \sum_i \lambda_iλj​/∑i​λi​ and independent Bernoulli acceptance coins. Expectations are series over this law (windowExp). FR's value is a backward recursion over periods (frTail), and expectations of functions of C(t)C(t)C(t) are a forward recursion (frStateExp).
  • Horizon. TTT is a positive integer; capacities are real vectors.
  • Standing assumptions of p. 7, left implicit there and hypotheses here: λj>0\lambda_j > 0λj​>0, rj≥0r_j \ge 0rj​≥0, alj≥0a_{lj} \ge 0alj​≥0, C≥0C \ge 0C≥0.
  • O(⋅)O(\cdot)O(⋅). "=O(T)= O(\sqrt{T})=O(T​)" is ∃M, ∀ sel,T≥1,C≥0\exists M,\ \forall\, \mathrm{sel}, T \ge 1, C \ge 0∃M, ∀sel,T≥1,C≥0. The paper's threshold T1T_1T1​ is dropped, which is equivalent because 0≤vFR0 \le v^{\mathrm{FR}}0≤vFR and vDLP≤T∑jrjλjv^{\mathrm{DLP}} \le T\sum_j r_j\lambda_jvDLP≤T∑j​rj​λj​.
  • Corrected slip, Lemma 8. The printed Kl=∑jalj2λj2K_l = \sqrt{\sum_j a_{lj}^2 \lambda_j^2}Kl​=∑j​alj2​λj2​​ is false: the proof replaces the conditional variance xj(i)≤λjx_j(i) \le \lambda_jxj​(i)≤λj​ of a Poisson increment by λj2\lambda_j^2λj2​. With one class, one resource, a=1a = 1a=1, λ=0.01\lambda = 0.01λ=0.01, C=λTC = \lambda TC=λT, T=1000T = 1000T=1000 and t=2t = 2t=2, an exact computation gives E[(b−b(2))+]≈1.96⋅10−5\mathbb{E}[(b - b(2))^+] \approx 1.96 \cdot 10^{-5}E[(b−b(2))+]≈1.96⋅10−5, above the printed bound 1.42⋅10−51.42 \cdot 10^{-5}1.42⋅10−5. The mission uses Kl=∑jalj2λjK_l = \sqrt{\sum_j a_{lj}^2 \lambda_j}Kl​=∑j​alj2​λj​​ in Lemma 8 and in the explicit bound.
  • Index slip. The paper's sums ∑l=1L\sum_{l=1}^L∑l=1L​ run over its mmm resources and are read as l∈[m]l \in [m]l∈[m].

A trivializing formalization is ruled out. The constant MMM is chosen before CCC. FR is defined with every optimal LP solution, not only nondegenerate or vertex ones. The capacity check is kept arrival by arrival; without it, FR's expected revenue would equal the LP revenue it targets and the gap would be trivially small.

Contributions welcome on every milestone. The LP sensitivity bound (33) is a statement about linear programs alone and milestone 4 about real numbers alone; both are reusable outside this mission, as is the window model of a randomized admission policy.

Selected references

  • Y. Bumpensanti, H. Wang, A Re-solving Heuristic with Uniformly Bounded Loss for Network Revenue Management, arXiv:1802.06192v3, 2018 (the source of this mission; later in Management Science 66(7), 2020). https://arxiv.org/abs/1802.06192
  • G. Gallego, G. van Ryzin, A Multiproduct Dynamic Pricing Problem and Its Applications to Network Yield Management, Operations Research 45(1), 24–41, 1997.
  • W. L. Cooper, Asymptotic Behavior of an Allocation Policy for Revenue Management, Operations Research 50(4), 720–727, 2002.
  • M. I. Reiman, Q. Wang, An Asymptotically Optimal Policy for a Quantity-Based Network Revenue Management Problem, Mathematics of Operations Research 33(2), 257–282, 2008.
  • S. Jasin, S. Kumar, A Re-Solving Heuristic with Bounded Revenue Loss for Network Revenue Management with Customer Choice, Mathematics of Operations Research 37(2), 313–345, 2012.
  • K. T. Talluri, G. J. van Ryzin, The Theory and Practice of Revenue Management, Springer, 2004.

Bibliographic details of the non-arXiv entries are those of the source's reference list (pp. 24–25).

9 thms1 active userReviewed
Dynamic ProgrammingMachine LearningOperations Research+1·Captain: mikedeng1

Stable Function Approximation in Dynamic Programming I: In a Discounted Finite MDP, Value Iteration Through an Averager Converges to V₀ with ‖V₀ − V*‖ ≤ 2γε/(1 − γ)Research Paper

Motivation

Value iteration computes the optimal value function of a Markov decision process by applying the dynamic programming backup to every state until the values stop changing. When the state space is too large for a lookup table, practitioners replace the table by a function approximator: after each backup, the new values are computed only at a sample of states and an approximator (a neural net, a spline, a nearest-neighbour rule) is fitted to them. This approximate value iteration is the basis of much of reinforcement learning, and in the early 1990s it was known to work well in some experiments and to diverge in others, with no theory separating the two. Boyan and Moore (NIPS 7, 1995) exhibited divergence with linear regression and neural nets, and Tsitsiklis and Van Roy (1996) later studied the same question for feature-based architectures.

Gordon's technical report (CMU-CS-95-103, 1995; a shorter, differently numbered version appeared at ICML 1995) isolated a property of the approximator that guarantees convergence: the approximator must not exaggerate differences between target value functions in max norm. It identified a broad class with this property, the averagers (k-nearest-neighbour, kernel averaging, linear and bilinear interpolation on a mesh), and proved that in a discounted problem approximate value iteration through an averager always converges, with an explicit error bound. This mission formalizes that discounted theory: the report's §2–§3 and its error bound of §6.1.

Setting

A finite Markov decision process MMM has states 1,…,n1,\dots,n1,…,n, a finite nonempty set U(i)U(i)U(i) of actions at each state iii, an expected one-step cost ciac_{ia}cia​ for action aaa at state iii, and transition probabilities paij≥0p_{aij}\ge0paij​≥0 with ∑jpaij=1\sum_j p_{aij}=1∑j​paij​=1. It is discounted with factor 0≤γ<10\le\gamma<10≤γ<1. A value function is a vector V∈RnV\in\mathbb R^nV∈Rn, measured in the max norm ∥V∥=max⁡i∣V(i)∣\|V\|=\max_i|V(i)|∥V∥=maxi​∣V(i)∣.

The parallel value backup operator TMT_MTM​ updates every state at once:

(TMV)(i)=min⁡a∈U(i)(cia+γ∑j=1npaijV(j)).(T_MV)(i)=\min_{a\in U(i)}\Big(c_{ia}+\gamma\sum_{j=1}^n p_{aij}V(j)\Big).(TM​V)(i)=a∈U(i)min​(cia​+γj=1∑n​paij​V(j)).

Its fixed point V∗V^*V∗ is the optimal value function, the minimal expected discounted cost from each state.

A function approximator is studied through its mapping MFM_FMF​: the function sending a vector of target values to the vector of fitted values. Two operators MFM_FMF​ and TTT are compatible if the iterates (MF∘T)k(x0)(M_F\circ T)^k(x_0)(MF​∘T)k(x0​) converge from every initial guess x0x_0x0​.

An averager AAA is given by constants kik_iki​ and nonnegative weights βi,βij\beta_i,\beta_{ij}βi​,βij​ with βi+∑jβij=1\beta_i+\sum_j\beta_{ij}=1βi​+∑j​βij​=1 for every iii; its mapping is

MA(Y)i=βiki+∑j=1nβijYj.M_A(Y)_i=\beta_ik_i+\sum_{j=1}^n\beta_{ij}Y_j .MA​(Y)i​=βi​ki​+j=1∑n​βij​Yj​.

The weights are fixed in advance and do not depend on the targets YYY.

Formalization targets

Goal: Theorem 6.2 (p. 12)

Let VAV^AVA be any fixed point of MAM_AMA​ and ε=∥VA−V∗∥\varepsilon=\|V^A-V^*\|ε=∥VA−V∗∥. Then there is V0V_0V0​ such that (TM∘MA)k(V)→V0(T_M\circ M_A)^k(V)\to V_0(TM​∘MA​)k(V)→V0​ from every initial guess VVV, and

∥V0−V∗∥≤2γε1−γ.\|V_0-V^*\|\le\frac{2\gamma\varepsilon}{1-\gamma}.∥V0​−V∗∥≤1−γ2γε​.

The goal has two parts: convergence from every start to a common limit V0V_0V0​, and the error bound on that limit.

Milestones

  1. Theorem 2.2, first clause (p. 4). ∥TMV−TMW∥≤γ∥V−W∥\|T_MV-T_MW\|\le\gamma\|V-W\|∥TM​V−TM​W∥≤γ∥V−W∥.
  2. Theorem 3.2 (p. 7). MAM_AMA​ is a max-norm nonexpansion, ∥MA(Y)−MA(Z)∥≤∥Y−Z∥\|M_A(Y)-M_A(Z)\|\le\|Y-Z\|∥MA​(Y)−MA​(Z)∥≤∥Y−Z∥, and is compatible with TMT_MTM​ for every discounted MDP.
  3. Theorem 3.1 (p. 5). If MFM_FMF​ is any max-norm nonexpansion, then MFM_FMF​ is compatible with TMT_MTM​ and ∥MF(TMV)−MF(TMW)∥≤γ∥V−W∥\|M_F(T_MV)-M_F(T_MW)\|\le\gamma\|V-W\|∥MF​(TM​V)−MF​(TM​W)∥≤γ∥V−W∥.
  4. Corollary 3.1 (p. 6). There is V∞V_\inftyV∞​ with ∥(MF∘TM)k(V)−V∞∥≤γk∥V−V∞∥\|(M_F\circ T_M)^k(V)-V_\infty\|\le\gamma^k\|V-V_\infty\|∥(MF​∘TM​)k(V)−V∞​∥≤γk∥V−V∞​∥ for all VVV and kkk.

A further item, not a milestone, is the display after the proof of Theorem 6.2 (p. 13), the bound on the fitted output: ∥V∗−MA(V0)∥≤2ε+2γε/(1−γ)\|V^*-M_A(V_0)\|\le2\varepsilon+2\gamma\varepsilon/(1-\gamma)∥V∗−MA​(V0​)∥≤2ε+2γε/(1−γ).

Significance

Theorem 6.2 gives a guarantee that depends only on how well the approximator can represent V∗V^*V∗, not on how the iteration is started: if some fixed point of the averager lies within ε\varepsilonε of V∗V^*V∗, approximate value iteration finds a function within 2γε/(1−γ)2\gamma\varepsilon/(1-\gamma)2γε/(1−γ) of V∗V^*V∗. Theorems 3.1 and 3.2 explain why: an averager is a max-norm nonexpansion, and composing a nonexpansion with a γ\gammaγ-contraction leaves a γ\gammaγ-contraction. Together they separate the approximators that are safe to use with value iteration from those that are not (linear regression is not a nonexpansion: the report's Figure 2 shows it can expand max-norm distances).

All results of this mission are proved in the report; none is open. The contraction of the discounted Bellman operator and the identification of its fixed point with the optimal value function are proved on Prove2Me (BertsekasDP.discounted_main_theorem, used here as a reference item). No machine-checked proof of Gordon's averager results or of the 2γε/(1−γ)2\gamma\varepsilon/(1-\gamma)2γε/(1−γ) bound is known to exist; this mission produces one, on top of the published finite MDP model.

Difficulty

Each step is short on paper; the difficulty is in the bookkeeping that a formal proof cannot skip. The nonexpansion of an averager rests on nonnegative weights summing to at most one, which must be extracted from the row constraint βi+∑jβij=1\beta_i+\sum_j\beta_{ij}=1βi​+∑j​βij​=1 in the max norm on Rn\mathbb R^nRn. The goal's convergence clause asks for one limit V0V_0V0​ shared by all initial guesses, which needs completeness of Rn\mathbb R^nRn and the contraction-mapping theorem applied to TM∘MAT_M\circ M_ATM​∘MA​, not to TMT_MTM​. The error bound compares three different fixed points (V∗V^*V∗ of TMT_MTM​, VAV^AVA of MAM_AMA​, V0V_0V0​ of TM∘MAT_M\circ M_ATM​∘MA​) in a chain of triangle inequalities. The order of composition matters throughout: the compatibility results iterate MF∘TMM_F\circ T_MMF​∘TM​ (fit after the backup), while the goal iterates TM∘MAT_M\circ M_ATM​∘MA​ (back up after the fit), and the two may not be interchanged.

Formalization scope

  • The MDP is the published BertsekasSSPModel (Fin n states, a finite action type, nonempty admissible action sets U(i)U(i)U(i), costs g, transition probabilities p), and TMT_MTM​ is its BertsekasDiscountedBellmanOp M γ. That model allows substochastic rows; every statement adds the hypothesis ∑jpaij=1\sum_j p_{aij}=1∑j​paij​=1 for admissible aaa, which makes it the report's MDP. Action sets may depend on the state, a harmless generalization of the report's single action set. The initial-state distribution S0S_0S0​ never enters a statement and is omitted.
  • The discount satisfies 0≤γ<10\le\gamma<10≤γ<1 in every item. Theorem 6.2's page says only "with discount factor γ\gammaγ"; it belongs to the report's discounted discussion and its proof uses that TMT_MTM​ is a γ\gammaγ-contraction.
  • ∥⋅∥\|\cdot\|∥⋅∥ on Fin n → ℝ is Mathlib's sup norm, i.e. the max norm.
  • V∗V^*V∗ is a hypothesis: a fixed point of TMT_MTM​. Theorem 2.2's last clause, proved on the platform as BertsekasDP.discounted_main_theorem, identifies it with the optimal value function.
  • The averager acts on whole value functions Rn→Rn\mathbb R^n\to\mathbb R^nRn→Rn, indexed by the states. The report's approximator fits a sample X0X_0X0​ of states; ignoring the value at a state jjj outside the sample is the special case βij=0\beta_{ij}=0βij​=0.
  • Theorem 3.1 is printed with "X=S×AX=S\times AX=S×A" and MF∈R∣X∣↦R∣X∣M_F\in\mathbb R^{|X|}\mapsto\mathbb R^{|X|}MF​∈R∣X∣↦R∣X∣; since TMT_MTM​ acts on value functions of the state, MFM_FMF​ is stated on Rn\mathbb R^nRn.
  • "Converges at the rate γ\gammaγ" (Corollary 3.1) is the geometric rate of the contraction-mapping theorem, γk\gamma^kγk times the initial distance to the limit.
  • Theorem 6.2 keeps ε=∥VA−V∗∥\varepsilon=\|V^A-V^*\|ε=∥VA−V∗∥ as an equality, as printed, and its conclusion keeps the convergence clause. A statement asserting only the existence of some V0V_0V0​ with ∥V0−V∗∥≤2γε/(1−γ)\|V_0-V^*\|\le2\gamma\varepsilon/(1-\gamma)∥V0​−V∗∥≤2γε/(1−γ) would be trivial (V0=V∗V_0=V^*V0​=V∗) and is not the theorem.
  • Lemma 2.1 and the Contraction Mapping theorem (Theorem 2.1) are in Mathlib (LipschitzWith.comp, ContractingWith) and are not posed.

Proofs of any item are welcome, as are reusable lemmas on max-norm nonexpansions of row-stochastic linear maps, which also serve the nondiscounted companion mission (Stable Function Approximation in Dynamic Programming II).

Selected references

  • G. J. Gordon, Stable Function Approximation in Dynamic Programming, Technical Report CMU-CS-95-103, Carnegie Mellon University, 1995; shorter version in Machine Learning Proceedings 1995 (ICML), 1995. https://doi.org/10.1016/B978-1-55860-377-6.50040-2
  • D. P. Bertsekas and J. N. Tsitsiklis, Parallel and Distributed Computation: Numerical Methods, Prentice Hall, 1989 (the report's [BT89]; no DOI).
  • J. A. Boyan and A. W. Moore, Generalization in Reinforcement Learning: Safely Approximating the Value Function, Advances in Neural Information Processing Systems 7, MIT Press, 1995 (the report's [BM95]).
  • J. N. Tsitsiklis and B. Van Roy, Feature-Based Methods for Large Scale Dynamic Programming, Machine Learning 22, 1996, pp. 59–94. https://doi.org/10.1007/BF00114724
8 thms3 active usersReviewed
Operations ResearchStochastic Systems·Captain: mikedeng1

Extensions of the Queueing Relations L = λW and H = λG: Under (14) and (15) the Time Average H(t) Converges if and only if the Customer Average G(s) Does, and Then H = λGResearch Paper

Motivation

Queueing results often relate an average accumulated over customers to an average accumulated over time. In the familiar relation L=λWL=\lambda WL=λW, the long-run average number in a system equals the arrival rate times the average time spent there. Glynn and Whitt study a broader relation, H=λGH=\lambda GH=λG, that can represent queue lengths and waiting times but also costs, work, and other cumulative inputs. Their framework is deterministic: a stochastic model may supply a sample path, yet the central comparison is a statement about functions on that path. This lets the same theorem apply to different queueing models without choosing a probability law for each one. Glynn and Whitt (1989)

The paper asks for more than the usual forward implication from a customer average to a time average. Its main theorem identifies conditions under which either average has a finite limit exactly when the other does. It also compares lim inf and lim sup when ordinary limits fail to exist. Both questions matter when sample paths fluctuate: convergence of one average cannot simply be inferred from a visual similarity between the two ways of indexing the input. Glynn and Whitt (1989), §§1–2

Setting

A cumulative input is a real-valued function F(s,t)F(s,t)F(s,t) on [0,∞)×[0,∞)[0,\infty)\times[0,\infty)[0,∞)×[0,∞), nondecreasing separately in the customer coordinate sss and the time coordinate ttt. Its marginal limits F(s,∞)F(s,\infty)F(s,∞) and F(∞,t)F(\infty,t)F(∞,t) are finite for every fixed argument. The first counts all eventual input associated with customers through index sss; the second counts all input accumulated through time ttt. The marginal averages are

G(s)=F(s,∞)s,H(t)=F(∞,t)t.G(s)=\frac{F(s,\infty)}{s},\qquad H(t)=\frac{F(\infty,t)}{t}.G(s)=sF(s,∞)​,H(t)=tF(∞,t)​.

The paper permits cumulative inputs that are not distribution functions of measures on rectangles. In particular, it does not require a rectangle-increment inequality or nonnegative values of FFF. The finite marginal limits and monotonicity are the actual assumptions of its general framework. Glynn and Whitt (1989), p. 635, (1)

A time change Ti(s)T_i(s)Ti​(s), for i=1,2i=1,2i=1,2, is finite, nonnegative, nondecreasing, and right-continuous, and tends to infinity with sss. Its right-continuous inverse is Si(t)=inf⁡{s≥0:Ti(s)>t}S_i(t)=\inf\{s\geq0:T_i(s)>t\}Si​(t)=inf{s≥0:Ti​(s)>t}. The two time changes may differ. Both have the same asymptotic rate Ti(s)/s→λ−1T_i(s)/s\to\lambda^{-1}Ti​(s)/s→λ−1 for a positive finite λ\lambdaλ. The paper's two approximation conditions are

F(s,T1(s−))−F(∞,T1(s−))s⟶0(14),F(s,∞)−F(s,T2(s))s⟶0(15),\frac{F(s,T_1(s-))-F(\infty,T_1(s-))}{s}\longrightarrow0 \quad(14), \qquad \frac{F(s,\infty)-F(s,T_2(s))}{s}\longrightarrow0 \quad(15),sF(s,T1​(s−))−F(∞,T1​(s−))​⟶0(14),sF(s,∞)−F(s,T2​(s))​⟶0(15),

as s→∞s\to\inftys→∞, where T1(s−)T_1(s-)T1​(s−) is the left limit. Condition (14) concerns input already present by a left-limit time; condition (15) concerns input not yet present by a right-limit time. Glynn and Whitt (1989), p. 638, (3), (14)–(15)

Formalization targets

One-sided asymptotic bounds

With only (14) and the rate for T1T_1T1​, the corrected upper bounds are

lim inf⁡H≤lim inf⁡λG,lim sup⁡H≤lim sup⁡λG.\liminf H\leq\liminf \lambda G,\qquad \limsup H\leq\limsup \lambda G.liminfH≤liminfλG,limsupH≤limsupλG.

With only (15) and the rate for T2T_2T2​, the corrected lower bounds reverse both inequalities. The two bounds remain useful separately when only one approximation condition holds. Their lim inf and lim sup may be infinite. Glynn and Whitt (1989), p. 639, Theorem 1(a)–(b) and Remark 2

Equality of asymptotic bounds and finite limits

Under both conditions, Theorem 1(c) asserts equality of the respective lim inf and lim sup. The mission goal is Theorem 1(f): for finite real limits,

H(t)→h⟺G(s)→g,and whenever these limits exist, h=λg.H(t)\to h\quad\Longleftrightarrow\quad G(s)\to g, \qquad\text{and whenever these limits exist, }h=\lambda g.H(t)→h⟺G(s)→g,and whenever these limits exist, h=λg.

Here the equivalence means existence of finite limits, with the second clause identifying their values. The lim inf and lim sup statement is retained as a milestone because it also covers nonconvergent paths. Glynn and Whitt (1989), p. 639, Theorem 1(c), (f)

Significance

The goal gives a two-way transfer between customer-indexed and time-indexed long-run averages. If an application establishes one finite average, the theorem supplies the other and fixes its value. The one-sided milestones give meaningful bounds when only one approximation condition is available; the lim inf and lim sup milestone retains information when neither average converges. These outcomes are stated for a general cumulative input, so applications can supply their own FFF, T1T_1T1​, and T2T_2T2​ without changing the theorem. Glynn and Whitt (1989), §§2–4

The paper proves these results on paper. The formalization target is a machine-checked interface for the paper's deterministic framework, its inversion lemmas, its asymptotic inequalities, and the two-way limit theorem. At this drafting stage the Lean theorem statements compile with proof placeholders; no machine-checked proofs of these new statements are claimed. The definitions and inverse-rate lemma can be reused in other sample-path results.

Difficulty

The two marginal averages examine different slices of FFF, and a time change may jump or have flat intervals. A direct substitution of t=Ti(s)t=T_i(s)t=Ti​(s) does not give an equality between F(s,∞)F(s,\infty)F(s,∞) and F(∞,t)F(\infty,t)F(∞,t) under the paper's assumptions. The left limit in (14) and the value in (15) also behave differently at jumps. The inverse SiS_iSi​ connects the coordinates, but its boundary behavior and rate must be handled before comparing the averages. These issues are present even without stochastic randomness. Glynn and Whitt (1989), pp. 638–639

Formalization scope

Lean represents s,ts,ts,t by nonnegative real numbers and FFF by a real-valued function with separate monotonicity and bounded marginal ranges. Real suprema represent F(s,∞)F(s,\infty)F(s,∞) and F(∞,t)F(\infty,t)F(∞,t); the boundedness fields ensure those suprema are the paper's finite limits. The inverse is an infimum of a nonempty set because Ti→∞T_i\to\inftyTi​→∞. The left limit is the supremum over earlier nonnegative arguments, with T(0−)=0T(0-)=0T(0−)=0. Ratios at zero use Lean's total division convention, but every ratio assertion is asymptotic at infinity.

Lim inf and lim sup are taken in the extended reals so an unbounded average retains an infinite limit. Multiplication by λ\lambdaλ happens in the reals before conversion. Ordinary limits in Theorem 1(f) are finite real limits. The two time changes are independent and share only the positive rate λ\lambdaλ. The goal assumes only (14), (15), and the stated time-change rates; it does not assume its own inverse-rate or asymptotic conclusions. No nonnegativity or rectangle inequality is imposed on FFF.

Theorem 1(a) and (b) have their hypothesis pairing reversed in print. The formalized one-sided bounds use the corrected pairing, and the milestone text preserves the printed source for audit. The intermediate expressions involving G(Si(t))G(S_i(t))G(Si​(t)) are excluded from the corrected statements because the framework does not assume customer-coordinate right continuity. Theorem 1(c) and (f) use both conditions and are true as printed. The scope includes the definitions, Lemmas 1–2, corrected parts (a)–(b), and parts (c) and (f). Contributions toward their proofs and reusable time-change lemmas are welcome. Glynn and Whitt (1989), p. 639, Theorem 1

Selected references

  • P. W. Glynn and W. Whitt, Extensions of the Queueing Relations L = λW and H = λG, Operations Research 37(4):634–644, 1989. DOI: 10.1287/opre.37.4.634
9 thms1 active userReviewed
CombinatoricsOperations ResearchOptimization·Captain: mikedeng1

Optimization and Approximation in Deterministic Sequencing and Scheduling: A Survey 1: The Optimal Two-Machine Open Shop Makespan Is max{T₁, T₂, maxⱼ(aⱼ + bⱼ)}Research Paper

Motivation

Shop scheduling asks how to sequence jobs that each need processing on several machines. In an open shop, a job's operations may be executed in any order, as in testing stations, repair bays, or classroom and examination timetables, where the order in which a candidate visits the stations is irrelevant. The objective studied here is the makespan Cmax⁡C_{\max}Cmax​, the time at which the last operation finishes.

The survey of Graham, Lawler, Lenstra and Rinnooy Kan (Ann. Discrete Math. 5, 1979) introduced the three-field notation α∣β∣γ\alpha|\beta|\gammaα∣β∣γ that the scheduling literature still uses, and classified the complexity of the problems it names. For the open shop, its §5.2.1 presents a simplified exposition of the result of Gonzalez and Sahni (J. ACM 23, 1976): with two machines and no preemption, the obvious lower bound on the makespan is always achieved. The same page records that the three-machine case O3∥Cmax⁡O3\|C_{\max}O3∥Cmax​ is binary NP-hard, so two machines is exactly where the problem is easy.

Timeline. Gonzalez and Sahni (1976) gave the linear-time algorithm for O2∥Cmax⁡O2\|C_{\max}O2∥Cmax​, proved NP-hardness for O3∥Cmax⁡O3\|C_{\max}O3∥Cmax​, and gave a polynomial algorithm for the preemptive problem O∣pmtn∣Cmax⁡O|pmtn|C_{\max}O∣pmtn∣Cmax​. Graham et al. (1979, §5.2.1) gave the shorter construction formalized here, and observed (§5.2.2) that it implies preemption brings no advantage for m=2m = 2m=2. Lenstra (cited as forthcoming in the survey) showed O2∣rj∣Cmax⁡O2|r_j|C_{\max}O2∣rj​∣Cmax​, O2∣tree∣Cmax⁡O2|tree|C_{\max}O2∣tree∣Cmax​ and O∥Cmax⁡O\|C_{\max}O∥Cmax​ unary NP-hard.

Setting

There are nnn jobs J1,…,JnJ_1, \dots, J_nJ1​,…,Jn​ and two machines M1M_1M1​, M2M_2M2​. Job JjJ_jJj​ has an operation on M1M_1M1​ of length aj≥0a_j \ge 0aj​≥0 and an operation on M2M_2M2​ of length bj≥0b_j \ge 0bj​≥0. There is no preemption, and every job is available at time 000. A schedule assigns start times s1(j)s_1(j)s1​(j) and s2(j)s_2(j)s2​(j) to the two operations of JjJ_jJj​, which then occupy [s1(j),s1(j)+aj)[s_1(j), s_1(j)+a_j)[s1​(j),s1​(j)+aj​) on M1M_1M1​ and [s2(j),s2(j)+bj)[s_2(j), s_2(j)+b_j)[s2​(j),s2​(j)+bj​) on M2M_2M2​.

A schedule is feasible if

  1. all start times are nonnegative;
  2. each machine processes at most one job at a time: the intervals of distinct jobs on the same machine do not overlap;
  3. each job is processed on at most one machine at a time: the two intervals of the same job do not overlap, in either order.

Write T1=∑jajT_1 = \sum_j a_jT1​=∑j​aj​ and T2=∑jbjT_2 = \sum_j b_jT2​=∑j​bj​ for the two machine loads. The survey's construction uses the sets

A={Jj∣aj≥bj},B={Jj∣aj<bj},A = \{J_j \mid a_j \ge b_j\}, \qquad B = \{J_j \mid a_j < b_j\},A={Jj​∣aj​≥bj​},B={Jj​∣aj​<bj​},

two distinct jobs JrJ_rJr​, JlJ_lJl​ with ar≥max⁡Jj∈Abja_r \ge \max_{J_j \in A} b_jar​≥maxJj​∈A​bj​ and bl≥max⁡Jj∈Bajb_l \ge \max_{J_j \in B} a_jbl​≥maxJj​∈B​aj​, and A′=A−{Jr,Jl}A' = A - \{J_r, J_l\}A′=A−{Jr​,Jl​}, B′=B−{Jr,Jl}B' = B - \{J_r, J_l\}B′=B−{Jr​,Jl​}.

Formalization targets

Goal: the optimal makespan

Cmax⁡∗=max⁡{T1, T2, max⁡j (aj+bj)},C^*_{\max} = \max\Big\{T_1,\ T_2,\ \max_j\,(a_j + b_j)\Big\},Cmax∗​=max{T1​, T2​, jmax​(aj​+bj​)},

and the optimum is attained. Formally, for every T≥0T \ge 0T≥0: a feasible schedule completing every operation by TTT exists if and only if T1≤TT_1 \le TT1​≤T, T2≤TT_2 \le TT2​≤T and aj+bj≤Ta_j + b_j \le Taj​+bj​≤T for all jjj. The goal mentions neither AAA, BBB, JrJ_rJr​, JlJ_lJl​ nor the case analysis; those are the milestones.

Milestones (in the order of the argument)

  1. Two distinct jobs JrJ_rJr​, JlJ_lJl​ with the required bounds exist when n≥2n \ge 2n≥2.
  2. Fig. 5.1: the blocks B′∪{Jl}B' \cup \{J_l\}B′∪{Jl​} and A′∪{Jr}A' \cup \{J_r\}A′∪{Jr​}, with A′A'A′ and B′B'B′ in arbitrary order, have feasible staircase schedules without idle time.
  3. Fig. 5.2: if T1−al≥T2−brT_1 - a_l \ge T_2 - b_rT1​−al​≥T2​−br​, the blocks combine into a feasible schedule of all jobs ending by T1+brT_1 + b_rT1​+br​.
  4. Case (1): if moreover ar≤T2−bra_r \le T_2 - b_rar​≤T2​−br​, some feasible schedule has length at most max⁡{T1,T2}\max\{T_1, T_2\}max{T1​,T2​}.
  5. Case (2): if moreover ar>T2−bra_r > T_2 - b_rar​>T2​−br​, some feasible schedule has length at most max⁡{T1,ar+br}\max\{T_1, a_r + b_r\}max{T1​,ar​+br​}.
  6. The symmetric case T1−al<T2−brT_1 - a_l < T_2 - b_rT1​−al​<T2​−br​: some feasible schedule has length at most max⁡{T1,T2,al+bl}\max\{T_1, T_2, a_l + b_l\}max{T1​,T2​,al​+bl​}.
  7. The lower bound: every feasible schedule has Cmax⁡≥max⁡{T1,T2,max⁡j(aj+bj)}C_{\max} \ge \max\{T_1, T_2, \max_j(a_j + b_j)\}Cmax​≥max{T1​,T2​,maxj​(aj​+bj​)}.

Significance

The result. The theorem gives a closed form for the optimal makespan of a two-machine open shop, together with a linear-time construction of an optimal schedule. The survey uses it immediately: since the bound is also a lower bound for preemptive schedules, O2∣pmtn∣Cmax⁡O2|pmtn|C_{\max}O2∣pmtn∣Cmax​ is solved by the same schedules, so preemption gives no advantage on two machines (§5.2.2). It is the standard example of a shop problem whose trivial lower bound is tight, and the contrast with the binary NP-hard O3∥Cmax⁡O3\|C_{\max}O3∥Cmax​ marks the complexity boundary for nonpreemptive open shops.

Formalizing it. The result is classical and proved on paper; no machine-checked proof is known to exist on this platform. The mission produces a reusable model of nonpreemptive two-machine open-shop schedules with real processing times, a verified lower bound, and a verified constructive argument. Unlike many existence-of-schedule results, the survey's construction is explicit (orders and start times), so it can be formalized directly rather than through an abstract existence argument.

Difficulty

The lower bound is the easy half. The difficulty is the construction: a schedule must meet the bound simultaneously on both machines and for every job. The natural first idea, running every job on M1M_1M1​ then M2M_2M2​ in some order (a flow-shop schedule), fails: Johnson's rule then gives a makespan that can exceed max⁡{T1,T2,max⁡j(aj+bj)}\max\{T_1, T_2, \max_j(a_j+b_j)\}max{T1​,T2​,maxj​(aj​+bj​)}, because the open shop needs some job to visit M2M_2M2​ first. The survey's construction moves exactly one job, JrJ_rJr​, to the front of M2M_2M2​, and its correctness depends on the choice of JrJ_rJr​ and JlJ_lJl​ and on the case split on T1−alT_1 - a_lT1​−al​ versus T2−brT_2 - b_rT2​−br​. Figures 5.3 and 5.4 are drawn for T1≥T2T_1 \ge T_2T1​≥T2​; in the other subcases the start times shown in the figures need adjustment, and the formal statements of the cases assert lengths rather than the figures' exact start times.

Formalization scope

All declarations live in the namespace SchedSurvey.O2. Jobs are Fin n, 0-based (JjJ_jJj​ is index j−1j-1j−1). Processing times and start times are real numbers with aj,bj≥0a_j, b_j \ge 0aj​,bj​≥0; the survey's integer data are a special case, and every claim of §5.2.1 holds over the reals. A schedule is a pair of start-time functions s₁ s₂ : Fin n → ℝ. Interval non-overlap is s + p ≤ s' ∨ s' + p' ≤ s, so touching intervals are allowed and a zero-length operation occupies nothing. Feasibility (IsFeasible) contains both disjointness constraints of §2.1, the machine constraint and the job constraint, with the two operations of a job in either order. The job constraint is essential: without it the optimum would be max⁡{T1,T2}\max\{T_1, T_2\}max{T1​,T2​} and the goal false.

"Length at most LLL" is CompletesBy a b S L: every operation ends by LLL. Optimality is stated in threshold form, which avoids taking a supremum or infimum over a possibly empty set and is equivalent to "Cmax⁡∗C^*_{\max}Cmax∗​ equals the maximum and is attained". A maximum over AAA or BBB appears as a bound on every member, which is also correct for empty AAA or BBB. The orders of A′A'A′ and B′B'B′ are duplicate-free lists whose members are exactly those sets; back-to-back start times are given by contigStart.

The milestone on the choice of JrJ_rJr​, JlJ_lJl​ assumes n≥2n \ge 2n≥2, which the page presupposes; the goal does not, and covers n≤1n \le 1n≤1 as well. The lower bound assumes T≥0T \ge 0T≥0, which matters only for n=0n = 0n=0.

A trivializing formalization is ruled out: feasibility includes both disjointness constraints and nonnegative start times, the threshold is quantified over all T≥0T \ge 0T≥0, and no constant is fixed.

Contributions welcome: proofs of the lower bound (a sum of disjoint intervals inside [0,T][0, T][0,T]), of the list-based block lemmas, of the case lemmas, and of the goal from them. The interval and back-to-back-schedule lemmas are reusable for other shop problems.

Selected references

  • R.L. Graham, E.L. Lawler, J.K. Lenstra, A.H.G. Rinnooy Kan, Optimization and approximation in deterministic sequencing and scheduling: a survey, Annals of Discrete Mathematics 5 (1979) 287–326. https://doi.org/10.1016/S0167-5060(08)70356-X
  • T. Gonzalez, S. Sahni, Open shop scheduling to minimize finish time, Journal of the ACM 23(4) (1976) 665–679. https://doi.org/10.1145/321978.321985
  • S.M. Johnson, Optimal two- and three-stage production schedules with setup times included, Naval Research Logistics Quarterly 1 (1954) 61–68. https://doi.org/10.1002/nav.3800010110
9 thms1 active userReviewed
Convex OptimizationOperations ResearchOptimization+1·Captain: mikedeng1

Deterministic Equivalents for Optimizing and Satisficing under Chance Constraints 2: The Fractional P-Model Program (38) Has the Same Supremum as the Convex Program (39)Research Paper

Motivation

A chance constraint limits the probability of violating a requirement rather than requiring that requirement to hold for every realization of uncertain data. Charnes and Cooper developed deterministic optimization problems for several ways of judging decisions under such constraints. Their P model gives a satisficing objective: increase the probability of reaching a specified aspiration level while meeting prescribed reliability levels for the resource constraints. The paper's concrete decision rule makes the decision vector depend linearly on the random right-hand side, and its P-model section moves from a fractional deterministic program to a convex one. The result explains how a risk-adjusted ratio can be optimized without retaining a fractional objective. The source is Charnes and Cooper, 1963, pp. 30–33, especially equations (35) and (38)–(39b).

The related linear-fractional change of variables was already being used for linear programs Charnes and Cooper, 1962; the present section applies it to constraints built from second moments rather than linear equations. That distinction matters because the normalized feasible set contains a boundary at zero scale, and because second-moment inequalities require their own convexity claim. The paper cites fractional programming results for its local-to-global assertion about (38); the mission focuses on its explicit transformed program (39). Charnes and Cooper, 1963, p. 32.

Setting

Let m,nm,nm,n be positive integers and (Ω,P)(\Omega,P)(Ω,P) a probability space. A fixed real m×nm\times nm×n matrix AAA has rows ai′a_i'ai′​. Random vectors b:Ω→Rmb:\Omega\to\mathbb R^mb:Ω→Rm and c:Ω→Rnc:\Omega\to\mathbb R^nc:Ω→Rn give the right-hand side and objective coefficients. The paper restricts decisions to the linear decision rule x=Dbx=Dbx=Db, where the real n×mn\times mn×m matrix DDD is chosen before bbb is realized. Write μb=E[b]\mu_b=E[b]μb​=E[b] and μc=E[c]\mu_c=E[c]μc​=E[c]. A number z0z_0z0​ is the given aspiration value. For each row iii, its reliability level αi\alpha_iαi​ is strictly between 1/21/21/2 and 111, and Ki=Φ−1(αi)>0K_i=\Phi^{-1}(\alpha_i)>0Ki​=Φ−1(αi​)>0 is the corresponding standard-normal quantile. These are the objects of equations (5), (19b), (21), and (27) in Charnes and Cooper, 1963.

The residual ai′Db−bia_i'Db-b_iai′​Db−bi​ has raw second moment σi2(D)=E[(ai′Db−bi)2]\sigma_i^2(D)=E[(a_i'Db-b_i)^2]σi2​(D)=E[(ai′​Db−bi​)2] and negative mean μi(D)=μbi−ai′Dμb\mu_i(D)=\mu_{b_i}-a_i'D\mu_bμi​(D)=μbi​​−ai′​Dμb​. The aspiration error has raw second moment V(D)=E[(c′Db−z0)2]V(D)=E[(c'Db-z_0)^2]V(D)=E[(c′Db−z0​)2]. These definitions come from equations (30) and (34). The expected linear objective appearing in the deterministic programs is μc′Dμb\mu_c'D\mu_bμc′​Dμb​; the model records the paper's assumption that the components of bbb and ccc are uncorrelated. Charnes and Cooper, 1963, pp. 26, 28, 30.

Program (38) chooses (D,v,v0,w0)(D,v,v_0,w_0)(D,v,v0​,w0​) and maximizes v0/w0v_0/w_0v0​/w0​. Its inequalities bound the mean objective below by z0+v0z_0+v_0z0​+v0​, bound w0w_0w0​ below by the root-mean-square aspiration error, and bound each nonnegative viv_ivi​ between the row's risk term and μi(D)\mu_i(D)μi​(D). The denominator satisfies w0>0w_0>0w0​>0. Program (39) introduces a nonnegative scale ttt and barred variables. It fixes wˉ0=1\bar w_0=1wˉ0​=1 and maximizes the linear objective vˉ0\bar v_0vˉ0​. The barred moments are calculated from Dˉ\bar DDˉ and ttt by equation (39b), rather than declared to be scaled copies of the unbarred moments. Charnes and Cooper, 1963, pp. 32–33.

Formalization targets

Convex transformed program

Let F39F_{39}F39​ contain every point satisfying all of (39), including t=0t=0t=0. The paper's convex-programming claim becomes

F39 is convex.F_{39}\text{ is convex}.F39​ is convex.

The source states the claim after displaying the barred moments, in the paragraph following (39b). Charnes and Cooper, 1963, p. 33.

Equal optimal values

Let F38F_{38}F38​ be the feasible set of (38). Provided F38F_{38}F38​ is nonempty, the mission goal states that the normalized substitution sends each point of F38F_{38}F38​ to a point of F39F_{39}F39​ with the same objective, and that

sup⁡(D,v,v0,w0)∈F38v0w0=sup⁡(Dˉ,vˉ,vˉ0,wˉ0,t)∈F39vˉ0.\sup_{(D,v,v_0,w_0)\in F_{38}}\frac{v_0}{w_0} =\sup_{(\bar D,\bar v,\bar v_0,\bar w_0,t)\in F_{39}}\bar v_0.(D,v,v0​,w0​)∈F38​sup​w0​v0​​=(Dˉ,vˉ,vˉ0​,wˉ0​,t)∈F39​sup​vˉ0​.

The suprema may be infinite. The equality concerns the complete program (39), including t=0t=0t=0. Positive-scale points have an inverse substitution; zero-scale points are retained in the comparison. This is the precise optimal-value reading of the paper's statement that (38) can be replaced by one convex program. Charnes and Cooper, 1963, pp. 32–33.

Significance

The result places the P model alongside the paper's E and V models as an optimization problem with convex feasible constraints and a nonfractional objective. A solver of (39) can compare aspiration and resource reliability within the same matrix decision rule. Equality of suprema says the transformed model has the same best attainable value even when the best value is only approached, and even when points at t=0t=0t=0 occur in the transformed feasible set. The forward and inverse substitution statements identify how positive-scale solutions correspond. Charnes and Cooper, 1963, pp. 30–33.

The paper result is a published mathematical claim. The present formalization states its definitions and assertions in Lean; its theorem proofs are still open. The standard Gaussian CDF and its inverse are available as a separately published Prove2Me definition, while the model-specific second moments and feasible sets must be formalized for this mission. The previously published Derman linear-fractional lemma concerns a polyhedral linear program and does not assert this P-model result. Completing the mission would add reusable formal machinery for expected-square constraints, a normalized perspective program, and equality of optimal values at a scale boundary.

Difficulty

The pointwise substitution t=1/w0t=1/w_0t=1/w0​ only reaches points of (39) with t>0t>0t>0, while (39) explicitly permits t=0t=0t=0. Therefore a bijection of feasible points at positive scale alone does not establish equality of the displayed suprema. The proof also has to reconcile the squared form of the row constraints with convexity: σˉi2\bar\sigma_i^2σˉi2​ is a raw second moment and μˉi2\bar\mu_i^2μˉ​i2​ is the square of its mean, so their difference is the variance term relevant to the risk bound. Taking the fourth inequality as a generic difference of quadratics would obscure that claim. The paper prints a conflicting square and sign in (38), which must be resolved against its earlier (29) and later (39). Charnes and Cooper, 1963, pp. 28, 32–33.

Formalization scope

Lean uses finite index types Fin m and Fin n, real matrices and scalars, a probability measure PPP, and Bochner integrals for the moments. Square integrability is stated for every component of bbb and ccc and every product cjbkc_jb_kcj​bk​; this keeps the expected squares meaningful. The paper assumes bbb and ccc are uncorrelated, so the same componentwise equalities are recorded. It also assumes that each row residual has a Gaussian law under a decision matrix; the Lean theorem retains this standing assumption even though the substitution from (38) to (39) is algebraic. The quantile KiK_iKi​ is imported from the published Cohen2019.Robust.PhiInvReal, with 1/2<αi<11/2<\alpha_i<11/2<αi​<1 excluding its junk endpoint values. The theorem concerns (38) onward; it does not assert the paper's analogous reduction from the original probability model (35), because the text does not establish a distributional theorem for its random objective. Charnes and Cooper, 1963, pp. 26–27, 31–33.

The source phrase “replace ... by one convex programming problem” is made explicit as convexity of the (39) feasible set, feasibility and value preservation of the forward scaling, and equality of extended-real suprema. The normalization wˉ0=1\bar w_0=1wˉ0​=1, strict w0>0w_0>0w0​>0, and weak t≥0t\ge0t≥0 are separate conditions. The t=0t=0t=0 slice is included, and the main theorem assumes F38F_{38}F38​ nonempty. The barred functions are genuine expectations of the homogenized expressions of (39b). The square-and-sign discrepancy in printed (38) is resolved in favor of the form printed in (29) and (39), consistent with the nearby statement that the row constraints are the same as before. These choices exclude a vacuous denominator, an artificially smaller transformed set, and a trivially defined scaling identity. Reusable contributions include moment lemmas, convexity results for expected-square constraints, and supremum comparison for normalized programs.

Selected references

  • A. Charnes and W. W. Cooper, Deterministic Equivalents for Optimizing and Satisficing under Chance Constraints, Operations Research 11(1), 1963, pp. 18–39. DOI.
  • A. Charnes and W. W. Cooper, Programming with Linear Fractional Functionals, Naval Research Logistics Quarterly 9(3–4), 1962, pp. 181–186. DOI.
  • C. Derman, On Sequential Decisions and Markov Chains, Management Science 9(1), 1962, pp. 16–24. DOI.
  • J. Cohen, E. Rosenfeld, and Z. Kolter, Certified Adversarial Robustness via Randomized Smoothing, ICML, 2019. arXiv.
6 thms1 active userReviewed
CombinatoricsOperations ResearchOptimization·Captain: mikedeng1

Optimization and Approximation in Deterministic Sequencing and Scheduling: A Survey 2: The Optimal Preemptive Open Shop Makespan Equals the Largest Machine Load or Job LengthResearch Paper

Motivation

Open shops model production and service systems in which every job must visit every machine, but the order of the visits is free: a car that needs an inspection, a wash and a tyre change, a patient who needs several tests, a student who sits several exams. The survey of Graham, Lawler, Lenstra and Rinnooy Kan (Ann. Discrete Math. 5, 1979) fixed the three-field notation α∣β∣γ\alpha|\beta|\gammaα∣β∣γ that the scheduling literature still uses, and classified the complexity of the problems it can express. Among the polynomially solvable cases, the preemptive open shop with makespan objective, O∣pmtn∣Cmax⁡O|pmtn|C_{\max}O∣pmtn∣Cmax​, is one of the few multi-machine problems whose optimal value has a closed form for any number of machines and jobs.

Timeline.

  • 1976: Gonzalez and Sahni (J. ACM 23) prove that the optimal preemptive open-shop makespan is the largest machine load or job length, and give a polynomial algorithm. In the same paper they solve O2∥Cmax⁡O2\|C_{\max}O2∥Cmax​ in linear time and show O3∥Cmax⁡O3\|C_{\max}O3∥Cmax​ NP-hard.
  • 1978: Lawler and Labetoulle (J. ACM 25) give a linear-programming treatment of preemptive scheduling on unrelated machines and reformulate the open-shop construction in terms of decrementing sets, found by an assignment problem through the Birkhoff–von Neumann theorem.
  • 1979: the survey (§5.2.2, p. 313) presents this construction as the standard argument and records the O(r+min⁡{m4,n4,r2})O(r+\min\{m^4,n^4,r^2\})O(r+min{m4,n4,r2}) bound of Gonzalez (1976), where rrr is the number of nonzero processing times.

Setting

There are mmm machines M1,…,MmM_1,\dots,M_mM1​,…,Mm​ and nnn jobs J1,…,JnJ_1,\dots,J_nJ1​,…,Jn​. Job JjJ_jJj​ consists of operations O1j,…,OmjO_{1j},\dots,O_{mj}O1j​,…,Omj​; operation OijO_{ij}Oij​ must be processed on machine MiM_iMi​ for pij≥0p_{ij}\ge 0pij​≥0 time units. The processing-time matrix is P=(pij)P=(p_{ij})P=(pij​): its rows are machines and its columns are jobs. Every job is available at time 000.

Preemption is allowed: an operation may be interrupted and resumed later. A schedule is a finite list of pieces (i,j,s,e)(i,j,s,e)(i,j,s,e), each meaning that MiM_iMi​ processes JjJ_jJj​ during [s,e)[s,e)[s,e). A schedule is feasible if

  1. every piece satisfies 0≤s≤e0\le s\le e0≤s≤e;
  2. each machine processes at most one job at a time, and each job is processed on at most one machine at a time: two pieces that share a machine or a job do not overlap;
  3. for every pair (i,j)(i,j)(i,j) the pieces of OijO_{ij}Oij​ have total length exactly pijp_{ij}pij​.

The makespan Cmax⁡C_{\max}Cmax​ is the time at which the last piece ends, and Cmax⁡∗C^*_{\max}Cmax∗​ is its minimum over feasible schedules. The load of machine MiM_iMi​ is the row sum ∑jpij\sum_j p_{ij}∑j​pij​, the length of job JjJ_jJj​ is the column sum ∑ipij\sum_i p_{ij}∑i​pij​, and

C=max⁡{max⁡j∑ipij, max⁡i∑jpij}.C=\max\Big\{\max_j \sum_i p_{ij},\ \max_i \sum_j p_{ij}\Big\}.C=max{jmax​i∑​pij​, imax​j∑​pij​}.

A row or column is tight if its sum equals CCC and slack otherwise. A decrementing set is a set SSS of strictly positive entries of PPP with exactly one element in each tight row and each tight column and at most one in each slack row and each slack column.

Formalization targets

Goal: Cmax⁡∗=CC^*_{\max}=CCmax∗​=C

For every T≥0T\ge 0T≥0,

(∃ feasible schedule with Cmax⁡≤T)  ⟺  (∑jpij≤T ∀i  and  ∑ipij≤T ∀j).\big(\exists \text{ feasible schedule with } C_{\max}\le T\big)\iff \Big(\sum_j p_{ij}\le T\ \forall i\ \text{ and }\ \sum_i p_{ij}\le T\ \forall j\Big).(∃ feasible schedule with Cmax​≤T)⟺(j∑​pij​≤T ∀i  and  i∑​pij​≤T ∀j).

This says that the optimal makespan is exactly the largest machine load or job length, and that it is attained.

Milestones (all from §5.2.2, p. 313)

  1. Lower bound Cmax⁡∗≥CC^*_{\max}\ge CCmax∗​≥C.
  2. Existence of a decrementing set for every nonzero nonnegative PPP.
  3. Positive step: for a decrementing set, the largest δ\deltaδ satisfying the constraints (1)–(3) of the survey exists and is positive.
  4. Step property: after replacing each pij∈Sp_{ij}\in Spij​∈S by max⁡{0,pij−δ}\max\{0,p_{ij}-\delta\}max{0,pij​−δ}, the largest line sum is exactly C−δC-\deltaC−δ.
  5. Partial schedule: for each pij∈Sp_{ij}\in Spij​∈S, MiM_iMi​ processes JjJ_jJj​ for min⁡{pij,δ}\min\{p_{ij},\delta\}min{pij​,δ} time units, with no machine or job used twice.
  6. Termination: every run of the procedure reaches P′=(0)P'=(0)P′=(0) within a bounded number of stages.
  7. Joining: the concatenated partial schedules form a feasible schedule with Cmax⁡≤CC_{\max}\le CCmax​≤C.

Significance

The result. The theorem turns an optimization over continuous-time schedules into the computation of m+nm+nm+n sums. It certifies optimality by a counting argument, it is the base case for preemptive open shops with release dates and due dates, and it is used elsewhere in the survey (§4.4.6) to reduce problems on unrelated machines with preemption to open-shop instances. Because a nonnegative matrix whose row and column sums are all equal is a multiple of a doubly stochastic matrix, the theorem is a scheduling form of the Birkhoff–von Neumann decomposition. It also underlies timetabling and edge-colouring results for bipartite multigraphs.

Formalizing it. The theorem has been proved since 1976 and is textbook material. No machine-checked proof is known to exist: Mathlib has the Birkhoff–von Neumann theorem for doubly stochastic matrices but no model of open-shop schedules. A formalization adds a reusable model of preemptive multi-machine schedules with both disjointness requirements, a checked proof of the decrementing-set construction, and a termination argument the survey asserts without proof.

Difficulty

The lower bound is a one-line counting argument. The difficulty is the construction of a schedule of length exactly CCC. Scheduling each machine's operations back to back gives length max⁡i∑jpij\max_i\sum_j p_{ij}maxi​∑j​pij​, but may run one job on two machines at once. Scheduling job by job has the symmetric defect. A greedy list schedule that only respects both constraints can leave machines idle and overshoot CCC. The construction must keep every tight line busy at every moment while never letting a slack line fall behind. The existence of the decrementing set at each stage is the combinatorial core: it is a Hall-type matching condition, not a local choice. Termination is also not automatic, because a careless choice of step length can produce infinitely many shrinking steps.

Formalization scope

All objects live in the namespace SchedSurvey.OPmtn. Machines and jobs are Fin m and Fin n, both 0-based, and processing times and piece endpoints are real numbers; integer data are a special case. A schedule is a List of pieces. Feasibility requires nonnegative start times, disjointness for pieces sharing a machine or a job (touching intervals allowed), and exactly pijp_{ij}pij​ units of processing for every pair (i,j)(i,j)(i,j). Every theorem assumes pij≥0p_{ij}\ge 0pij​≥0.

"CCC is the maximum" is the predicate IsMaxLoad P C: all line sums are at most CCC and one equals CCC. The goal is stated in threshold form and mentions no maximum at all. The display defining CCC on p. 313 prints max⁡i{∑ipij}\max_i\{\sum_i p_{ij}\}maxi​{∑i​pij​} for the second term; the following sentence shows it means the row sums ∑jpij\sum_j p_{ij}∑j​pij​, and the formalization uses those. The hypothesis T≥0T\ge 0T≥0 matters only for P=0P=0P=0, where the empty schedule finishes by every TTT.

A trivializing formalization is ruled out: the goal mentions neither decrementing sets nor δ\deltaδ. Its "if" direction asserts that a schedule exists. Feasibility counts work per pair (machine, job), not per job, and forbids a job from running on two machines at once. Without either requirement the statement would be a different and easier theorem.

A complete development needs: list sums of interval lengths over disjoint intervals, the existence of decrementing sets (via Birkhoff–von Neumann, König's theorem or Hall's theorem on the bipartite graph of positive entries), the step and termination lemmas, and concatenation of schedules. The schedule model and the decrementing-set lemma are reusable for other preemptive shop problems. Contributions of alternative proofs of any milestone, for example a direct Hall-theorem proof of the existence of decrementing sets, are welcome.

Selected references

  • R. L. Graham, E. L. Lawler, J. K. Lenstra, A. H. G. Rinnooy Kan, Optimization and approximation in deterministic sequencing and scheduling: a survey, Annals of Discrete Mathematics 5 (1979) 287–326. https://doi.org/10.1016/S0167-5060(08)70356-X
  • T. Gonzalez, S. Sahni, Open shop scheduling to minimize finish time, Journal of the ACM 23 (1976) 665–679. https://doi.org/10.1145/321978.321985
  • E. L. Lawler, J. Labetoulle, On preemptive scheduling of unrelated parallel processors by linear programming, Journal of the ACM 25 (1978) 612–619. https://doi.org/10.1145/322077.322090
9 thms1 active userReviewed
Convex OptimizationOperations ResearchOptimization+1·Captain: mikedeng1

Deterministic Equivalents for Optimizing and Satisficing under Chance Constraints 1: Under Normality, the E-Model Chance Constraints Are Equivalent to the Convex Program (29)Research Paper

Motivation

Chance-constrained programming replaces a linear program max⁡c′x\max c'xmaxc′x subject to Ax≤bAx\le bAx≤b by a problem in which some data are random and each constraint only has to hold with a prescribed probability. Charnes and Cooper introduced the idea in 1959 for scheduling heating-oil production against weather-dependent demand, and the formulation is now a standard modelling tool in operations research, finance, energy systems and engineering design (Charnes and Cooper 1959; Prékopa 1995).

A chance-constrained problem is not directly solvable: its constraints are probabilities of events that depend on the decision. The 1963 paper of Charnes and Cooper (doi:10.1287/opre.11.1.18) asks when such a problem has a deterministic equivalent, an ordinary mathematical program with the same feasible decisions and corresponding objective values, and when that equivalent is a convex program. Its first answer, for the expected-value ('E') model under linear decision rules and normality, is the subject of this mission. The resulting constraint form, a mean slack dominating KαK_\alphaKα​ standard deviations, is an early instance of the second-order-cone reformulation of individual normal chance constraints used throughout modern stochastic and robust optimization.

Timeline. 1959: Charnes and Cooper, chance-constrained programming with the heating-oil model. 1963: this paper, deterministic equivalents for the E, V and P models under linear decision rules x=Dbx=Dbx=Db. 1965: Miller and Wagner treat joint chance constraints with independent rows (doi:10.1287/opre.13.6.930). 1971: Prékopa's logarithmically concave measures give convexity of joint chance constraints under log-concave laws.

Setting

Let (Ω,F,P)(\Omega,\mathcal F,P)(Ω,F,P) be a probability space. The data are a constant m×nm\times nm×n matrix AAA with rows a1′,…,am′a_1',\dots,a_m'a1′​,…,am′​, a random right-hand side b:Ω→Rmb:\Omega\to\mathbb R^mb:Ω→Rm and random objective coefficients c:Ω→Rnc:\Omega\to\mathbb R^nc:Ω→Rn. A linear decision rule is an n×mn\times mn×m real matrix DDD; it chooses x=Dbx=Dbx=Db after bbb is observed. Write μb=Eb\mu_b=Ebμb​=Eb, μc=Ec\mu_c=Ecμc​=Ec and b^=b−μb\hat b=b-\mu_bb^=b−μb​.

The E-model (18) is

max⁡ E(c′Db)subject toP(ai′Db≤bi)≥αi(i=1,…,m),\max\ E(c'Db)\quad\text{subject to}\quad P(a_i'Db\le b_i)\ge\alpha_i\qquad(i=1,\dots,m),max E(c′Db)subject toP(ai′​Db≤bi​)≥αi​(i=1,…,m),

with one probability level αi\alpha_iαi​ per row: the constraints are row-wise, as in (3) of the paper, not a single joint constraint.

For 12<α<1\tfrac12<\alpha<121​<α<1 let Kα=Φ−1(α)>0K_\alpha=\Phi^{-1}(\alpha)>0Kα​=Φ−1(α)>0 be the standard normal α\alphaα-quantile. With the moment functions (30),

σi2(D)=E(ai′Db−bi)2,μi(D)=μbi−ai′Dμb,\sigma_i^2(D)=E(a_i'Db-b_i)^2,\qquad \mu_i(D)=\mu_{b_i}-a_i'D\mu_b,σi2​(D)=E(ai′​Db−bi​)2,μi​(D)=μbi​​−ai′​Dμb​,

the paper's deterministic program (29) in the variables (D,v)(D,v)(D,v), v∈Rmv\in\mathbb R^mv∈Rm, is

min⁡ −μc′Dμbs.t.μi(D)−vi≥0,−Kαi2σi2(D)+Kαi2μi2(D)+vi2≥0,vi≥0.\min\ -\mu_c'D\mu_b\quad\text{s.t.}\quad \mu_i(D)-v_i\ge0,\quad -K_{\alpha_i}^2\sigma_i^2(D)+K_{\alpha_i}^2\mu_i^2(D)+v_i^2\ge0,\quad v_i\ge0 .min −μc′​Dμb​s.t.μi​(D)−vi​≥0,−Kαi​2​σi2​(D)+Kαi​2​μi2​(D)+vi2​≥0,vi​≥0.

Formalization targets

Goal: (18) is equivalent to the convex program (29)

Assume every bkb_kbk​ is square integrable, every cjc_jcj​ and cjbkc_jb_kcj​bk​ integrable, bbb and ccc uncorrelated (E(cjbk)=Ecj EbkE(c_jb_k)=E c_j\,E b_kE(cj​bk​)=Ecj​Ebk​), every variate ai′Db−bia_i'Db-b_iai′​Db−bi​ normal (for every DDD and iii, zero variance allowed), and 12<αi<1\tfrac12<\alpha_i<121​<αi​<1. Then

(∀D: D feasible for (18)  ⟺  ∃v, (D,v) feasible for (29)) ∧ (∀D: E(c′Db)=μc′Dμb) ∧ {(D,v) feasible for (29)} is convex.\Big(\forall D:\ D\text{ feasible for (18)}\iff\exists v,\ (D,v)\text{ feasible for (29)}\Big)\ \wedge\ \Big(\forall D:\ E(c'Db)=\mu_c'D\mu_b\Big)\ \wedge\ \{(D,v)\ \text{feasible for (29)}\}\ \text{is convex}.(∀D: D feasible for (18)⟺∃v, (D,v) feasible for (29)) ∧ (∀D: E(c′Db)=μc′​Dμb​) ∧ {(D,v) feasible for (29)} is convex.

Milestones, in the order of the paper

  1. (19a): E(c′Db)=(Ec)′D(Eb)E(c'Db)=(Ec)'D(Eb)E(c′Db)=(Ec)′D(Eb) for uncorrelated bbb, ccc.
  2. (22)–(27): with positive variance, P(ai′Db≤bi)≥αi  ⟺  (−μbi+ai′Dμb)/E[b^i−ai′Db^]2≤−KαiP(a_i'Db\le b_i)\ge\alpha_i\iff(-\mu_{b_i}+a_i'D\mu_b)/\sqrt{E[\hat b_i-a_i'D\hat b]^2}\le-K_{\alpha_i}P(ai′​Db≤bi​)≥αi​⟺(−μbi​​+ai′​Dμb​)/E[b^i​−ai′​Db^]2​≤−Kαi​​.
  3. (28a)–(28b): (27) holds iff some viv_ivi​ satisfies μbi−ai′Dμb≥vi≥KαiE[b^i−ai′Db^]2≥0\mu_{b_i}-a_i'D\mu_b\ge v_i\ge K_{\alpha_i}\sqrt{E[\hat b_i-a_i'D\hat b]^2}\ge0μbi​​−ai′​Dμb​≥vi​≥Kαi​​E[b^i​−ai′​Db^]2​≥0.
  4. (28c)–(28d): for vi≥0v_i\ge0vi​≥0, that pair is equivalent to its squared form.
  5. Footnote ‡ to (30): σi2(D)−μi2(D)=E[b^i−ai′Db^]2\sigma_i^2(D)-\mu_i^2(D)=E[\hat b_i-a_i'D\hat b]^2σi2​(D)−μi2​(D)=E[b^i​−ai′​Db^]2.
  6. The convexity paragraph after (30): the feasible set of (29) is convex in (D,v)(D,v)(D,v).
  7. 'V Model' (32)–(34): under the same normal chance assumptions and square integrability of each cjbkc_jb_kcj​bk​, the chance constraints of (32) are equivalent to (33) for some vvv; the pair feasible set and V(D)=E(c′Db−z0)2V(D)=E(c'Db-z^0)^2V(D)=E(c′Db−z0)2 are convex.

Significance

The result. The theorem turns a problem whose constraints are probabilities into a finite-dimensional convex program whose data are the first two moments of bbb and the means of ccc. The optimal rules of (18) minimize (29), whose optimal value is the negative of the maximum in (18). The slack variables viv_ivi​ separate each constraint into a "quality" part (the mean slack μi(D)\mu_i(D)μi​(D)) and a "risk" part (KαiK_{\alpha_i}Kαi​​ standard deviations), which is the interpretation the paper develops in (31) and its Appendix. The same constraint set serves the V-model (33), so only the objective changes between the two models.

Formalizing it. The result is classical and its proof is elementary, but the paper's argument is informal in ways that matter for a machine-checked version: it divides by a standard deviation it then allows to vanish, writes FiF_iFi​ for what must be an upper-tail function, and labels a variance as σi2(D)\sigma_i^2(D)σi2​(D) while defining σi2(D)\sigma_i^2(D)σi2​(D) as a raw second moment. This mission produces a statement in which each of these points is settled, with every hypothesis explicit. No machine-checked version of the result is known to exist.

Difficulty

The chance-constraint step itself is a one-dimensional fact about the normal law, but three points need care. The variance of ai′Db−bia_i'Db-b_iai′​Db−bi​ may be zero for some DDD and iii; then the law is a point mass, the quotient in (27) is undefined, and the equivalence must be argued separately, as footnote † of p. 28 indicates. The quadratic constraint of (29) alone, vi2≥Kαi2(σi2(D)−μi2(D))v_i^2\ge K_{\alpha_i}^2(\sigma_i^2(D)-\mu_i^2(D))vi2​≥Kαi​2​(σi2​(D)−μi2​(D)), describes both nappes of a hyperboloid and is not convex; convexity needs vi≥0v_i\ge0vi​≥0 and the positive semidefiniteness of D↦Var⁡(ai′Db−bi)D\mapsto\operatorname{Var}(a_i'Db-b_i)D↦Var(ai′​Db−bi​), which comes from square integrability of bbb and not from normality. Finally, the identity relating σi2\sigma_i^2σi2​, μi2\mu_i^2μi2​ and the variance requires the integrals to be genuine, so the integrability hypotheses cannot be dropped.

Formalization scope

Everything is in the namespace ChanceDetEquiv.EModel. The probability space is (Ω, P) with [IsProbabilityMeasure P]; A : Matrix (Fin m) (Fin n) ℝ, b : Ω → Fin m → ℝ, c : Ω → Fin n → ℝ, D : Matrix (Fin n) (Fin m) ℝ; ai′Dba_i'Dbai′​Db is (A *ᵥ (D *ᵥ b ω)) i. Expectations are Bochner integrals and probabilities are P.real. Explicit readings of the paper's phrases:

  • "deterministic equivalent for (18)" is the conjunction of an iff between feasible sets (with the auxiliary vvv existentially quantified) and E(c′Db)=μc′DμbE(c'Db)=\mu_c'D\mu_bE(c′Db)=μc′​Dμb​ for every DDD; (29) minimizes the negative of this mean;
  • "is a convex programming problem" is Convex ℝ of the feasible set of (29) in (D,v)(D,v)(D,v), vi≥0v_i\ge0vi​≥0 included; for the V model it also asserts ConvexOn ℝ of VVV;
  • "normally distributed" is: for every DDD and iii, the law of ai′Db−bia_i'Db-b_iai′​Db−bi​ is gaussianReal μ s for some μ\muμ and s≥0s\ge0s≥0; joint normality of bbb is not assumed, since it would be a stronger hypothesis;
  • "bbb and ccc are uncorrelated" is E(cjbk)=Ecj EbkE(c_jb_k)=E c_j\,E b_kE(cj​bk​)=Ecj​Ebk​ for all j,kj,kj,k;
  • Kα=Φ−1(α)K_\alpha=\Phi^{-1}(\alpha)Kα​=Φ−1(α), using the published definition Cohen2019_Robust_Phi; FiF_iFi​ in (26)–(27) is read as the upper-tail function of ziz_izi​, and αi<1\alpha_i<1αi​<1 is added so that KαiK_{\alpha_i}Kαi​​ is finite;
  • σi2(D)\sigma_i^2(D)σi2​(D) is the raw second moment exactly as printed in (30).

Positive variance is a hypothesis of milestones 2 and 3, where (27) has a denominator. The goal and later milestones admit zero variance. The statements admit no trivializing reading: the normality hypothesis is satisfied by constant and by Gaussian bbb, the integrability hypotheses rule out the junk value 000 of non-integrable expectations, and αi<1\alpha_i<1αi​<1 rules out the junk value of Φ−1(1)\Phi^{-1}(1)Φ−1(1).

A complete development needs: the normal CDF and quantile, the law of an affine image of a random variable, variance as EX2−(EX)2E X^2-(EX)^2EX2−(EX)2 in L2L^2L2, and convexity of the epigraph of a seminorm composed with an affine map. The convexity milestones need no probability beyond L2L^2L2 and are reusable for any second-order-cone representation of individual chance constraints. Proofs of any milestone, and of the goal from the milestones, are welcome.

The related open platform item KallMayer.Chance.chapter2_theorem2_5 (convexity of a single normal chance-feasible set in xxx) is credited here and not restated: no item of this mission states the convexity of the set of DDD feasible for (18). Related published items that are about other models: DRCVRP.RCI.prob_le_iff_valueAtRisk_le (chance constraints and value-at-risk for a general law) and the log-concavity results of NumStochOpt.LogConcave.

Selected references

  • A. Charnes and W. W. Cooper, Deterministic Equivalents for Optimizing and Satisficing under Chance Constraints, Operations Research 11(1), 1963, 18–39. https://doi.org/10.1287/opre.11.1.18
  • A. Charnes and W. W. Cooper, Chance-Constrained Programming, Management Science 6(1), 1959, 73–79. https://doi.org/10.1287/mnsc.6.1.73
  • A. Prékopa, Stochastic Programming, Kluwer, 1995. https://doi.org/10.1007/978-94-017-3087-7
  • P. Kall and J. Mayer, Stochastic Linear Programming, 2nd ed., Springer, 2011. https://doi.org/10.1007/978-1-4419-7729-8
10 thms1 active userReviewed
Operations ResearchOptimizationProbability+1·Captain: mikedeng1

Statistics of Robust Optimization: A Generalized Empirical Likelihood Approach 3: Robust Optimal Values and Solution Sets over f-Divergence Balls Are ConsistentResearch Paper

Motivation

Stochastic optimization asks for a decision xxx in a set X⊂Rd\mathcal X\subset\mathbb R^dX⊂Rd that minimises an expected loss EP0[ℓ(x;ξ)]E_{P_0}[\ell(x;\xi)]EP0​​[ℓ(x;ξ)] when the distribution P0P_0P0​ of the data ξ\xiξ is known only through a sample ξ1,…,ξn\xi_1,\dots,\xi_nξ1​,…,ξn​. The classical estimator, sample average approximation, replaces P0P_0P0​ by the empirical distribution P^n\widehat P_nPn​. Distributionally robust optimization instead minimises the worst-case expected loss over all distributions close to P^n\widehat P_nPn​. Duchi, Glynn and Namkoong (arXiv:1610.03425v3; Math. Oper. Res. 46(3), 2021) take the neighbourhood to be an fff-divergence ball of radius ρ/n\rho/nρ/n and show that the robust optimal value is a calibrated upper confidence bound for the population optimum, in the spirit of Owen's empirical likelihood.

A confidence bound is useful only if the robust problem still estimates the right thing. Section 5 of the paper answers this: under essentially the conditions that make sample average approximation consistent, the robust optimal value converges to the population optimal value, and the robust minimisers approach the population minimisers. This mission formalizes that consistency result (contribution (iv), p. 3, and §5.1).

Setting

Let ξ1,ξ2,…\xi_1,\xi_2,\dotsξ1​,ξ2​,… be i.i.d. random elements of a separable metric space Ξ\XiΞ with law P0P_0P0​, and let P^n\widehat P_nPn​ be the empirical distribution of ξ1,…,ξn\xi_1,\dots,\xi_nξ1​,…,ξn​. Let ℓ:Rd×Ξ→R\ell:\mathbb R^d\times\Xi\to\mathbb Rℓ:Rd×Ξ→R be lower semicontinuous on X×Ξ\mathcal X\times\XiX×Ξ, with ℓ(x;⋅)\ell(x;\cdot)ℓ(x;⋅) measurable for x∈Xx\in\mathcal Xx∈X, and let X⊂Rd\mathcal X\subset\mathbb R^dX⊂Rd be a nonempty closed feasible set, as in the paper's opening setup (p. 1).

The divergence generator f:[0,∞)→R∪{+∞}f:[0,\infty)\to\mathbb R\cup\{+\infty\}f:[0,∞)→R∪{+∞} is convex with f(1)=0f(1)=0f(1)=0; Assumption A asks moreover that fff be three times differentiable near 111 with f′(1)=0f'(1)=0f′(1)=0 and f′′(1)=2f''(1)=2f′′(1)=2. For a distribution P≪P^nP\ll\widehat P_nP≪Pn​ with weights pip_ipi​ on the sample points, Df(P∥P^n)=1n∑if(npi)D_f(P\|\widehat P_n)=\frac1n\sum_i f(np_i)Df​(P∥Pn​)=n1​∑i​f(npi​). The robust objective and the population objective are

F^n(x)=sup⁡P≪P^n{EP[ℓ(x;ξ)]:Df(P∥P^n)≤ρn},F(x)=EP0[ℓ(x;ξ)],\widehat F_n(x)=\sup_{P\ll\widehat P_n}\Big\{E_P[\ell(x;\xi)] : D_f(P\|\widehat P_n)\le\frac{\rho}{n}\Big\},\qquad F(x)=E_{P_0}[\ell(x;\xi)],Fn​(x)=P≪Pn​sup​{EP​[ℓ(x;ξ)]:Df​(P∥Pn​)≤nρ​},F(x)=EP0​​[ℓ(x;ξ)],

with radius parameter ρ≥0\rho\ge0ρ≥0. Their solution sets are SP^n⋆=argmin⁡x∈XF^n(x)S^\star_{\widehat P_n}=\operatorname{argmin}_{x\in\mathcal X}\widehat F_n(x)SPn​⋆​=argminx∈X​Fn​(x) and SP0⋆=argmin⁡x∈XF(x)S^\star_{P_0}=\operatorname{argmin}_{x\in\mathcal X}F(x)SP0​⋆​=argminx∈X​F(x) (display (23)). The inclusion distance from a set AAA to a set BBB is d⊂(A,B)=sup⁡x∈Adist⁡(x,B)d_\subset(A,B)=\sup_{x\in A}\operatorname{dist}(x,B)d⊂​(A,B)=supx∈A​dist(x,B) (display (6)).

Assumption E asks for a measurable envelope Z≥0Z\ge0Z≥0 with ∣ℓ(x;ξ)∣≤Z(ξ)|\ell(x;\xi)|\le Z(\xi)∣ℓ(x;ξ)∣≤Z(ξ) for all x∈Xx\in\mathcal Xx∈X and EP0[Z1+ϵ]<∞E_{P_0}[Z^{1+\epsilon}]<\inftyEP0​​[Z1+ϵ]<∞ for some ϵ>0\epsilon>0ϵ>0. A class H\mathcal HH of functions on Ξ\XiΞ is Glivenko–Cantelli (Definition 2) if sup⁡h∈H∣EP^n[h]−EP0[h]∣→0\sup_{h\in\mathcal H}|E_{\widehat P_n}[h]-E_{P_0}[h]|\to0suph∈H​∣EPn​​[h]−EP0​​[h]∣→0 almost surely.

Formalization targets

Goal: Corollary 1 (p. 17)

Let Assumptions A and E hold, let X\mathcal XX be nonempty and compact, and let ℓ(⋅;ξ)\ell(\cdot;\xi)ℓ(⋅;ξ) be continuous on X\mathcal XX for every ξ\xiξ. Then, in outer probability,

inf⁡x∈XF^n(x)−inf⁡x∈XF(x)→P∗0andd⊂(SP^n⋆,SP0⋆)→P∗0.\inf_{x\in\mathcal X}\widehat F_n(x)-\inf_{x\in\mathcal X}F(x)\xrightarrow{P^*}0 \qquad\text{and}\qquad d_\subset\big(S^\star_{\widehat P_n},S^\star_{P_0}\big)\xrightarrow{P^*}0 .x∈Xinf​Fn​(x)−x∈Xinf​F(x)P∗​0andd⊂​(SPn​⋆​,SP0​⋆​)P∗​0.

Both conclusions belong to the goal. No rate is asserted; the statement survives any later sharpening.

Milestones

  1. Lemma 13 (p. 34): the likelihood-ratio vectors of the ball satisfy ∥np−1∥2≤ρCf\|np-\mathbb 1\|_2\le\sqrt{\rho C_f}∥np−1∥2​≤ρCf​​ uniformly in nnn, and the bound is of the right order (≥ρcf\ge\sqrt{\rho c_f}≥ρcf​​ for some n,pn,pn,p).
  2. (47) (App. E.1, p. 46): ∣EP[ℓ]−EP0[ℓ]∣≤EP^n[∣L−1∣p]1/pEP^n[∣ℓ∣q]1/q+∣EP^n[ℓ]−EP0[ℓ]∣|E_P[\ell]-E_{P_0}[\ell]|\le E_{\widehat P_n}[|L-1|^p]^{1/p}E_{\widehat P_n}[|\ell|^q]^{1/q}+|E_{\widehat P_n}[\ell]-E_{P_0}[\ell]|∣EP​[ℓ]−EP0​​[ℓ]∣≤EPn​​[∣L−1∣p]1/pEPn​​[∣ℓ∣q]1/q+∣EPn​​[ℓ]−EP0​​[ℓ]∣ with q=min⁡{2,1+ϵ}q=\min\{2,1+\epsilon\}q=min{2,1+ϵ}, p=max⁡{2,1+1/ϵ}p=\max\{2,1+1/\epsilon\}p=max{2,1+1/ϵ}.
  3. The display after (47) (p. 46): EP^n[∣L−1∣p]1/p≤n−1/pρCfE_{\widehat P_n}[|L-1|^p]^{1/p}\le n^{-1/p}\sqrt{\rho C_f}EPn​​[∣L−1∣p]1/p≤n−1/pρCf​​.
  4. Theorem 7 (p. 16): if {ℓ(x;⋅):x∈X}\{\ell(x;\cdot):x\in\mathcal X\}{ℓ(x;⋅):x∈X} is Glivenko–Cantelli, then
sup⁡x∈Xsup⁡P≪P^n{∣EP[ℓ(x;ξ)]−EP0[ℓ(x;ξ)]∣:Df(P∥P^n)≤ρn}→a.s.∗0.\sup_{x\in\mathcal X}\sup_{P\ll\widehat P_n}\Big\{|E_P[\ell(x;\xi)]-E_{P_0}[\ell(x;\xi)]| : D_f(P\|\widehat P_n)\le\tfrac{\rho}{n}\Big\}\xrightarrow{\text{a.s.}^*}0.x∈Xsup​P≪Pn​sup​{∣EP​[ℓ(x;ξ)]−EP0​​[ℓ(x;ξ)]∣:Df​(P∥Pn​)≤nρ​}a.s.∗​0.
  1. Example 5 (p. 16, from van der Vaart, Asymptotic Statistics, Example 19.8): a class of losses continuous on a compact X\mathcal XX for almost every ξ\xiξ, with an integrable envelope, is Glivenko–Cantelli.

Significance

The result. Corollary 1 shows that robustness against a ρ/n\rho/nρ/n-divergence perturbation of the data costs nothing asymptotically: the robust optimal value and its minimisers are consistent for the population problem. Together with the paper's coverage theorem, this justifies using the robust value both as a point estimate and as an upper confidence bound. Theorem 7 is stronger than what the corollary needs: it controls every reweighting in the ball uniformly over X\mathcal XX, which is the uniform law of large numbers for distributionally robust objectives, and it needs only slightly more than the first moment that sample average approximation needs.

Formalizing it. The results are proved in the paper; none is machine-checked. A formal development would supply a Glivenko–Cantelli notion for parametric loss classes, the bracketing argument behind Example 5 (a uniform strong law over a compact parameter set, not in Mathlib), and the passage from uniform convergence of objectives to convergence of optimal values and of argmin sets in the inclusion distance. The last two are standard steps of M-estimation and sample average approximation theory that are reusable well beyond this paper.

Difficulty

The obvious argument writes EP[ℓ]−EP0[ℓ]E_P[\ell]-E_{P_0}[\ell]EP​[ℓ]−EP0​​[ℓ] as a reweighting term plus the ordinary empirical deviation and handles the second by the Glivenko–Cantelli property. The reweighting term 1n∑i(npi−1)ℓ(x;ξi)\frac1n\sum_i(np_i-1)\ell(x;\xi_i)n1​∑i​(npi​−1)ℓ(x;ξi​) is the obstacle: the weights npinp_inpi​ are not bounded uniformly in nnn for every divergence, and a Cauchy–Schwarz bound would need a second moment of the envelope, which Assumption E does not provide. The exponent pair (p,q)(p,q)(p,q) and the uniform ℓ2\ell_2ℓ2​ control of Lemma 13 are what make 1+ϵ1+\epsilon1+ϵ moments enough.

For the solution sets, uniform convergence of F^n\widehat F_nFn​ to FFF does not by itself place the minimisers of F^n\widehat F_nFn​ near those of FFF; compactness of X\mathcal XX and continuity of FFF are needed to separate FFF on the complement of an ϵ\epsilonϵ-enlargement of SP0⋆S^\star_{P_0}SP0​⋆​ from its minimum. Measurability is a further obstacle: suprema over uncountable X\mathcal XX and over the divergence ball need not be measurable, which is why the paper works with outer probability and outer almost-sure convergence.

Formalization scope

  • Samples are ξ : ℕ → Ω → Ξ on a probability space, measurable, mutually independent (iIndepFun) and identically distributed with ξ 0; P0P_0P0​ is the law of ξ 0, and P^n\widehat P_nPn​ uses ξ 0, …, ξ (n-1) (0-based indices). The separable metric sample domain and lower semicontinuous loss from p. 1 are explicit in Theorem 7 and Corollary 1. Decisions live in EuclideanSpace ℝ (Fin d); ℓ x is measurable for each x∈Xx\in\mathcal Xx∈X.
  • fff is ℝ → EReal satisfying the published IsPhiDivergenceFunction (never −∞-\infty−∞, finite on (0,∞)(0,\infty)(0,∞), f(1)=0f(1)=0f(1)=0, convex on [0,∞)[0,\infty)[0,∞)) plus the smoothness of Assumption A, stated on t↦(f t).toRealt\mapsto(f\,t).\mathrm{toReal}t↦(ft).toReal on an open interval around 111.
  • A distribution P≪P^nP\ll\widehat P_nP≪Pn​ in the ball is a weight vector in the published probUncertaintySet f (1/n,…,1/n) (ρ/n), i.e. {p≥0:∑pi=1, ∑if(npi)≤ρ}\{p\ge0:\sum p_i=1,\ \sum_i f(np_i)\le\rho\}{p≥0:∑pi​=1, ∑i​f(npi​)≤ρ}. Every supremum "over PPP with Df(P∥P^n)≤ρ/nD_f(P\|\widehat P_n)\le\rho/nDf​(P∥Pn​)≤ρ/n" is read over P≪P^nP\ll\widehat P_nP≪Pn​, as in (4a).
  • Suprema of absolute deviations (Definition 2, Theorem 7) are taken in [0,∞][0,\infty][0,∞], and d⊂d_\subsetd⊂​ is [0,∞][0,\infty][0,∞]-valued; an unbounded family therefore cannot satisfy them through a junk real supremum of 000. Almost-sure statements use Mathlib's ∀ᵐ, which requires the exceptional set to have outer measure zero; convergence in outer probability is μ{ω:δ<∣Xn(ω)∣}→0\mu\{\omega:\delta<|X_n(\omega)|\}\to0μ{ω:δ<∣Xn​(ω)∣}→0 for every δ>0\delta>0δ>0 with Mathlib's outer measure and no measurability hypothesis.
  • Readings recorded in the items: in (47) the middle term is EP^n[∣L−1∣ ∣ℓ∣]E_{\widehat P_n}[|L-1|\,|\ell|]EPn​​[∣L−1∣∣ℓ∣] (the page omits the absolute value on ℓ\ellℓ); in the display after (47), ρ/γf\sqrt{\rho/\gamma_f}ρ/γf​​ is ρCf\sqrt{\rho C_f}ρCf​​ with CfC_fCf​ from Lemma 13; in Lemma 13 the constants may depend on ρ\rhoρ as well as fff, as in its proof.
  • A trivializing formalization would take the suprema in R\mathbb RR (where an unbounded set has supremum 000), or allow the argmin sets to be empty by construction; neither is possible here, and nonemptiness of the solution sets is not assumed.
  • Contributions welcome: a Glivenko–Cantelli library for parametric classes (Example 5), the deterministic inequalities (47) and Lemma 13, and the argmin-consistency argument of Corollary 1.

Selected references

  • J. C. Duchi, P. W. Glynn, H. Namkoong, Statistics of Robust Optimization: A Generalized Empirical Likelihood Approach, arXiv:1610.03425v3, 2018; Math. Oper. Res. 46(3), 2021. https://arxiv.org/abs/1610.03425 , https://doi.org/10.1287/moor.2020.1085
  • A. W. van der Vaart, Asymptotic Statistics, Cambridge University Press, 1998 (Example 19.8). https://doi.org/10.1017/CBO9780511802256
  • A. W. van der Vaart, J. A. Wellner, Weak Convergence and Empirical Processes, Springer, 1996. https://doi.org/10.1007/978-1-4757-2545-2
  • A. B. Owen, Empirical Likelihood, Chapman & Hall/CRC, 2001. https://doi.org/10.1201/9781420036152
  • A. Ben-Tal, D. den Hertog, A. De Waegenaere, B. Melenberg, G. Rennen, Robust Solutions of Optimization Problems Affected by Uncertain Probabilities, Management Science 59(2), 2013. https://doi.org/10.1287/mnsc.1120.1641
16 thms1 active userReviewed
PreviousNext

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me