Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Operations Research

2,232 missions · 1,108 completed

The discipline of applying mathematical analysis to complex decision problems in operations: allocating scarce resources, scheduling, routing, inventory, and the design of service and production systems. Drawing on mathematical programming, stochastic modeling, queueing, simulation, and game-theoretic reasoning, it seeks policies that perform provably well in systems shaped by constraints, congestion, and uncertainty.

Missions

Open1124Completed1108All2232
🏆Completed
Algorithmic Game TheoryCombinatorics·Captain: mikedeng1

Potential Games 1: A Game Is an Exact Potential Game If and Only If I(γ, u) = 0 on Every Simple Closed Path of Length 4Research Paper

Why this question matters

In a strategic game, each player evaluates a change in their own strategy using that player's own payoff. These incentives need not point in a common direction. A potential game is a case in which one real-valued function records every player's payoff change under a unilateral deviation. This common function lets questions about incentives be expressed as questions about one object on the space of strategy profiles. Monderer and Shapley's 1996 paper introduced several kinds of potential and gave a local characterization of the exact kind. The characterization is the subject of this mission.

The local test matters because the defining condition appears to require finding an unknown potential on the entire profile space. Theorem 2.8 says that a condition on four-step cycles already determines whether such a function exists, even when individual strategy sets are infinite. The paper compares this characterization with the familiar idea that a conservative field has zero integral around closed curves; here the “integral” is a finite sum of payoff changes along unilateral deviations (Monderer and Shapley, pp. 130–131).

Games, deviations, and path sums

Let NNN be a finite set of players. For each player i∈Ni\in Ni∈N, let YiY^iYi be a strategy set, and let Y=∏i∈NYiY=\prod_{i\in N}Y^iY=∏i∈N​Yi be the set of pure strategy profiles. The payoff of player iii is a function ui:Y→Ru^i:Y\to\mathbb Rui:Y→R. If y∈Yy\in Yy∈Y, the notation (y−i,x)(y^{-i},x)(y−i,x) means the profile obtained by replacing only player iii's strategy with x∈Yix\in Y^ix∈Yi. The strategy sets themselves are not required to be finite in this section of the paper (p. 127).

An exact potential is a function P:Y→RP:Y\to\mathbb RP:Y→R such that, for every iii, every opponents' profile y−iy^{-i}y−i, and every x,z∈Yix,z\in Y^ix,z∈Yi,

ui(y−i,x)−ui(y−i,z)=P(y−i,x)−P(y−i,z).u^i(y^{-i},x)-u^i(y^{-i},z) =P(y^{-i},x)-P(y^{-i},z).ui(y−i,x)−ui(y−i,z)=P(y−i,x)−P(y−i,z).

A game admitting such a function is an exact potential game. The paper uses the shorter term “potential game” for this class when the adjective is clear (pp. 127–128, equation (2.2)).

A path γ=(y0,…,yL)\gamma=(y_0,\ldots,y_L)γ=(y0​,…,yL​) is a sequence in which each step changes exactly one player's strategy to a different value. Write iki_kik​ for the unique player who moves from yk−1y_{k-1}yk−1​ to yky_kyk​. The path sum of the payoff vector uuu is

I(γ,u)=∑k=1L(uik(yk)−uik(yk−1)).I(\gamma,u)=\sum_{k=1}^{L} \bigl(u^{i_k}(y_k)-u^{i_k}(y_{k-1})\bigr).I(γ,u)=k=1∑L​(uik​(yk​)−uik​(yk−1​)).

The path is closed when y0=yLy_0=y_Ly0​=yL​. It is simple closed when, in addition, the vertices y0,…,yL−1y_0,\ldots,y_{L-1}y0​,…,yL−1​ are pairwise distinct. Its length is LLL, the number of steps and the number of vertices before the final return. These definitions follow pp. 128, 130–131.

Formalization targets

Theorem 2.8: four equivalent conditions

For a game with finitely many players, Theorem 2.8 asserts the equivalence of all four claims:

Γ has an exact potential;I(γ,u)=0for every finite closed path γ;I(γ,u)=0for every finite simple closed path γ;I(γ,u)=0for every simple closed path γ of length 4.\begin{aligned} &\Gamma\text{ has an exact potential};\\ &I(\gamma,u)=0\quad\text{for every finite closed path }\gamma;\\ &I(\gamma,u)=0\quad\text{for every finite simple closed path }\gamma;\\ &I(\gamma,u)=0\quad\text{for every simple closed path }\gamma\text{ of length }4. \end{aligned}​Γ has an exact potential;I(γ,u)=0for every finite closed path γ;I(γ,u)=0for every finite simple closed path γ;I(γ,u)=0for every simple closed path γ of length 4.​

The last condition is a local criterion, but the goal keeps the full four-way equivalence of the published theorem, p. 131. The milestone list follows five claims in its Appendix A proof: vanishing path sums from a potential, path independence, construction of a potential from vanishing closed-path sums, the local exchange of two different players' moves, and the reduction from all closed paths to length-four simple cycles (pp. 138–139).

Related results in the same development

Corollary 2.9 expresses the length-four test directly as a zero sum of payoff changes around four corners obtained by varying two players' strategies. Lemma 2.7 says that two exact potentials for the same game differ by one additive constant. Both are included as supporting statements from the same definition layer, although they are not milestones in the attack path for Theorem 2.8 (pp. 130–131).

What the result provides

Theorem 2.8 turns existence of a global function into a test on local cycles. Corollary 2.9 makes those cycles visible in payoff tables: fixing all but two players, the alternating sum around each two-player rectangle must vanish. For finite strategy sets this gives a direct finite collection of conditions; for infinite strategy sets the theorem remains a mathematical characterization without claiming a finite algorithm (Monderer and Shapley, p. 131).

The original paper proves these statements. The formalization work is to represent games, paths, path sums, and the four-way equivalence in Lean, then supply machine-checked proofs. The present mission contains compiled statements with open proofs. Its definition modules are also reusable for the paper's other results about potentials, improvement paths, and congestion games.

Where the proof is difficult

The challenging direction is that zero sums on simple length-four cycles force zero sums on every closed path. A closed path may repeat vertices and may involve more than two players. A direct appeal to the local condition does not cover such a path. The Appendix A argument uses changes to a path's sequence of deviators, and its informal treatment of adjacent moves by the same player leaves a boundary case: the two moves can cancel, so replacing them by one move would create a null step, which the definition of a path excludes. A formal proof must account for this case while preserving the paper's exact statement (pp. 138–139).

Formalization scope

Lean represents the finite player set by a finite type ι\iotaι and a profile by a dependent function y:∏i:ιYiy:\prod_{i:\iota}Y^iy:∏i:ι​Yi. Strategy sets YiY^iYi remain arbitrary types. The operation (y−i,x)(y^{-i},x)(y−i,x) is a one-coordinate update. A finite path stores L+1L+1L+1 vertices and its deviator at each of the LLL steps; the step condition determines that deviator uniquely. Closed paths of length zero are allowed and have sum zero. The paper prints nnn, the number of players, as the upper limit of the path sum on p. 130, although its summands are indexed by path steps. The Lean definition sums over all LLL steps, as the surrounding definition and later equations require.

The four-cycle hypothesis quantifies only over simple closed paths of exactly four genuine steps. It is not replaced by all four-step walks or by cycles with null or simultaneous deviations. The goal retains all four clauses rather than only its shortest equivalence. Corollary 2.9 explicitly requires the two varying players to be distinct; this is implicit in the paper's four-corner construction. No finite-strategy assumption is imposed on Theorem 2.8, Corollary 2.9, or Lemma 2.7.

The development needs ordinary finite sums, dependent functions, coordinate updates, and finite-indexed paths. Its path and potential definitions are intended as an interface for later work. Contributions proving any of the five source-backed milestones, the goal, or the two related statements are within scope.

Selected references

  • Dov Monderer and Lloyd S. Shapley, Potential Games, Games and Economic Behavior 14 (1996), 124–143. DOI: 10.1006/game.1996.0044.
10 thms2 active usersReviewed
🏆Completed
CombinatoricsTheoretical Computer Science·Captain: mikedeng1

Flowshop and Jobshop Schedules: Complexity and Approximation 3: The Partition Job Shop on Two Machines Has a Schedule of Finish Time 5T, Preemptive or Not, Iff a Partition ExistsResearch Paper

Motivation

A job shop is the basic model of a factory floor in which every job follows its own route through the machines. Minimizing the time at which the last job is finished (the finish time, or makespan) is one of the central problems of deterministic scheduling theory, and the question of which special cases admit efficient algorithms has organized much of the field since the 1950s.

For two machines the picture is sharp. Jackson (1956) showed that a two-machine job shop in which every job has at most two operations is solved by a simple rule extending Johnson's flow-shop algorithm (Jackson, Naval Research Logistics Quarterly 3, 1956; Conway, Maxwell and Miller, Theory of Scheduling, 1967, p. 105). Once a single job may have three operations, the non-preemptive problem becomes NP-complete: Lenstra, Rinnooy Kan and Brucker showed this for n−1n-1n−1 jobs with one nonzero task each and one job with three (Annals of Discrete Mathematics 1, 1977; a 1975 Mathematisch Centrum report is the paper's reference [1]). Gonzalez and Sahni (Operations Research 26(1), 1978) extended this boundary to preemptive schedules, in which a task may be interrupted and resumed later: even then the two-machine problem is NP-complete, already when only two jobs have three nonzero tasks. This mission formalizes that reduction, Lemma 5 together with Corollary 2 of their paper.

Timeline:

  • 1956: Jackson, two-machine job shop with at most two operations per job, solved in O(nlog⁡n)O(n\log n)O(nlogn).
  • 1975/1977: Lenstra, Rinnooy Kan and Brucker, the non-preemptive two-machine job shop NP-complete with n−1n-1n−1 one-task jobs and one three-task job.
  • 1976: Garey, Johnson and Sethi, the non-preemptive two-machine job shop NP-complete even when problem size is measured by the sum of the task lengths (Mathematics of Operations Research 1, 1976).
  • 1978: Gonzalez and Sahni, the preemptive two-machine job shop NP-complete (Lemmas 5 and 6), and the non-preemptive case again by the same reduction (Corollary 2).

Setting

A job shop has processors P1,…,PmP_1, \dots, P_mP1​,…,Pm​ and jobs 1,…,n1, \dots, n1,…,n. Job iii is a finite sequence of tasks; task jjj of job iii must be processed on a given processor kkk for tk,i,j≥0t_{k,i,j} \ge 0tk,i,j​≥0 time units, and for every job, task j≥2j \ge 2j≥2 can begin only after task j−1j-1j−1 has been completed. Schedules start at time 000. A preemptive schedule assigns to every task a finite set of time intervals [s,f)[s, f)[s,f) on its processor, of total length tk,i,jt_{k,i,j}tk,i,j​, such that intervals on the same processor do not overlap and every interval of task jjj begins after task j−1j-1j−1 of the same job is completed. A non-preemptive schedule processes each task in a single interval. If fi(S)f_i(S)fi​(S) is the time at which job iii is completed, the finish time is FT(S)=max⁡ifi(S)\mathrm{FT}(S) = \max_i f_i(S)FT(S)=maxi​fi​(S).

PARTITION: a multiset {a1,…,an}\{a_1, \dots, a_n\}{a1​,…,an​} of nonnegative integers has a partition if some index set uuu satisfies ∑i∈uai=12∑i=1nai\sum_{i \in u} a_i = \tfrac12 \sum_{i=1}^n a_i∑i∈u​ai​=21​∑i=1n​ai​.

From a1,…,ana_1, \dots, a_na1​,…,an​, with T=∑iaiT = \sum_i a_iT=∑i​ai​, the paper builds the two-processor job shop JS\mathrm{JS}JS with n+2n+2n+2 jobs:

  • job i≤ni \le ni≤n: tasks (P2,ai)(P_2, a_i)(P2​,ai​), (P1,ai)(P_1, a_i)(P1​,ai​);
  • job n+1n+1n+1: tasks (P1,T/2)(P_1, T/2)(P1​,T/2), (P2,T/2)(P_2, T/2)(P2​,T/2), (P1,3T)(P_1, 3T)(P1​,3T);
  • job n+2n+2n+2: tasks (P2,3T)(P_2, 3T)(P2​,3T), (P1,T/2)(P_1, T/2)(P1​,T/2), (P2,T/2)(P_2, T/2)(P2​,T/2).

Each processor carries load exactly 5T5T5T. In Lean, the instance is JS a : JobShopLTAS.Core.Instance 2 (n + 2), a schedule is S : Schedule (JS a) (a finite set of pieces), and the predicates are S.IsPreemptive, S.IsNonPreemptive and S.FinishedBy (5 * T a).

Formalization targets

Goal: Lemma 5 and Corollary 2

For every nnn and every a:Fin n→Na : \mathrm{Fin}\,n \to \mathbb Na:Finn→N,

(∃ S preemptive, FT(S)≤5T)  ⟺  Partition(a)and(∃ S non-preemptive, FT(S)≤5T)  ⟺  Partition(a).\bigl(\exists\, S \text{ preemptive},\ \mathrm{FT}(S) \le 5T\bigr) \iff \mathrm{Partition}(a) \quad\text{and}\quad \bigl(\exists\, S \text{ non-preemptive},\ \mathrm{FT}(S) \le 5T\bigr) \iff \mathrm{Partition}(a).(∃S preemptive, FT(S)≤5T)⟺Partition(a)and(∃S non-preemptive, FT(S)≤5T)⟺Partition(a).

Milestones

  1. Lemma 5(a): a partition yields a non-preemptive schedule of finish time exactly 5T5T5T (the paper's Figure 3).
  2. Observations (i)–(ii) in the proof of Lemma 5(b): in any preemptive schedule with FT≤5T\mathrm{FT} \le 5TFT≤5T, task t2,n+1,2t_{2,n+1,2}t2,n+1,2​ is completed by 2T2T2T and t2,n+2,1t_{2,n+2,1}t2,n+2,1​ by 4T4T4T; no part of t1,n+1,3t_{1,n+1,3}t1,n+1,3​ runs before TTT and no part of t1,n+2,2t_{1,n+2,2}t1,n+2,2​ before 3T3T3T.
  3. Lemma 5(b): without a partition, every preemptive schedule has FT>5T\mathrm{FT} > 5TFT>5T.
  4. Lemma 5: the preemptive equivalence.
  5. Corollary 2: the non-preemptive equivalence.

Significance

The result places the boundary of tractability for two-machine job shops exactly: at most two operations per job is solvable in O(nlog⁡n)O(n\log n)O(nlogn), while two jobs with three operations make the problem NP-complete, and allowing preemption does not help. The same instance serves both schedule types, because its optimum is 5T5T5T in either model exactly when a partition exists.

The theorem is classical and fully proved on paper; no machine-checked proof is known to exist. Formalizing it requires a precise model of preemptive schedules, which the paper treats informally, and makes explicit an argument (the "no idle time" step of Lemma 5(b)) that the paper compresses into a few sentences. The schedule model built here is shared with the other job-shop missions of this series.

Difficulty

Direction (a) is a concrete schedule and is bookkeeping. Direction (b) is the substance. The tempting argument "each processor has load 5T5T5T, so a schedule of finish time 5T5T5T has no idle time, hence some set of short jobs fills exactly [0,T/2][0, T/2][0,T/2] on P2P_2P2​" is incomplete for preemptive schedules: the short jobs may be split into many pieces spread over the whole horizon, and UUU, the set of short jobs that touch P1P_1P1​ during [0,T][0, T][0,T], is defined by pieces rather than by whole tasks. Making the counting argument rigorous requires measuring idle time on each processor across arbitrary finite unions of intervals and tying the amount of processing done on P1P_1P1​ before TTT to the completed first tasks on P2P_2P2​.

Formalization scope

  • Processing times are real numbers; the PARTITION data are natural numbers cast to R\mathbb RR; TTT is the real sum. Processors are Fin 2 with P1=0P_1 = 0P1​=0, P2=1P_2 = 1P2​=1; jobs and tasks are 0-based, so the paper's job n+1n+1n+1 is job n and job n+2n+2n+2 is job n + 1.
  • Job-shop data reuse the published JobShopLTAS.Core.Instance. Schedules are finite sets of pieces (task, start, end) with positive length, following the paper's footnote 1 (p. 40). A task of length zero has no pieces and is completed when its predecessor is; it never blocks a processor.
  • A non-preemptive schedule is a preemptive one with at most one piece per task. "Finish time ≤τ\le \tau≤τ" is ∀ j, S.jobFinish j ≤ τ; "finish time >5T> 5T>5T" is the existence of a job finishing after 5T5T5T; "finish time 5T5T5T" in Lemma 5(a) is ≤5T\le 5T≤5T together with a job finishing at exactly 5T5T5T.
  • Complexity wording not formalized. "Partition α\alphaα preemptive JOFT" and "Partition α\alphaα nonpreemptive JOFT" (polynomial reducibility), "NP-complete", and Lemma 6 ("JOFT is in NP") are not stated. What is stated is the equivalence that the paper's proofs establish for the instance they construct, with the explicit constant τ=5T\tau = 5Tτ=5T.
  • The PARTITION condition is written 2∑i∈uai=∑iai2\sum_{i\in u} a_i = \sum_i a_i2∑i∈u​ai​=∑i​ai​ in N\mathbb NN, avoiding truncated division.
  • A trivializing formalization is ruled out: the schedule notion requires every task to receive its full processing time, so the empty schedule is feasible only when T=0T = 0T=0 (and then the empty index set is a partition), and the finish-time bound is over every job, so no statement holds by an unattained supremum or a default value.
  • Welcome contributions: a proof of Lemma 5(a) by an explicit piece schedule; infrastructure for measuring busy and idle time of a processor in a finite piece schedule, reusable for Lemma 7 (mission 4) and the preemptive flow-shop missions; the proof of Lemma 5(b).

Selected references

  • T. Gonzalez, S. Sahni, Flowshop and Jobshop Schedules: Complexity and Approximation, Operations Research 26(1), 36–52, 1978. https://doi.org/10.1287/opre.26.1.36
  • J. K. Lenstra, A. H. G. Rinnooy Kan, P. Brucker, Complexity of Machine Scheduling Problems, Annals of Discrete Mathematics 1, 343–362, 1977. https://doi.org/10.1016/S0167-5060(08)70743-X
  • M. R. Garey, D. S. Johnson, R. Sethi, Complexity of Flow Shop and Job Shop Scheduling, Mathematics of Operations Research 1(2), 117–129, 1976. https://doi.org/10.1287/moor.1.2.117
  • J. R. Jackson, An Extension of Johnson's Results on Job Lot Scheduling, Naval Research Logistics Quarterly 3(3), 201–203, 1956. https://doi.org/10.1002/nav.3800030307
  • R. W. Conway, W. L. Maxwell, L. W. Miller, Theory of Scheduling, Addison-Wesley, 1967.
11 thms2 active usersReviewed
🏆Completed
Convex OptimizationOptimization·Captain: mikedeng1

Nonlinear Proximal Point Algorithms Using Bregman Functions, with Applications to Convex Programming 4: Nonquadratic Multiplier Methods for Inequality Constraints Find an Optimal MultiplierResearch Paper

Motivation

Convex programs with inequality constraints arise when a decision must meet capacity, resource, or performance limits. Their Lagrange multipliers assign a price to each constraint. Finding an optimal multiplier gives a dual certificate and can guide a primal optimization method. Classical quadratic multiplier methods update these prices through a particular penalty. Eckstein's 1993 paper places a broader family of multiplier updates inside the theory of Bregman proximal point algorithms, allowing a nonquadratic function to shape each step (Eckstein 1993, §4.2).

The result here concerns the inequality constrained case, where multiplier vectors must be componentwise nonnegative. Eckstein identifies a monotone conjugate that incorporates this restriction into the primal penalty and proves that the resulting multiplier sequence converges to an optimal multiplier when one exists. The paper also studies primal limit points and the behavior when no optimal multiplier exists (Eckstein 1993, Theorem 7 and proof, pp. 216–219).

Setting

Let C⊆RnC\subseteq\mathbb R^nC⊆Rn be closed, nonempty, and convex. Let f,g1,…,gmf,g_1,\ldots,g_mf,g1​,…,gm​ be proper lower semicontinuous convex functions, finite on CCC. The primal problem is to minimize f(x)f(x)f(x) over x∈Cx\in Cx∈C subject to gi(x)≤0g_i(x)\le 0gi​(x)≤0 for every iii. Write g(x)=(g1(x),…,gm(x))g(x)=(g_1(x),\ldots,g_m(x))g(x)=(g1​(x),…,gm​(x)). A point solves the problem only when it lies in CCC, satisfies every inequality, and has no larger objective value than any other feasible point.

For a nonnegative multiplier ppp, the dual functional is d(p)=inf⁡x∈C{f(x)+⟨p,g(x)⟩}d(p)=\inf_{x\in C}\{f(x)+\langle p,g(x)\rangle\}d(p)=infx∈C​{f(x)+⟨p,g(x)⟩}; it equals −∞-\infty−∞ outside the nonnegative orthant. A multiplier p∗p^*p∗ is optimal when it maximizes ddd. The standing assumption that ddd is not identically −∞-\infty−∞ makes this dual functional a meaningful proper concave object (Eckstein 1993, p. 215).

A Bregman function hhh has an open zone SSS. It is continuously differentiable there, strictly convex and continuous on S‾\overline SS, and satisfies the boundedness and sequential conditions of Definition 1. Its Bregman distance is Dh(u,v)=h(u)−h(v)−⟨∇h(v),u−v⟩D_h(u,v)=h(u)-h(v)-\langle\nabla h(v),u-v\rangleDh​(u,v)=h(u)−h(v)−⟨∇h(v),u−v⟩, with u∈S‾u\in\overline Su∈S and v∈Sv\in Sv∈S. The zone contains the strict positive orthant, and the image of its gradient contains that orthant. Its monotone conjugate is h∗+(z)=sup⁡p≥0{⟨p,z⟩−h(p)}h^{*+}(z)=\sup_{p\ge0}\{\langle p,z\rangle-h(p)\}h∗+(z)=supp≥0​{⟨p,z⟩−h(p)}. Lemma 3 establishes that this function is finite and differentiable everywhere under these assumptions (Eckstein 1993, pp. 205, 215–216).

Given positive step sizes ckc_kck​ bounded away from zero, recursion (11) chooses xk+1x^{k+1}xk+1 as a minimizer over CCC of f(x)+ck−1h∗+(∇h(pk)+ckg(x))f(x)+c_k^{-1}h^{*+}(\nabla h(p^k)+c_kg(x))f(x)+ck−1​h∗+(∇h(pk)+ck​g(x)), then sets pk+1=∇h∗+(∇h(pk)+ckg(xk+1))p^{k+1}=\nabla h^{*+}(\nabla h(p^k)+c_kg(x^{k+1}))pk+1=∇h∗+(∇h(pk)+ck​g(xk+1)). The theorem assumes an infinite sequence conforming to these recursions; it does not assert that each minimizer exists for arbitrary data.

Formalization targets

Multiplier convergence

The goal is Eckstein's Theorem 7. If the dual problem has an optimal multiplier, then the multiplier sequence converges to one:

∃p∗∈argmax⁡dsuch thatpk⟶p∗.\exists p^*\in\operatorname*{argmax}d\quad\text{such that}\quad p^k\longrightarrow p^*.∃p∗∈argmaxdsuch thatpk⟶p∗.

When every gig_igi​ is continuous on CCC and SSS contains the closed nonnegative orthant, each subsequential limit of the primal iterates solves the constrained problem. Under the same zone condition, the multiplier sequence is unbounded if the dual has no optimal multiplier. The printed theorem says “if (10) has no solution” in this last clause; its proof on p. 218 establishes the no-optimal-multiplier condition, which is the version formalized here.

Supporting targets

The milestones include the representations of h∗+h^{*+}h∗+ in Lemma 2, the appendix results governing recession directions and the monotone conjugate, Lemma 3's global finiteness and differentiability, the subdifferential chain rule, and the Bregman proximal point result of Theorem 1. They also capture the paper's claims that recursion (11) is a Bregman proximal point run for ∂(−d)\partial(-d)∂(−d) and that primal limit points meet the feasibility, complementarity, and Lagrangian conditions.

Significance

The theorem supplies a convergence guarantee for nonquadratic methods of multipliers with inequality constraints. It separates the dual conclusion, which uses the strict positive orthant condition, from the primal limit and unboundedness conclusions, which additionally require the closed orthant to lie in the zone. This distinction lets a Bregman function whose zone excludes boundary points still yield dual convergence when optimal multipliers exist (Eckstein 1993, Theorem 7, pp. 216–218).

Eckstein proved this theorem on paper. The mission asks for machine checked proofs of its precise statements and the supporting results; the draft statements compile but their proofs remain open. A completed development would also provide reusable finite dimensional infrastructure for extended-real convex functions, monotone conjugates, Bregman distances, and convex-analytic multiplier conditions.

Difficulty

A direct appeal to ordinary proximal point convergence does not identify the update in (11) as a proximal step: the primal minimization uses h∗+h^{*+}h∗+, whereas the operator of interest is the subdifferential of the negative dual functional. The nonnegative orthant also introduces boundary behavior absent from the equality constrained case. The link requires precise conjugacy and subdifferential statements, including a globally finite monotone conjugate, before Theorem 1 can apply (Eckstein 1993, pp. 215–218). For primal limit points, the issue is to pass from optimality of each primal subproblem to feasibility, complementarity, and minimization of the limiting Lagrangian.

Formalization scope

Lean uses finite dimensional real inner product spaces for the general proximal point theorem and EuclideanSpace ℝ (Fin n) and EuclideanSpace ℝ (Fin m) for the primal and multiplier spaces. Functions that the paper regards as extended-valued are represented by EReal; their properness excludes −∞-\infty−∞. The infimum defining ddd and the supremum defining h∗+h^{*+}h∗+ remain extended-real operations, so an infinite value cannot silently become zero. Real values are extracted from h∗+h^{*+}h∗+ in recursion (11) only because Lemma 3 asserts finiteness everywhere.

The real function hhh is total in Lean but constrained only on S‾\overline SS; its gradient is evaluated only at points in SSS. Every multiplier iterate is explicitly in SSS. The initial primal value x0x^0x0 is unused by recursion (11). The Bregman proximal point recursion is represented by its equivalent inclusion (4), and a “limit point” is a subsequential limit. The sequential condition (vi) of Definition 1 is stated for xk∈S‾x^k\in\overline Sxk∈S, the natural first-argument domain of DhD_hDh​. The Appendix's essential strict convexity means strict convexity on convex subsets of the subdifferential domain. Its recession direction uses the stated limit inferior condition.

Lemma A4's printed unconditional claim that its composite GGG is proper lacks a finite-value witness. The formal statement keeps convexity of GGG unconditional and states properness at a point x0x_0x0​ where all inner functions and the outer function are finite; differentiability of the outer function there is expressed with local finiteness of its extended-real value. At a zero coefficient, its corresponding subgradient term contributes zero without requiring a subgradient to exist. These conditions expose rather than hide the domain issue. The formulation rules out an arbitrary multiplier sequence, an all-space supremum, or a minimization over infeasible points. Contributions proving the milestones, improving shared convex analysis libraries, and checking the boundary conventions are welcome.

Selected references

  • Jonathan Eckstein, Nonlinear proximal point algorithms using Bregman functions, with applications to convex programming, Mathematics of Operations Research 18(1), 202–226, 1993. DOI:10.1287/moor.18.1.202.
15 thms2 active usersReviewed
🏆Completed
ProbabilityStochastic Systems·Captain: mikedeng1

Reflected Solutions of Backward SDE's, and Related Obstacle Problems for PDE's 1: The Reflected BSDE Has a Unique Square-Integrable SolutionResearch Paper

Motivation

A backward stochastic differential equation (BSDE) prescribes the value ξ\xiξ of a process at a terminal time TTT and asks for an adapted process YYY that reaches it while following a given drift fff. Adaptedness forces a second unknown ZZZ, the integrand of a martingale term. Pardoux and Peng (1990) proved that Lipschitz BSDEs are well posed. BSDEs then became a standard language for stochastic control, for pricing and hedging in mathematical finance, and for probabilistic representations of semilinear parabolic PDEs.

Many such problems carry a constraint. The value of an American option must stay above its exercise payoff, and the value of an optimal stopping problem must stay above the reward for stopping now. El Karoui, Kapoudjian, Pardoux, Peng and Quenez (1997) introduced the reflected BSDE: the solution is kept above a given obstacle SSS by an increasing process KKK that acts only when the constraint binds. This mission formalizes the paper's first main result, existence and uniqueness of the reflected BSDE, together with the estimates its proof rests on.

Setting

Let B=(B1,…,Bd)B=(B^1,\dots,B^d)B=(B1,…,Bd) be a ddd-dimensional standard Brownian motion on a probability space (Ω,F,P)(\Omega,\mathcal F,P)(Ω,F,P). Let (Ft)(\mathcal F_t)(Ft​) be its natural filtration, augmented by the PPP-null sets. Fix a horizon TTT. The data are:

  • a terminal value ξ\xiξ, FT\mathcal F_TFT​-measurable with Eξ2<∞E\xi^2<\inftyEξ2<∞ (condition (i));
  • a coefficient f(t,ω,y,z)f(t,\omega,y,z)f(t,ω,y,z) such that f(⋅,y,z)f(\cdot,y,z)f(⋅,y,z) is progressively measurable with E∫0Tf(t,y,z)2dt<∞E\int_0^Tf(t,y,z)^2dt<\inftyE∫0T​f(t,y,z)2dt<∞ (ii), and ∣f(t,y,z)−f(t,y′,z′)∣≤K(∣y−y′∣+∣z−z′∣)|f(t,y,z)-f(t,y',z')|\le K(|y-y'|+|z-z'|)∣f(t,y,z)−f(t,y′,z′)∣≤K(∣y−y′∣+∣z−z′∣) almost surely for some K>0K>0K>0 (iii);
  • an obstacle SSS, continuous and progressively measurable, with Esup⁡t≤T(St+)2<∞E\sup_{t\le T}(S_t^+)^2<\inftyEsupt≤T​(St+​)2<∞ (iv),

with the standing assumption ST≤ξS_T\le\xiST​≤ξ a.s.

A solution is a triple (Y,Z,K)(Y,Z,K)(Y,Z,K) of progressively measurable processes, valued in R\mathbb RR, Rd\mathbb R^dRd and R+\mathbb R_+R+​, such that

Yt=ξ+∫tTf(s,Ys,Zs) ds+KT−Kt−∫tT(Zs,dBs),0≤t≤T(vi),Y_t=\xi+\int_t^Tf(s,Y_s,Z_s)\,ds+K_T-K_t-\int_t^T(Z_s,dB_s),\qquad 0\le t\le T\quad\text{(vi)},Yt​=ξ+∫tT​f(s,Ys​,Zs​)ds+KT​−Kt​−∫tT​(Zs​,dBs​),0≤t≤T(vi),

Yt≥StY_t\ge S_tYt​≥St​ (vii), and KKK is continuous and nondecreasing with K0=0K_0=0K0​=0 and ∫0T(Yt−St) dKt=0\int_0^T(Y_t-S_t)\,dK_t=0∫0T​(Yt​−St​)dKt​=0 (viii). Condition (viii) says that KKK increases only when YYY touches SSS. The integrability conditions are (v), E∫0T∣Zt∣2dt<∞E\int_0^T|Z_t|^2dt<\inftyE∫0T​∣Zt​∣2dt<∞, and (v′), Esup⁡t≤TYt2<∞E\sup_{t\le T}Y_t^2<\inftyEsupt≤T​Yt2​<∞ and EKT2<∞EK_T^2<\inftyEKT2​<∞.

Formalization targets

Goal: Theorem 5.2

Under (i)–(iv) and ST≤ξS_T\le\xiST​≤ξ, the reflected BSDE with (v)–(viii) has a solution, and any two solutions satisfying (v)–(viii) coincide:

∃ (Y,Z,K) solving (v)–(viii),(Y,Z,K),(Y′,Z′,K′) solving (v)–(viii) ⇒ Y≡Y′, K≡K′, Z=Z′ dP⊗dt-a.e.\exists\,(Y,Z,K)\ \text{solving (v)–(viii)},\qquad (Y,Z,K),(Y',Z',K')\ \text{solving (v)–(viii)}\ \Rightarrow\ Y\equiv Y',\ K\equiv K',\ Z=Z'\ dP\otimes dt\text{-a.e.}∃(Y,Z,K) solving (v)–(viii),(Y,Z,K),(Y′,Z′,K′) solving (v)–(viii) ⇒ Y≡Y′, K≡K′, Z=Z′ dP⊗dt-a.e.

Milestones, in the order the proof uses them

  1. Lemma 2.1: the deterministic Skorohod problem y=x+k≥0y=x+k\ge0y=x+k≥0 has a unique solution, with kt=sup⁡s≤txs−k_t=\sup_{s\le t}x_s^-kt​=sups≤t​xs−​.
  2. Proposition 2.2: KT−Kt=sup⁡t≤u≤T(ξ+∫uTf ds−∫uT(Zs,dBs)−Su)−K_T-K_t=\sup_{t\le u\le T}\big(\xi+\int_u^Tf\,ds-\int_u^T(Z_s,dB_s)-S_u\big)^-KT​−Kt​=supt≤u≤T​(ξ+∫uT​fds−∫uT​(Zs​,dBs​)−Su​)−.
  3. Corollary 3.3 (α): (v) implies (v′).
  4. Proposition 2.3: Yt=ess sup⁡v∈TtE[∫tvf ds+Sv1{v<T}+ξ1{v=T}∣Ft]Y_t=\operatorname{ess\,sup}_{v\in\mathcal T_t}E\big[\int_t^vf\,ds+S_v1_{\{v<T\}}+\xi1_{\{v=T\}}\mid\mathcal F_t\big]Yt​=esssupv∈Tt​​E[∫tv​fds+Sv​1{v<T}​+ξ1{v=T}​∣Ft​].
  5. Proposition 3.5: the a priori estimate E(sup⁡Y2+∫∣Z∣2+KT2)≤C E(ξ2+∫f(t,0,0)2+sup⁡(S+)2)E(\sup Y^2+\int|Z|^2+K_T^2)\le C\,E(\xi^2+\int f(t,0,0)^2+\sup(S^+)^2)E(supY2+∫∣Z∣2+KT2​)≤CE(ξ2+∫f(t,0,0)2+sup(S+)2).
  6. Proposition 3.6: the stability estimate in (ξ,f,S)(\xi,f,S)(ξ,f,S).
  7. Corollary 3.7: uniqueness under (v).
  8. Proposition 5.1: well-posedness of the backward reflection problem, the case where f=f(t)f=f(t)f=f(t) does not depend on (y,z)(y,z)(y,z).

Significance

Theorem 5.2 is the foundation of the theory of reflected BSDEs. With it, the solution gives the value of a mixed optimal stopping problem (Proposition 2.3). For concave fff it gives the value of a combined stopping and control problem, and in a Markovian setting it gives the unique viscosity solution of the obstacle problem for a semilinear parabolic PDE. The other two missions of this series formalize those consequences, and both use the existence and uniqueness proved here. The model has many later extensions (two obstacles and Dynkin games, jumps, quadratic growth), and the pricing of American options under constrained or nonlinear dynamics is formulated through it.

The result is classical and fully proved in the paper. As far as is known, no machine-checked proof of existence for a (reflected or plain) BSDE exists. The remaining work is the formalization of the known proof: the Skorohod lemma, the optimal-stopping representation, the a priori and stability estimates, and the Picard contraction. The milestones are reusable well beyond this paper, in particular the Skorohod lemma, the estimates, and the identification of the reflected solution with a Snell envelope.

Difficulty

The natural first idea is to treat (vi) as a forward equation and reflect it pathwise with the Skorohod map, as in forward reflected SDEs. This fails: the pathwise reflection of a backward equation produces a process KKK that is not adapted (Proposition 2.2 gives KKK as a supremum over the future). The adaptedness of (Y,K)(Y,K)(Y,K) comes only from the choice of ZZZ, i.e. from a martingale representation. Any construction must produce ZZZ and KKK together, and the estimates must control the contribution of KKK using only the minimality condition (viii). In the formal setting, Mathlib has Brownian motion, filtrations, stopping times and conditional expectations, but no stochastic integral (the platform definition Peng1990.SMP.IsItoIntegral supplies one, without any calculus), no Itô formula, no martingale representation, no Burkholder–Davis–Gundy inequality and no Snell envelope theory in continuous time.

Formalization scope

The Lean development builds on the published definitions Peng1990.SMP.Stochastic: standard ddd-dimensional Brownian motion, H2\mathbb H^2H2 as L2F, and the L2L^2L2 Itô integral IsItoIntegral. It commits to the following conventions:

  • time is ℝ≥0, with T:R≥0T:\mathbb R_{\ge0}T:R≥0​, and only t≤Tt\le Tt≤T matters;
  • the filtration is the natural Brownian filtration joined with the σ\sigmaσ-algebra of PPP-null sets;
  • H2\mathbb H^2H2 uses progressive rather than predictable measurability;
  • ∣z∣|z|∣z∣ is the Euclidean norm on Rd\mathbb R^dRd;
  • the stochastic integral is the L2L^2L2 Itô integral with a version continuous on [0,T][0,T][0,T]. Since that integral is only defined for Z∈H2Z\in\mathbb H^2Z∈H2, the predicate for (vi)–(viii) contains (v), which is a recorded deviation for Proposition 2.2;
  • (vi)–(viii) hold almost surely, simultaneously for all t∈[0,T]t\in[0,T]t∈[0,T];
  • the integral ∫(Y−S) dK\int(Y-S)\,dK∫(Y−S)dK is taken against the Stieltjes measure of the path of KKK;
  • moments are lower Lebesgue integrals in [0,∞][0,\infty][0,∞];
  • the essential supremum is a predicate on the candidate;
  • uniqueness of ZZZ is dP⊗dtdP\otimes dtdP⊗dt-almost everywhere.

Proposition 2.3 additionally assumes S∈S2S\in\mathcal S^2S∈S2, which the paper's Remark 3.2 allows without loss of generality, so that every conditional expectation in it is of an integrable variable. The constants of Propositions 3.5 and 3.6 are quantified before the Brownian dimension, probability space, data and solution, and depend only on (T,K)(T,K)(T,K); a per-solution constant would make both statements trivial. The condition ST≤ξS_T\le\xiST​≤ξ is part of every statement, since without it no solution exists. Proposition 3.1 and Corollary 3.3 (β) are not posed.

A complete proof needs Itô's formula for Y2Y^2Y2, the Burkholder–Davis–Gundy inequality, Gronwall's lemma, martingale representation for the Brownian filtration, and the Snell envelope with its Doob–Meyer decomposition. Each of these is reusable on its own, and contributions of any of them are welcome, as are proofs of individual milestones.

Selected references

  • N. El Karoui, C. Kapoudjian, É. Pardoux, S. Peng, M. C. Quenez, Reflected solutions of backward SDE's, and related obstacle problems for PDE's, Ann. Probab. 25(2), 1997, 702–737. https://doi.org/10.1214/aop/1024404416
  • É. Pardoux, S. Peng, Adapted solution of a backward stochastic differential equation, Systems & Control Letters 14, 1990, 55–61. https://doi.org/10.1016/0167-6911(90)90082-6
  • N. El Karoui, S. Peng, M. C. Quenez, Backward stochastic differential equations in finance, Math. Finance 7(1), 1997, 1–71. https://doi.org/10.1111/1467-9965.00022
14 thms2 active usersReviewed
🏆Completed
ProbabilityStatistics·Captain: mikedeng1

Residual Life Time at Great Age 6: For 0 < ξ < α, Residual Life Attraction to Γ_α Is Equivalent to a Finite ξ-th Moment and E((X/t)^ξ | X > t) → (1 − ξ/α)^{−1}Research Paper

Motivation

Actuaries, reliability engineers and demographers ask how much longer an item or a person will live given that it has already survived to a great age ttt. For a lifetime XXX with distribution function FFF, this is the law of the residual life time X−tX - tX−t given X>tX > tX>t, and the question is what this law looks like as t→∞t \to \inftyt→∞. Balkema and de Haan (Ann. Probab. 2 (1974) 792–804) determined all possible limit laws of the suitably normed residual life time and the distribution functions attracted to each. When only a scale normalization is allowed, the possible continuous limits are the exponential law and the Pareto-type laws Γα\Gamma_\alphaΓα​, the counterparts in residual-life theory of the Gumbel and Fréchet laws of extreme value theory. Both theories rest on Karamata's theory of regular variation (de Haan 1970).

Section 5 of the paper restates the domain of attraction of Γα\Gamma_\alphaΓα​ in terms of moments: weak convergence of the scaled residual life times is equivalent to convergence of a single conditional moment of the scaled residual life. For an exponential limit the analogous link between weak convergence and first moments had been studied by Meilijson (1972). Moment conditions of this form underlie the mean-excess and Hill-type diagnostics used in heavy-tail statistics and in the peaks-over-threshold method (Pickands 1975).

Setting

Let XXX be a real random variable with law μ\muμ and distribution function FFF, and write R(x)=1−F(x)=P{X>x}R(x) = 1 - F(x) = P\{X > x\}R(x)=1−F(x)=P{X>x} for its tail. The standing assumption is F(x)<1F(x) < 1F(x)<1 for every real xxx, i.e. R(x)>0R(x) > 0R(x)>0: XXX has no finite upper endpoint, and conditioning on {X>t}\{X > t\}{X>t} makes sense for every ttt.

For t>0t > 0t>0, the conditional distribution function of X/tX/tX/t given X>tX > tX>t is

P{Xt≤x ∣ X>t}=P{t<X≤xt}P{X>t},P\Big\{\frac{X}{t} \le x \,\Big|\, X > t\Big\} = \frac{P\{t < X \le xt\}}{P\{X > t\}},P{tX​≤x​X>t}=P{X>t}P{t<X≤xt}​,

which vanishes for x≤1x \le 1x≤1. For a real exponent ξ\xiξ, the conditional ξ\xiξ-th moment is

E((Xt)ξ ∣ X>t)=1P{X>t}∫(t,∞)(yt)ξdF(y).E\Big(\Big(\frac{X}{t}\Big)^{\xi}\,\Big|\,X > t\Big) = \frac{1}{P\{X>t\}}\int_{(t,\infty)} \Big(\frac{y}{t}\Big)^{\xi} dF(y).E((tX​)ξ​X>t)=P{X>t}1​∫(t,∞)​(ty​)ξdF(y).

For α>0\alpha > 0α>0 the limit law Γα\Gamma_\alphaΓα​ is Γα(x)=1−(1+x)−α\Gamma_\alpha(x) = 1 - (1+x)^{-\alpha}Γα​(x)=1−(1+x)−α for x≥0x \ge 0x≥0 and Γα(x)=0\Gamma_\alpha(x) = 0Γα​(x)=0 for x<0x < 0x<0. The shifted function Γα(x−1)\Gamma_\alpha(x-1)Γα​(x−1) equals 1−x−α1 - x^{-\alpha}1−x−α for x≥1x \ge 1x≥1: the Pareto law of index α\alphaα on [1,∞)[1,\infty)[1,∞). The distribution function FFF is in the domain of residual life time attraction Dr(Γα)D_r(\Gamma_\alpha)Dr​(Γα​) when

lim⁡t→∞P{Xt≤x ∣ X>t}=Γα(x−1)for all x>0.\lim_{t\to\infty} P\Big\{\frac{X}{t} \le x \,\Big|\, X > t\Big\} = \Gamma_\alpha(x-1) \qquad \text{for all } x > 0 .t→∞lim​P{tX​≤x​X>t}=Γα​(x−1)for all x>0.

In Lean the tail is BalkemaDeHaan.LimitTypes.tail; the scaled conditional distribution and moment are BalkemaDeHaan.Moments.scaledResidualCDF and BalkemaDeHaan.Moments.condMoment. The limit law is BalkemaDeHaan.ParetoBounds.GammaLaw.

Formalization targets

Goal: Theorem 8(a), corrected

For F(x)<1F(x) < 1F(x)<1 for all xxx and 0<ξ<α0 < \xi < \alpha0<ξ<α:

F∈Dr(Γα)  ⟺  ∫0∞yξ dF(y)<∞  and  lim⁡t→∞E((Xt)ξ ∣ X>t)=(1−ξα)−1.F \in D_r(\Gamma_\alpha) \iff \int_0^\infty y^\xi\, dF(y) < \infty \ \text{ and } \ \lim_{t\to\infty} E\Big(\Big(\frac{X}{t}\Big)^{\xi}\,\Big|\,X > t\Big) = \Big(1 - \frac{\xi}{\alpha}\Big)^{-1}.F∈Dr​(Γα​)⟺∫0∞​yξdF(y)<∞  and  t→∞lim​E((tX​)ξ​X>t)=(1−αξ​)−1.

Milestones

  1. The identity in the proof of Theorem 8(a): for x>0x > 0x>0, with a finite ξ\xiξ-th moment,
∫x∞yξdF(y)xξ(1−F(x))=ξ ∫x∞yξ−1(1−F(y)) dyxξ(1−F(x))+1,\frac{\int_x^\infty y^\xi dF(y)}{x^\xi(1-F(x))} = \xi\,\frac{\int_x^\infty y^{\xi-1}(1-F(y))\,dy}{x^\xi(1-F(x))} + 1,xξ(1−F(x))∫x∞​yξdF(y)​=ξxξ(1−F(x))∫x∞​yξ−1(1−F(y))dy​+1,

the left side being E((X/x)ξ∣X>x)E((X/x)^\xi \mid X > x)E((X/x)ξ∣X>x). 2. The value of the limit: ∫0∞xξ dΓα(x−1)=(1−ξ/α)−1\int_0^\infty x^\xi\, d\Gamma_\alpha(x-1) = (1-\xi/\alpha)^{-1}∫0∞​xξdΓα​(x−1)=(1−ξ/α)−1 for 0<ξ<α0 < \xi < \alpha0<ξ<α. 3. The "only if" half: F∈Dr(Γα)F \in D_r(\Gamma_\alpha)F∈Dr​(Γα​) implies a finite ξ\xiξ-th moment and convergence of the conditional moment to (1−ξ/α)−1(1-\xi/\alpha)^{-1}(1−ξ/α)−1. 4. The "if" half, corrected: the converse.

Significance

The theorem replaces a distributional limit, required at every x>0x > 0x>0, by one numerical limit, for any order ξ∈(0,α)\xi \in (0,\alpha)ξ∈(0,α). In statistics this justifies testing or estimating heavy-tail behaviour through empirical conditional moments above a high threshold, and it identifies the limit value (1−ξ/α)−1(1-\xi/\alpha)^{-1}(1−ξ/α)−1, from which α\alphaα can be read off. Combined with Theorem 4 of the same paper (Dr(Γα)=D(Φα)D_r(\Gamma_\alpha) = D(\Phi_\alpha)Dr​(Γα​)=D(Φα​)), it gives a moment criterion for the Fréchet domain of attraction of extreme value theory.

The result is classical and proved, by reduction to Karamata's theorem on integrals of regularly varying functions. No machine-checked proof is known. Mathlib has no theory of regular variation, no Karamata theorem and no domains of attraction, so a formal proof also produces a reusable piece of the theory of regularly varying tails: the direct and converse halves of Karamata's integral theorem for tails of probability laws.

Difficulty

Both directions pass through the asymptotics of ∫x∞yξ−1R(y) dy\int_x^\infty y^{\xi-1}R(y)\,dy∫x∞​yξ−1R(y)dy against xξR(x)x^\xi R(x)xξR(x). The direct half requires uniform control of R(tx)/R(t)R(tx)/R(t)R(tx)/R(t) over x∈(1,∞)x \in (1,\infty)x∈(1,∞) to exchange the limit t→∞t\to\inftyt→∞ with an integral over an unbounded range; pointwise convergence of the tail ratio alone does not dominate the integrand. The converse half must recover regular variation of RRR from the behaviour of a single integral functional, and here the limit value matters: the page's hypothesis that the limit merely exists does not identify α\alphaα (see below), so an argument that never uses the value (1−ξ/α)−1(1-\xi/\alpha)^{-1}(1−ξ/α)−1 cannot succeed.

Formalization scope

  • The law of XXX is μ : Measure ℝ with IsProbabilityMeasure μ; F(x)<1F(x) < 1F(x)<1 for all xxx is ∀ x, 0 < μ (Set.Ioi x). All conditional quantities divide by μ (Set.Ioi t), which this hypothesis keeps nonzero.
  • "∫0∞yξdF(y)\int_0^\infty y^\xi dF(y)∫0∞​yξdF(y) is finite" is IntegrableOn (fun y => y ^ ξ) (Set.Ioi 0) μ (real power on positive bases). In the "only if" half it is part of the conclusion, never an assumption; Lean's value 000 for a non-integrable Bochner integral therefore cannot make the statements hold trivially. Milestone 1 asserts integrability of yξ−1R(y)y^{\xi-1}R(y)yξ−1R(y) on (x,∞)(x,\infty)(x,∞) as well.
  • "lim⁡t→∞\lim_{t\to\infty}limt→∞​" is Tendsto … atTop along real ttt; the limit form of Dr(Γα)D_r(\Gamma_\alpha)Dr​(Γα​) is required for every x>0x > 0x>0, as printed (the limit Γα(x−1)\Gamma_\alpha(x-1)Γα​(x−1) is continuous, so this is weak convergence). The goal uses this explicit form, the one given after "i.e." on the page, not a separate definition of DrD_rDr​.
  • ∫0∞xξdΓα(x−1)\int_0^\infty x^\xi d\Gamma_\alpha(x-1)∫0∞​xξdΓα​(x−1) is the integral against a probability measure whose distribution function (ProbabilityTheory.cdf) is x↦Γα(x−1)x \mapsto \Gamma_\alpha(x-1)x↦Γα​(x−1); milestone 2 asserts such a measure exists and computes the moment for every such measure.
  • Corrected statement. The source is the published article (Annals of Probability, DOI 10.1214/aop/1176996548). As printed, the "if" direction asks only that c=lim⁡E((X/t)ξ∣X>t)c = \lim E((X/t)^\xi \mid X>t)c=limE((X/t)ξ∣X>t) exist and be finite. That is false: the tail R(x)=x−βR(x) = x^{-\beta}R(x)=x−β for x≥1x \ge 1x≥1, with β>ξ\beta > \xiβ>ξ and β≠α\beta \ne \alphaβ=α, has a finite ξ\xiξ-th moment and E((X/t)ξ∣X>t)=(1−ξ/β)−1E((X/t)^\xi\mid X > t) = (1-\xi/\beta)^{-1}E((X/t)ξ∣X>t)=(1−ξ/β)−1 for all t≥1t \ge 1t≥1, but its limit law is Γβ(x−1)\Gamma_\beta(x-1)Γβ​(x−1). The goal and milestone 4 require c=(1−ξ/α)−1c = (1-\xi/\alpha)^{-1}c=(1−ξ/α)−1, the value the page itself states in "Then c=(1−ξ/α)−1c = (1-\xi/\alpha)^{-1}c=(1−ξ/α)−1". The "only if" direction is exactly the page's.
  • No hypothesis beyond the page is added; α>0\alpha > 0α>0 follows from 0<ξ<α0 < \xi < \alpha0<ξ<α.

A complete development needs regularly varying functions, uniform convergence (or Potter bounds) for regularly varying tails, and Karamata's integral theorem with its converse; all are reusable beyond this mission. Proofs of the milestones, of these general tools, and of the Pareto moment computation are welcome.

Selected references

  • A. A. Balkema and L. de Haan, Residual life time at great age, Annals of Probability 2 (1974), no. 5, 792–804. https://doi.org/10.1214/aop/1176996548
  • L. de Haan, On Regular Variation and Its Application to the Weak Convergence of Sample Extremes, Mathematical Centre Tracts 32, Amsterdam, 1970 (Theorem 1.2.1 and Remark 1.2.1).
  • N. H. Bingham, C. M. Goldie and J. L. Teugels, Regular Variation, Cambridge University Press, 1987. https://doi.org/10.1017/CBO9780511721434
  • I. Meilijson, Limiting properties of the mean residual lifetime function, Annals of Mathematical Statistics 43 (1972), 354–357. https://doi.org/10.1214/aoms/1177692729
  • J. Pickands III, Statistical inference using extreme order statistics, Annals of Statistics 3 (1975), 119–131. https://doi.org/10.1214/aos/1176343003
8 thms2 active usersReviewed
🏆Completed
ProbabilityStatistics·Captain: mikedeng1

Residual Life Time at Great Age 2: The Domain of Residual Life Time Attraction of the Exponential Law Is D(Λ) ∩ D₀Research Paper

Motivation

A lifetime observed only after it has survived to a high age is described by its residual life: the additional time until failure, conditional on survival so far. Reliability analysis asks whether these conditional distributions settle into a stable shape after scaling and shifting. Extreme-value theory asks a related question about the largest observation in a large independent sample. Balkema and de Haan identify an exact connection between these questions for the exponential residual-life limit and the Gumbel maxima limit in Theorem 3 of their 1974 article. The connection lets one recognize the asymptotic form of old-age lifetimes from the domain of attraction of sample maxima, provided the lifetime distribution has no finite upper endpoint.

The article studies several residual-life limits. This mission isolates its exponential case, where the limiting conditional excess has distribution function Π(x)=1−e−x\Pi(x)=1-e^{-x}Π(x)=1−e−x for x≥0x\ge0x≥0. The other continuous family Γα\Gamma_\alphaΓα​ and the paper's discrete limits have separate hypotheses and attraction domains; they are outside this theorem.

Setting

Let XXX have a probability distribution function FFF on R\mathbb RR, and let its survival function be R(x)=Pr⁡(X>x)=1−F(x)R(x)=\Pr(X>x)=1-F(x)R(x)=Pr(X>x)=1−F(x). For a threshold ttt with R(t)>0R(t)>0R(t)>0, the residual-life distribution function is

Ft(x)=Pr⁡(X−t≤x∣X>t)=Pr⁡(t<X≤t+x)R(t).F_t(x)=\Pr(X-t\le x\mid X>t)=\frac{\Pr(t<X\le t+x)}{R(t)}.Ft​(x)=Pr(X−t≤x∣X>t)=R(t)Pr(t<X≤t+x)​.

It is zero for x<0x<0x<0. The class D0D_0D0​ consists of the distributions with R(x)>0R(x)>0R(x)>0 for every real xxx. This says that the upper endpoint is infinite and makes FtF_tFt​ meaningful at every threshold.

A law FFF belongs to the domain of residual-life attraction Dr(G)D_r(G)Dr​(G) when F∈D0F\in D_0F∈D0​ and there are a positive scale a(t)a(t)a(t) and a shift b(t)b(t)b(t) such that Ft(b(t)+xa(t))F_t(b(t)+xa(t))Ft​(b(t)+xa(t)) converges weakly to G(x)G(x)G(x) as t→∞t\to\inftyt→∞. The shift here acts on X−tX-tX−t, the residual lifetime. Weak convergence means convergence at every continuity point of the limiting distribution function; it does not require convergence at a jump.

For maxima, FFF belongs to the domain of attraction D(G)D(G)D(G) if there are sequences an>0a_n>0an​>0 and bnb_nbn​ for which F(anx+bn)nF(a_nx+b_n)^nF(an​x+bn​)n converges weakly to G(x)G(x)G(x) as n→∞n\to\inftyn→∞. The power is the distribution function of the maximum of nnn independent observations after the indicated normalization. The relevant limit laws are the exponential residual-life law and the Gumbel law:

Π(x)={0,x<0,1−e−x,x≥0,Λ(x)=e−e−x(x∈R).\Pi(x)=\begin{cases}0,&x<0,\\1-e^{-x},&x\ge0,\end{cases}\qquad \Lambda(x)=e^{-e^{-x}}\quad(x\in\mathbb R).Π(x)={0,1−e−x,​x<0,x≥0,​Λ(x)=e−e−x(x∈R).

These definitions and formulas come from the introduction and §2 of the published article, printed pages 792–793 and 798.

Formalization targets

Theorem 3: the exact domain identity

The goal is the identity stated on printed page 798:

Dr(Π)=D(Λ)∩D0.D_r(\Pi)=D(\Lambda)\cap D_0.Dr​(Π)=D(Λ)∩D0​.

Both inclusions are required. In particular, membership in the maxima domain alone is insufficient: the maximum of a sample can have a Gumbel limit even when the underlying distribution has a finite upper endpoint, while residual life cannot be conditioned on survival beyond that endpoint. The D0D_0D0​ condition is therefore part of the mathematical claim.

Supporting targets

The milestone list follows the statements used in the article's treatment of Theorem 3: the convergence-of-types remark on page 795; Lemma 3's asymptotic ratio R(x−0)/R(x+0)→1R(x-0)/R(x+0)\to1R(x−0)/R(x+0)→1; the tail criterion nR(bn+xan)→e−xnR(b_n+xa_n)\to e^{-x}nR(bn​+xan​)→e−x associated with Gumbel attraction; the inclusion D(Λ)∩D0⊆Dr(Π)D(\Lambda)\cap D_0\subseteq D_r(\Pi)D(Λ)∩D0​⊆Dr​(Π); and the passage from this tail limit on x>0x>0x>0 to all x∈Rx\in\mathbb Rx∈R. The last step retains the same normalization sequences. The article presents the criterion in one direction and relies on its converse at the end; the formal milestone records both directions with the same sequences.

Significance

The identity translates a conditional limit at a moving high threshold into a classical maxima-domain statement. A theorem about sample extremes can therefore characterize whether normalized remaining lifetime is asymptotically exponential. Conversely, observing exponential residual-life attraction determines a Gumbel maxima limit once the tail normalization is extended across the real line. The condition D0D_0D0​ marks exactly where the conditional lifetime exists; omitting it would misstate the equivalence.

The article proves the result mathematically. The Lean targets here provide a precise representation of its distributions, normalizations, and limiting claims, with Theorem 3 still posed for formal proof. A complete development would add proofs of the supporting tail and convergence-of-types statements, then establish both inclusions. The definitions of weak convergence at continuity points, survival functions, and attraction domains can also support later formalizations of the paper's Pareto and discrete cases.

Difficulty

The simple comparison F(anx+bn)n≈e−nR(anx+bn)F(a_nx+b_n)^n\approx e^{-nR(a_nx+b_n)}F(an​x+bn​)n≈e−nR(an​x+bn​) only relates the two limits after a suitable normalization is already available. The reverse direction starts with conditional residual-life convergence indexed by real thresholds, whereas maxima attraction needs a sequence indexed by integers. Sampling thresholds must preserve the tail asymptotics despite possible atoms. More seriously, the residual-life statement initially yields the required scaled-tail convergence only for positive arguments. The maxima limit must hold on the whole real line. A proof confined to that half-line cannot establish D(Λ)D(\Lambda)D(Λ); the continuation across its left boundary is the central difficulty highlighted by the article on printed pages 798–799.

Formalization scope

Lean represents FFF as the cumulative distribution function of a probability measure on R\mathbb RR and uses real-valued probabilities of intervals for RRR and FtF_tFt​. The residual-life denominator is positive wherever DrD_rDr​ is asserted. The extrema normalization is indexed by natural numbers, while the residual-life normalization is indexed by real thresholds. The scale is positive at every index; only large indices affect the limit. Weak convergence is encoded at every continuity point of the limit. As Π\PiΠ and Λ\LambdaΛ are continuous, their particular domain conditions amount to convergence at every real argument.

The paper uses two shift conventions: Ft(b(t)+xa(t))F_t(b(t)+xa(t))Ft​(b(t)+xa(t)) shifts X−tX-tX−t, while the scaled-tail expressions R(bn+xan)R(b_n+xa_n)R(bn​+xan​) shift XXX. Each statement uses the convention of its source passage. The convergence-of-types remark makes explicit the antitonicity and right-continuity of its limiting tails and states its identity where both arguments lie in the half-line on which convergence is known. Gnedenko's criterion is formalized as an equivalence: the printed sentence states the forward implication, and the conclusion of Theorem 3 uses the converse. The page-799 expression R(b(t)+xa(t))/(t)R(b(t)+xa(t))/(t)R(b(t)+xa(t))/(t) has a missing RRR in the denominator; the formal statement uses the intended R(t)R(t)R(t), consistent with conditional probability and with equation (11). These choices prevent a zero-denominator quotient or an out-of-domain limit identity from trivializing a target. In particular, D0D_0D0​ is part of the definition of Dr(G)D_r(G)Dr​(G): without it a law with a finite upper endpoint would have R(t)=0R(t)=0R(t)=0 for large ttt, the conditional distribution would be the junk quotient 0/0=00/0=00/0=0, and the domain would be mis-specified. In Lemma 3 the limit GGG is the distribution function of a probability measure, assumed continuous on all of R\mathbb RR.

The development needs measure-theoretic cumulative distributions and interval probabilities, filters for limits, and real exponential identities. The domain definitions and scaled-tail predicate are reusable beyond this theorem. Contributions that prove the stated milestones, or supply general lemmas about weak convergence and normalized tails, fit the scope.

Selected references

  • A. A. Balkema and L. de Haan, Residual Life Time at Great Age, The Annals of Probability 2(5), 792–804 (1974). DOI: 10.1214/aop/1176996548.
  • B. Gnedenko, Sur la distribution limite du terme maximum d'une série aléatoire, Annals of Mathematics 44(3), 423–453 (1943). DOI: 10.2307/1968974.
11 thms2 active usersReviewed
🏆Completed
ProbabilityStatistics·Captain: mikedeng1

Residual Life Time at Great Age 3: F Is in the Domain of Residual Life Time Attraction of Π_{p,c} iff It Is Tail Equivalent to a Discrete Law with Gap Ratios → e^{pc} and Tail Ratios → e^{−p}Research Paper

Residual life at great age

A component that has survived to age ttt has a residual life time X−tX - tX−t, and in reliability, actuarial work and the analysis of excesses over high thresholds the question is what its conditional law looks like when ttt is large. Balkema and de Haan (Ann. Probab. 2 (1974), 792–804) answered this in full generality: after an affine normalization, the only possible limit laws are the exponential law Π\PiΠ, the Pareto-type laws Γα\Gamma_\alphaΓα​, and a two-parameter family of discrete laws Πp,c\Pi_{p,c}Πp,c​. The continuous half of their classification became the Pickands–Balkema–de Haan theorem behind the peaks-over-threshold method of extreme-value statistics. The discrete half is less known, and this mission treats it: Theorem 5 of the paper (§3, p. 800) describes exactly which lifetimes are attracted to Πp,c\Pi_{p,c}Πp,c​.

Discrete limits appear only when the normalization is allowed both a scale and a shift. They describe lifetimes that live, asymptotically, on a lattice-like set of ages whose spacing grows geometrically, with a fixed fraction of survivors failing at each lattice point.

The source is the published article in The Annals of Probability (DOI 10.1214/aop/1176996548); page numbers below are the journal's.

Setting

Let XXX be a real random variable with law μ\muμ, distribution function FFF and tail R(x)=1−F(x)=P{X>x}R(x) = 1 - F(x) = P\{X > x\}R(x)=1−F(x)=P{X>x}, and assume F(x)<1F(x) < 1F(x)<1 for every xxx. The residual life distribution function at age ttt is (1), p. 792,

Ft(x)=P{X−t≤x∣X>t}=μ((t,t+x])μ((t,∞)).F_t(x) = P\{X - t \le x \mid X > t\} = \frac{\mu((t, t+x])}{\mu((t,\infty))}.Ft​(x)=P{X−t≤x∣X>t}=μ((t,∞))μ((t,t+x])​.

A family of distribution functions HtH_tHt​ converges weakly to GGG if Ht(x)→G(x)H_t(x) \to G(x)Ht​(x)→G(x) at every continuity point xxx of GGG. The domain of residual life time attraction Dr(G)D_r(G)Dr​(G) (p. 798) is the set of FFF with F(x)<1F(x) < 1F(x)<1 for all xxx for which some a(t)>0a(t) > 0a(t)>0 and b(t)b(t)b(t) give

Ft(b(t)+xa(t))→G(x)weakly as t→∞.F_t(b(t) + x a(t)) \to G(x) \quad \text{weakly as } t \to \infty.Ft​(b(t)+xa(t))→G(x)weakly as t→∞.

For p>0p > 0p>0 and c≥0c \ge 0c≥0 the discrete limit law is (p. 793), for x≥0x \ge 0x≥0,

Πp,c(x)=1−exp⁡(−p[1+log⁡(1+cx)cp]) (c>0),Πp,0(x)=1−exp⁡(−p[1+xp]),\Pi_{p,c}(x) = 1 - \exp\Big(-p\Big[1 + \frac{\log(1+cx)}{cp}\Big]\Big) \ (c > 0), \qquad \Pi_{p,0}(x) = 1 - \exp\Big(-p\Big[1 + \frac{x}{p}\Big]\Big),Πp,c​(x)=1−exp(−p[1+cplog(1+cx)​]) (c>0),Πp,0​(x)=1−exp(−p[1+px​]),

and Πp,c(x)=0\Pi_{p,c}(x) = 0Πp,c​(x)=0 for x<0x < 0x<0; [ ⋅ ][\,\cdot\,][⋅] is the integer part. Its tail takes the values e−p,e−2p,…e^{-p}, e^{-2p}, \dotse−p,e−2p,… and jumps at (ekpc−1)/c(e^{kpc} - 1)/c(ekpc−1)/c, k=0,1,…k = 0, 1, \dotsk=0,1,… (at kpkpkp if c=0c = 0c=0).

A distribution function F0=1−R0F_0 = 1 - R_0F0​=1−R0​ is discrete with jump sequence t0<t1<⋯t_0 < t_1 < \cdotst0​<t1​<⋯ if the tnt_ntn​ are unbounded, each carries positive mass and there is no other mass. Two distribution functions with Fi(x)<1F_i(x) < 1Fi​(x)<1 for all xxx are tail equivalent if 1−F1(x)∼1−F2(x)1 - F_1(x) \sim 1 - F_2(x)1−F1​(x)∼1−F2​(x) as x→∞x \to \inftyx→∞. The conditions of §3 are

(12a)  tn+1−tntn−tn−1→epc,(12b)  R0(tn+1)R0(tn)→e−p.\text{(12a)}\ \ \frac{t_{n+1} - t_n}{t_n - t_{n-1}} \to e^{pc}, \qquad \text{(12b)}\ \ \frac{R_0(t_{n+1})}{R_0(t_n)} \to e^{-p}.(12a)  tn​−tn−1​tn+1​−tn​​→epc,(12b)  R0​(tn​)R0​(tn+1​)​→e−p.

Formalization targets

Goal: Theorem 5 (p. 800)

For p>0p > 0p>0 and c≥0c \ge 0c≥0,

F∈Dr(Πp,c)  ⟺  F is tail equivalent to a discrete F0 whose jumps satisfy (12a) and whose tail satisfies (12b).F \in D_r(\Pi_{p,c}) \iff F \text{ is tail equivalent to a discrete } F_0 \text{ whose jumps satisfy (12a) and whose tail satisfies (12b).}F∈Dr​(Πp,c​)⟺F is tail equivalent to a discrete F0​ whose jumps satisfy (12a) and whose tail satisfies (12b).

Milestones

  1. (§3, pp. 799–800) A discrete FFF satisfying (12a) and (12b) lies in Dr(Πp,c)D_r(\Pi_{p,c})Dr​(Πp,c​).
  2. (§3, p. 800) If F1F_1F1​ is tail equivalent to F2∈Dr(Πp,c)F_2 \in D_r(\Pi_{p,c})F2​∈Dr​(Πp,c​), then F1∈Dr(Πp,c)F_1 \in D_r(\Pi_{p,c})F1​∈Dr​(Πp,c​). Milestones 1 and 2 give the "if" half.
  3. (Proof of Theorem 5, p. 800) If F∈Dr(Πp,c)F \in D_r(\Pi_{p,c})F∈Dr​(Πp,c​), there are bn↑∞b_n \uparrow \inftybn​↑∞ with R(bn+1)/R(bn)→e−pR(b_{n+1})/R(b_n) \to e^{-p}R(bn+1​)/R(bn​)→e−p and a discrete F0F_0F0​, tail equivalent to FFF, with R0(tn)=R(bn)R_0(t_n) = R(b_n)R0​(tn​)=R(bn​) at its jumps.
  4. (Proof of Theorem 5, pp. 800–801) Such an F0F_0F0​ satisfies (12b) and (12a). Milestones 3 and 4 give the "only if" half.

Significance

Theorem 5, together with Theorems 1, 3 and 4 of the paper, completes the description of residual-life attraction: every nondegenerate limit is of one of the listed types, and each type's domain of attraction is identified. For the discrete types the answer is a statement purely about the geometry of the atoms of an approximating law, which makes membership checkable for concrete lifetimes (geometric-type laws on {0,1,2,… }\{0, 1, 2, \dots\}{0,1,2,…} fall under c=0c = 0c=0, laws on a geometric grid {λn}\{\lambda^n\}{λn} under c>0c > 0c>0). It also explains why discrete limits are invisible when only a scale normalization is allowed.

The theorem has been proved since 1974; it has not been formalized. A machine-checked development would supply weak convergence of distribution functions at continuity points, residual-life normalizations and tail equivalence as reusable objects, and would check a proof that the paper compresses into a page, including a convergence-of-types step on a half line that the paper cites from its own §1.

Difficulty

The "if" half is close to a computation, but the computation is about weak convergence to a step function: the normed tails converge only off the jumps, and the normalization must be extended from the jump times tnt_ntn​ to all real ages ttt.

The "only if" half is the core. From F∈Dr(Πp,c)F \in D_r(\Pi_{p,c})F∈Dr​(Πp,c​) alone one has to manufacture the atoms tnt_ntn​ of a discrete law that FFF itself need not have. The obvious attempt, reading the atoms off the jumps of FFF, fails because FFF may be continuous: membership in Dr(Πp,c)D_r(\Pi_{p,c})Dr​(Πp,c​) only says that FFF drops by a factor close to e−pe^{-p}e−p over short stretches, relative to the normalization, and never by an intermediate factor. Making "never by an intermediate factor" precise uniformly in the age ttt, with normalizations a(t),b(t)a(t), b(t)a(t),b(t) about which nothing but their existence is known, is where the work lies; the same lack of control over a(t)a(t)a(t) is what makes the gap ratio (12a) hard to extract.

Formalization scope

A law is a measure μ : Measure ℝ with IsProbabilityMeasure μ; the tail R(x)R(x)R(x) is (μ (Set.Ioi x)).toReal, and Ft(x)F_t(x)Ft​(x) is μ((t, t+x]) / μ((t,∞)). Dr(G)D_r(G)Dr​(G) (InDr) includes F(x)<1F(x) < 1F(x)<1 for all xxx, normalizations a(t)>0a(t) > 0a(t)>0 for all real ttt, and "weakly" means convergence at every continuity point of GGG and nowhere else; requiring convergence at the jumps of Πp,c\Pi_{p,c}Πp,c​ would make Dr(Πp,c)D_r(\Pi_{p,c})Dr​(Πp,c​) empty. Πp,c\Pi_{p,c}Πp,c​ (piPC) is defined by cases c=0c = 0c=0 / c>0c > 0c>0 with Int.floor, so that c=0c = 0c=0 is not the junk value of a division by zero; it is used only with p>0p > 0p>0, c≥0c \ge 0c≥0. A discrete law with jump sequence ttt (IsDiscreteWithJumps) has ttt strictly increasing and tending to ∞\infty∞, positive mass at each tnt_ntn​ and no mass elsewhere. (12a) is indexed from n=1n = 1n=1. Tail equivalence (TailEquiv) includes Fi(x)<1F_i(x) < 1Fi​(x)<1 for both laws.

Conventions and disclosed readings:

  • The page proves the "if" direction by showing convergence to a function of the type of 1−Πp,c1 - \Pi_{p,c}1−Πp,c​; since DrD_rDr​ lets a,ba, ba,b be chosen freely, milestone 1 is stated with Πp,c\Pi_{p,c}Πp,c​ itself.
  • The proof of Theorem 5 uses the normalization (2)–(3) of p. 794, where b(t)b(t)b(t) shifts XXX rather than X−tX - tX−t; milestone 3 only asserts the existence of the sequence bnb_nbn​ with R(bn+1)/R(bn)→e−pR(b_{n+1})/R(b_n) \to e^{-p}R(bn+1​)/R(bn​)→e−p, so no convention enters its statement.
  • "F0F_0F0​ only takes the values F(bn)F(b_n)F(bn​)" is formalized as R0(tn)=R(bn)R_0(t_n) = R(b_n)R0​(tn​)=R(bn​) for all nnn, the form the next paragraph of the page uses. This identity is a hypothesis of milestone 4, as on the page, and cannot be dropped: a law tail equivalent to FFF may carry extra atoms of vanishing relative mass, at which (12a) and (12b) fail.
  • The page identifies the limit of the gap ratios as the scale constant AAA of a functional equation; milestone 4 states it as epce^{pc}epc, the gap ratio of the jumps of Πp,c\Pi_{p,c}Πp,c​.
  • Theorem 5 prints "distribution fuction"; this typo is kept in the quoted text only.

No statement is trivialized: Dr(Πp,c)D_r(\Pi_{p,c})Dr​(Πp,c​) is nonempty (the geometric law on {0,1,2,… }\{0,1,2,\dots\}{0,1,2,…} lies in Dr(Πp,0)D_r(\Pi_{p,0})Dr​(Πp,0​)), and Theorem 5 is not a definitional unfolding, since DrD_rDr​ is defined by weak convergence and the right-hand side by discrete approximation.

A complete development needs: weak convergence of distribution functions at continuity points, a convergence-of-types lemma on a half line (the Remark after Lemma 1 of the paper, p. 795), and elementary facts on step functions. The first two are reusable across the whole paper and across extreme-value theory. Contributions of either half of the theorem, or of the convergence-of-types lemma, are welcome.

Selected references

  • A. A. Balkema, L. de Haan, Residual Life Time at Great Age, The Annals of Probability 2 (1974), no. 5, 792–804. https://doi.org/10.1214/aop/1176996548
  • J. Pickands III, Statistical Inference Using Extreme Order Statistics, The Annals of Statistics 3 (1975), 119–131. https://doi.org/10.1214/aos/1176343003
  • B. V. Gnedenko, Sur la distribution limite du terme maximum d'une série aléatoire, Annals of Mathematics 44 (1943), 423–453. https://doi.org/10.2307/1968974
  • L. de Haan, On Regular Variation and Its Application to the Weak Convergence of Sample Extremes, Mathematical Centre Tracts 32, Amsterdam, 1970.
9 thms2 active usersReviewed
🏆Completed
Dynamic ProgrammingLinear OptimizationOptimization·Captain: mikedeng1

Economic Lot Sizing: An O(n log n) Algorithm That Runs in Linear Time in the Wagner-Whitin Case 2: The Greedy Forward Dual Solution Is Optimal and Its Value Is the Lot-Sizing CostResearch Paper

Motivation

Economic lot sizing asks when to produce goods across a finite planning horizon when demand in each period is known. Producing in a period incurs a fixed setup charge and a marginal cost per unit, while goods may be produced before the period in which they are needed. Such a decision has to balance paying another setup charge against producing more units earlier. The model is a standard setting for studying how dynamic programming and linear optimization describe the same planning decision. Wagelmans, Van Hoesel and Kolen study faster algorithms for this model and, in Section 4, connect the optimal lot-sizing cost to a greedy solution of a dual program Wagelmans et al. (1992).

The dual connection is useful in its own right. It supplies a certificate for the cost returned by the forward dynamic program: a feasible dual vector attains that cost. The paper allows demand to vanish in some periods, which makes the dual values at those periods free and forces care in defining the dynamic program. The mission targets precisely that case.

Setting

There are periods 1,…,n1,\ldots,n1,…,n. Demand dtd_tdt​ and setup cost fif_ifi​ are nonnegative for the periods in the horizon. The marginal production cost cic_ici​ is any real number. Write di,j=∑t=ijdtd_{i,j}=\sum_{t=i}^j d_tdi,j​=∑t=ij​dt​ for cumulative demand from iii through jjj. Values at period zero and beyond the horizon are bookkeeping only; every optimization constraint concerns periods 1,…,n1,\ldots,n1,…,n.

The forward lot-sizing cost F(j)F(j)F(j) describes the least cost of serving periods 1,…,j1,\ldots,j1,…,j under the zero-inventory property cited by the paper. Its recursion starts with F(0)=0F(0)=0F(0)=0. If dj=0d_j=0dj​=0, no new production is needed and F(j)=F(j−1)F(j)=F(j-1)F(j)=F(j−1). If dj>0d_j>0dj​>0, the last production setup may occur at some i≤ji\le ji≤j, giving

F(j)=min⁡1≤i≤j(fi+cidi,j+F(i−1)).F(j)=\min_{1\le i\le j}\bigl(f_i+c_i d_{i,j}+F(i-1)\bigr).F(j)=1≤i≤jmin​(fi​+ci​di,j​+F(i−1)).

This piecewise definition matters even when only one period has zero demand. Taking the displayed minimum at dj=0d_j=0dj​=0 would charge a setup that need not occur.

Program D′ chooses free real values v1,…,vnv_1,\ldots,v_nv1​,…,vn​ to maximize ∑t=1ndtvt\sum_{t=1}^n d_tv_t∑t=1n​dt​vt​, subject to

∑t=indtmax⁡{0,vt−ci}≤fi(1≤i≤n).\sum_{t=i}^n d_t\max\{0,v_t-c_i\}\le f_i \qquad(1\le i\le n).t=i∑n​dt​max{0,vt​−ci​}≤fi​(1≤i≤n).

“Free” means there is no nonnegativity constraint on vtv_tvt​. The paper obtains D′ from the dual of the linear relaxation of its simple plant location formulation, using the variables of Formulation III Wagelmans et al., pp. S147, S152–S153. The mission takes D′ as the defined optimization problem.

The greedy forward rule visits periods in increasing order. At a period with dj>0d_j>0dj​>0, the chosen value is the minimum of the upper bounds left by the constraints indexed i≤ji\le ji≤j:

vj=min⁡1≤i≤j(ci+fi−∑t=ij−1dtmax⁡{0,vt−ci}dj).v_j=\min_{1\le i\le j} \left(c_i+\frac{f_i-\sum_{t=i}^{j-1}d_t\max\{0,v_t-c_i\}}{d_j}\right).vj​=1≤i≤jmin​(ci​+dj​fi​−∑t=ij−1​dt​max{0,vt​−ci​}​).

When dj=0d_j=0dj​=0, the rule places no restriction on vjv_jvj​. This matches the paper's statement that it may be assigned an arbitrary value. One concrete recursive vector in the definitions sets each such value to zero, but the goal covers every assignment.

Formalization targets

The goal says that every vector satisfying the greedy rule is feasible for D′, agrees with the dynamic-programming cost at every prefix, and is optimal among all feasible D′ vectors:

∑t=1jdtvt=F(j)(1≤j≤n),∑t=1ndtut≤∑t=1ndtvtfor every feasible u.\sum_{t=1}^j d_tv_t=F(j)\quad(1\le j\le n), \qquad \sum_{t=1}^n d_tu_t\le\sum_{t=1}^n d_tv_t \quad\text{for every feasible }u.t=1∑j​dt​vt​=F(j)(1≤j≤n),t=1∑n​dt​ut​≤t=1∑n​dt​vt​for every feasible u.

The milestone path follows the Section 4 statements: feasibility of the greedy vector; decreasing greedy values across positive-demand periods; the prefix upper bound for any feasible dual vector; and Equation (2), which expresses a greedy prefix value using a minimizing production period. Equation (2) is stated with the induction hypothesis that appears immediately before it in the paper. The goal combines these claims without treating the desired value identity as a hypothesis.

Significance

The result identifies a dual certificate whose value matches the forward lot-sizing cost. It also explains why a greedy forward assignment can solve D′ despite each constraint linking the current value with all later periods. The full-horizon identity recovers the cost F(n)F(n)F(n), and the comparison with every feasible vector makes the word “optimal” precise. The paper additionally says that this dual computation directly provides an optimal primal solution; this mission does not encode that reconstruction because it would require the primal formulation and its correspondence to FFF Wagelmans et al., p. S153.

A formal proof would provide a reusable finite-horizon certificate theorem for this dual formulation and a careful treatment of empty and zero-demand prefixes. The paper's result is already proved mathematically. The Lean files in this proposal state the goal and its milestones; their theorem proofs remain to be supplied by solvers. Related platform goals about the convex hull of other lot-sizing formulations and the Federgruen–Tzur forward algorithm concern different objects, so they are credited as neighboring work rather than imported as this theorem.

Difficulty

A current greedy value is limited by every earlier production index, and feasibility must still hold for the entire horizon, not merely for the constraints truncated at the current period. Equality with F(j)F(j)F(j) also has to survive periods with zero demand, where the dual coordinate is unrestricted but its weighted contribution vanishes. The forward recurrence has a separate branch at exactly those periods. A formulation that assumes every demand is strictly positive would avoid the delicate case and would miss a feature the authors explicitly retain.

Formalization scope

Lean represents the horizon by natural-number indices 1,…,n1,\ldots,n1,…,n and the demand, setup, marginal-cost and dual sequences by functions N→R\mathbb N\to\mathbb RN→R. Finite sums use closed intervals; the sum before period jjj uses [i,j)[i,j)[i,j), so it is empty when i=ji=ji=j. Minima are over the nonempty finite set {1,…,j}\{1,\ldots,j\}{1,…,j}, only when j≥1j\ge1j≥1. The horizon n=0n=0n=0 has empty sums and no constraints. The cost and dual values are real, with no sign condition on cic_ici​ or viv_ivi​.

Several informal phrases are made explicit. “The solution is feasible” means every D′ constraint through nnn holds. “Optimal” includes feasibility, every prefix identity, and comparison with every feasible dual vector. “Can be given an arbitrary value” is represented by no greedy-rule condition at zero demand; the theorem quantifies over all vectors that satisfy the positive-demand conditions. The paper states monotonicity for consecutive nonzero-demand periods; the milestone uses any two positive-demand periods, skipping zero-demand positions so it holds for every choice of their dual values. The weak-duality milestone spells out the paper's reference to “duality and the structure of D′” as an inequality for each feasible vector and prefix.

The identification of FFF with the optimum of the primal lot-sizing model relies on the zero-inventory property cited by the authors and is not separately formalized. Neither the equivalence of Program D and D′ nor the recovery of a primal production plan is an item here. The paper's running-time claims, including O(n2)O(n^2)O(n2) for the greedy forward algorithm and O(nlog⁡n)O(n\log n)O(nlogn) for its backward algorithm, are outside the scope: the paper does not fix a machine model or constants for them. A definition of FFF as the optimum of D′ would make the value identity circular; the proposal defines it by the paper's forward recursion instead. The backward algorithm of pp. S153–S155 belongs to a separate development.

Selected references

  • A. Wagelmans, S. Van Hoesel and A. Kolen, Economic Lot Sizing: An O(n log n) Algorithm That Runs in Linear Time in the Wagner-Whitin Case, Operations Research 40, Supplement 1, 1992, S145–S156. DOI
7 thms2 active usersReviewed
🏆Completed
Bandit AlgorithmsDynamic ProgrammingProbability·Captain: mikedeng1

Multi-armed Bandits and the Gittins Index: With Per-Project Horizons the Maximal M-Process Reward Is K − ∫_M^K ∏ᵢ ∂φᵢ/∂m dm and the Gittins Index Rule Attains ItResearch Paper

Motivation

The multi-armed bandit problem asks how to allocate effort sequentially among NNN independent projects, only one of which can be worked on at a time, so as to maximise expected total discounted reward. It is the model behind research planning, clinical-trial allocation and job scheduling, and it is the prototypical example of a Markov decision problem whose state space grows exponentially in NNN yet whose optimal policy is simple. Gittins and Jones (1974) and Gittins (1979) showed that each project can be given an index computed from that project alone, and that it is optimal always to engage a project of largest index. P. Whittle's 1980 paper gave a short proof of this theorem by attaching a retirement option to the process, and extended it to projects with individual horizons.

Timeline:

  • 1974–1979. Gittins and Jones introduce the dynamic allocation index; Gittins (1979, JRSS B) proves its optimality by an interchange argument.
  • 1980. Whittle (JRSS B 42, 143–149) introduces the MMM-process, proves the finite-horizon formula (Theorem 1 below), derives the infinite-horizon identity (12), and extends the result to superprocesses (Theorem 2).
  • 1980s–2010s. Weber (1992) and Tsitsiklis (1994) give further short proofs; the index theory is collected in Gittins, Glazebrook and Weber, Multi-armed Bandit Allocation Indices (Wiley, 2011).

Setting

There are NNN projects. Project iii has a state xix_ixi​ in a measurable space XiX_iXi​. Engaging project iii in state xix_ixi​ earns the expected reward Ri(xi)R_i(x_i)Ri​(xi​) and moves its state by a Markov kernel PiP_iPi​; the other projects' states do not change. Rewards are discounted by β\betaβ, 0≤β<10 \le \beta < 10≤β<1, and bounded:

k(1−β)≤Ri(xi)≤K(1−β).(1)k(1-\beta) \le R_i(x_i) \le K(1-\beta). \qquad (1)k(1−β)≤Ri​(xi​)≤K(1−β).(1)

The operator Liθ(x)=Ri(xi)+β E[θ(x(t+1))∣x(t)=x,i(t)=i]L_i\theta(x) = R_i(x_i) + \beta\,\mathbb E[\theta(x(t+1)) \mid x(t) = x, i(t) = i]Li​θ(x)=Ri​(xi​)+βE[θ(x(t+1))∣x(t)=x,i(t)=i] evaluates engaging project iii for one step.

In the MMM-process one may also retire at any time for the reward MMM. Its value F(x,M)F(x, M)F(x,M) solves F=max⁡(M,max⁡iLiF)F = \max(M, \max_i L_i F)F=max(M,maxi​Li​F) (4), and the value φi(xi,M)\varphi_i(x_i, M)φi​(xi​,M) of the single-project MMM-process solves φi=max⁡(M,Liφi)\varphi_i = \max(M, L_i\varphi_i)φi​=max(M,Li​φi​) (9).

With per-project horizons, project iii may be operated at most sis_isi​ more times. A project with si>0s_i > 0si​>0 is active, and DisD_i sDi​s lowers sis_isi​ by one. The single-project value φi(xi,si,M)\varphi_i(x_i, s_i, M)φi​(xi​,si​,M) satisfies φi(xi,0,M)=M\varphi_i(x_i, 0, M) = Mφi​(xi​,0,M)=M and

φi(xi,si,M)=max⁡[M, Ri(xi)+β E φi(xi(t+1),si−1,M)].(14)\varphi_i(x_i, s_i, M) = \max\big[M,\ R_i(x_i) + \beta\,\mathbb E\,\varphi_i(x_i(t+1), s_i - 1, M)\big]. \qquad (14)φi​(xi​,si​,M)=max[M, Ri​(xi​)+βEφi​(xi​(t+1),si​−1,M)].(14)

F(x,s,M)F(x, s, M)F(x,s,M) is the maximal expected reward of the MMM-process under these limits. The index Mi(xi,si)M_i(x_i, s_i)Mi​(xi​,si​) is the infimal MMM with φi(xi,si,M)=M\varphi_i(x_i, s_i, M) = Mφi​(xi​,si​,M)=M, and vi=(1−β)Miv_i = (1-\beta)M_ivi​=(1−β)Mi​ is the Gittins index. Finally

F^(x,s,M)=K−∫MK∏i∂φi(xi,si,m)∂m dm.(13)\hat F(x, s, M) = K - \int_M^K \prod_i \frac{\partial \varphi_i(x_i, s_i, m)}{\partial m}\, dm. \qquad (13)F^(x,s,M)=K−∫MK​i∏​∂m∂φi​(xi​,si​,m)​dm.(13)

Formalization targets

Goal: Theorem 1 (p. 147)

F(x,s,M)=F^(x,s,M),F(x, s, M) = \hat F(x, s, M),F(x,s,M)=F^(x,s,M),

and FFF is attained by the policy that, at (x,s)(x, s)(x,s), engages a project iii maximising Mi(xi,si)M_i(x_i, s_i)Mi​(xi​,si​) when this maximum exceeds MMM, and otherwise retires. The Lean goal has three conjuncts: F=F^F = \hat FF=F^, every measurable index rule (any tie-breaking) earns FFF, and no feasible measurable Markov policy earns more than FFF.

Milestones (the steps of the proof)

  • Lemma 1 (p. 144): F(x,M)F(x, M)F(x,M) is non-decreasing and convex in MMM, equals Φ(x)\Phi(x)Φ(x) for M≤kM \le kM≤k and MMM for M≥KM \ge KM≥K.
  • (18) (p. 147): Pi(x,s,M)=∏j≠i∂φj/∂MP_i(x,s,M) = \prod_{j \ne i}\partial\varphi_j/\partial MPi​(x,s,M)=∏j=i​∂φj​/∂M is a distribution function in MMM, equal to 111 for M≥M(i)=max⁡j≠iMjM \ge M_{(i)} = \max_{j\ne i} M_jM≥M(i)​=maxj=i​Mj​.
  • (19) (p. 147): F^=φiPi+∫M∞φi dmPi\hat F = \varphi_i P_i + \int_M^\infty \varphi_i\, d_m P_iF^=φi​Pi​+∫M∞​φi​dm​Pi​.
  • (21) (p. 148): F^≥LiF^\hat F \ge L_i\hat FF^≥Li​F^, with equality if Mi=max⁡jMj≥MM_i = \max_j M_j \ge MMi​=maxj​Mj​≥M.
  • Retirement case (p. 148): if max⁡jMj≤M\max_j M_j \le Mmaxj​Mj​≤M then F^=M\hat F = MF^=M.
  • (16) (p. 147): F^=max⁡(M,max⁡iLiF^)\hat F = \max(M, \max_i L_i\hat F)F^=max(M,maxi​Li​F^) and F^(x,0,M)=M\hat F(x, 0, M) = MF^(x,0,M)=M.

Further item

  • Infinite horizon (p. 148, formula (12) of p. 146): F(x,M)=K−∫MK∏i∂φi(xi,m)/∂m dmF(x, M) = K - \int_M^K \prod_i \partial\varphi_i(x_i, m)/\partial m\, dmF(x,M)=K−∫MK​∏i​∂φi​(xi​,m)/∂mdm, with the index rule optimal.

Significance

Theorem 1 reduces an NNN-project problem, whose state space is a product, to NNN one-dimensional retirement problems. The formula (13) shows more than optimality of the index rule: the derivative of the multi-project value in MMM is the product of the single-project derivatives, so the multi-project value is computable from the projects separately. The finite-horizon version gives an inductive argument that avoids the interchange arguments of earlier proofs, and the infinite-horizon identity (12) follows from it.

The result is classical and proved. What this mission adds is a machine-checked version in a generality not yet on the platform: heterogeneous projects (each with its own kernel and reward on its own measurable space), a retirement option, and per-project horizons. The platform already has a proved index theorem for identical arms sharing one kernel and reward without retirement, BanditAlgorithm.gittins_index_theorem (Lattimore–Szepesvári, Theorem 35.9), single-arm retirement values in charge form (GittinsFiniteRetirementValue), and open Beta–Bernoulli special cases from Bäuerle–Rieder (MDPFinance.InfiniteHorizonApplications.proposition_7_6_7, proposition_7_6_9, theorem_7_6_10). None of these states Theorem 1, formula (13) or formula (12).

Difficulty

The obvious approach, value iteration on the product state space, gives existence of an optimal policy but says nothing about its structure. The content of Theorem 1 lies in the identity of a multi-dimensional value with an integral of a product of one-dimensional derivatives. Verifying it requires differentiating single-project values in MMM (they are convex, but have a kink exactly at the index, where the choice of one-sided derivative matters), an integration by parts against a Stieltjes measure in MMM, and an exchange of the expectation over the next state with the MMM-integral. The exhausted projects (si=0s_i = 0si​=0) and the boundary M=MiM = M_iM=Mi​ need separate care in every step.

Formalization scope

  • Projects are indexed by Fin N (0-based; the paper uses 1,…,N1, \dots, N1,…,N). State spaces are arbitrary measurable spaces; no finiteness or countability is assumed. Kernels are Markov, rewards measurable and bounded as in (1), and 0≤β<10 \le \beta < 10≤β<1 (β = 0 is allowed). kkk and KKK are any constants satisfying (1).
  • Budgets are s : Fin N → ℕ; DisD_i sDi​s is Function.update s i (s i - 1) and is only applied to active projects.
  • F(x,s,M)F(x, s, M)F(x,s,M), the "maximal reward", is the backward-induction value: F(x,0,M)=MF(x, 0, M) = MF(x,0,M)=M and F=max⁡(M,max⁡i activeLiF)F = \max(M, \max_{i\ \text{active}} L_iF)F=max(M,maxi active​Li​F), defined by recursion on ∑isi\sum_i s_i∑i​si​. It is not defined through F^\hat FF^, the index, or a policy. φi(xi,si,M)\varphi_i(x_i, s_i, M)φi​(xi​,si​,M) is defined by (14) with φi(xi,0,M)=M\varphi_i(x_i, 0, M) = Mφi​(xi​,0,M)=M.
  • ∂/∂m\partial/\partial m∂/∂m is the right derivative. Since the φi\varphi_iφi​ are convex in mmm, this changes (13) at no point, and it makes (18) hold at the kink M=M(i)M = M_{(i)}M=M(i)​.
  • The index of an exhausted project is the paper's −∞-\infty−∞. In Lean index takes the junk value 0 there; every use (the index rule, M(i)M_{(i)}M(i)​, max⁡jMj\max_j M_jmaxj​Mj​) ranges over active projects only.
  • Policies are Markov in (x,s,M)(x, s, M)(x,s,M), valued in Option (Fin N) (none = retire), feasible (they engage only active projects) and measurable (each decision set is measurable), so that their expected rewards are well defined. The index rule allows arbitrary tie-breaking; the goal quantifies over every such rule.
  • Infinite-horizon values (Lemma 1, the further item) are any bounded measurable solutions of (2), (4), (9); such solutions exist and are unique by the contraction property.
  • (19) uses the Stieltjes measure of any monotone right-continuous function agreeing with PiP_iPi​, and integrates over m>Mm > Mm>M.
  • Trivializing formalizations are excluded: FFF is not F^\hat FF^ by definition, exhausted projects cannot be engaged by the index rule, and maxima over iii are seeded with MMM rather than taken as a junk real supremum.

A complete development needs measurability of the recursive values, convexity of φi\varphi_iφi​ in MMM with one-sided derivatives, Lebesgue–Stieltjes integration by parts, and Fubini for kernels. Convexity of finite-horizon retirement values and the integration-by-parts identity are reusable beyond this mission. Contributions to any milestone, and sorry-free lemmas on these ingredients, are welcome.

Selected references

  • P. Whittle, Multi-armed Bandits and the Gittins Index, J. R. Statist. Soc. B 42(2), 143–149, 1980. https://doi.org/10.1111/j.2517-6161.1980.tb01111.x
  • J. C. Gittins, Bandit Processes and Dynamic Allocation Indices, J. R. Statist. Soc. B 41(2), 148–177, 1979. https://doi.org/10.1111/j.2517-6161.1979.tb01068.x
  • D. Blackwell, Discounted Dynamic Programming, Ann. Math. Statist. 36(1), 226–235, 1965. https://doi.org/10.1214/aoms/1177700285
  • J. Gittins, K. Glazebrook, R. Weber, Multi-armed Bandit Allocation Indices, 2nd ed., Wiley, 2011. https://doi.org/10.1002/9780470980033
  • T. Lattimore, Cs. Szepesvári, Bandit Algorithms, Cambridge University Press, 2020, Chapter 35. https://doi.org/10.1017/9781108571401
8 thms2 active usersReviewed
🏆Completed
CombinatoricsGraph Theory·Captain: mikedeng1

An Introduction to Timetabling 3: Course Scheduling with Unavailabilities and Preassignments in p Periods Is Equivalent to p-Coloring the Nodes of a GraphResearch Paper

Motivation

Universities schedule lectures and examinations every term. When students choose their courses freely, with no fixed curriculum, the basic requirement is that no student is asked to attend two lectures at the same time. On top of this come local constraints: a course cannot take place at some periods (its teacher or a suitable room is unavailable), and some lectures are fixed in advance at a given period. D. de Werra's invited review An introduction to timetabling (Eur. J. Oper. Res. 19 (1985) 151–162) surveys the graph models of these problems. Its §3.1 shows that course scheduling, with unavailabilities and preassignments, is exactly a node colouring problem. This reduction is the standard starting point for graph colouring heuristics in timetabling, including the examination timetabling literature.

Setting

A course scheduling instance has qqq courses KbK_bKb​, course KbK_bKb​ consisting of kbk_bkb​ lectures lal_ala​, and rrr students; student iii takes a set TiT_iTi​ of courses. There are ppp periods.

The lecture graph GGG has one lecture-node mabm_{ab}mab​ for each lecture lal_ala​ of each course KbK_bKb​. Two lecture-nodes of the same course are adjacent. Two lecture-nodes of distinct courses KbK_bKb​, KbˉK_{\bar b}Kbˉ​ are adjacent whenever some student takes both courses.

A feasible course schedule in ppp periods assigns a period s(l)∈{1,…,p}s(l) \in \{1,\dots,p\}s(l)∈{1,…,p} to each lecture so that two lectures of one course are at different periods and no student has two lectures at the same period.

A course scheduling problem with unavailabilities and preassignments (CSUP) adds, for each course KbK_bKb​, a set UbU_bUb​ of forbidden periods, and for some lectures lll a prescribed period kˉ(l)\bar k(l)kˉ(l). A solution is a feasible schedule with s(l)∉Ubs(l) \notin U_bs(l)∈/Ub​ for every lecture lll of KbK_bKb​ and s(l)=kˉ(l)s(l) = \bar k(l)s(l)=kˉ(l) for every preassigned lecture.

The graph G^\hat GG^ of a CSUP adds one period-node kkk per period to GGG. All pairs of period-nodes are adjacent. A lecture-node of KbK_bKb​ is adjacent to period-node kkk if k∈Ubk \in U_bk∈Ub​. A lecture-node of a lecture preassigned to kˉ\bar kkˉ is adjacent to every period-node k≠kˉk \neq \bar kk=kˉ.

A node colouring with ppp colours assigns one of ppp colours to each node so that adjacent nodes get different colours.

Formalization targets

Goal: Proposition 3.1

the CSUP P has a solution in p periods  ⟺  G^(P) has a node colouring with p colours.\text{the CSUP } P \text{ has a solution in } p \text{ periods} \iff \hat G(P) \text{ has a node colouring with } p \text{ colours.}the CSUP P has a solution in p periods⟺G^(P) has a node colouring with p colours.

Milestones

  1. §3.1 (p. 157). Without unavailabilities and preassignments, the feasible schedules in ppp periods are exactly the node colourings of GGG with ppp colours.
  2. Figure 4 (p. 157). For courses K1,K2,K3K_1,K_2,K_3K1​,K2​,K3​ with 1,2,21,2,21,2,2 lectures, student 1 taking K1,K2K_1,K_2K1​,K2​ and student 2 taking K2,K3K_2,K_3K2​,K3​, the printed schedule in 444 periods is feasible.
  3. Proof of Proposition 3.1 (p. 158). Every colouring of G^\hat GG^ with ppp colours gives a solution in which lecture lal_ala​ of KbK_bKb​ is at period kkk exactly when mabm_{ab}mab​ has the colour of period-node kkk, and every solution arises in this way from some colouring.
  4. Proposition 3.2 (p. 158). Let HHH be a graph on lecture-nodes and a clique of ppp period-nodes, with some lecture-nodes precoloured consistently with the colours of period-nodes. Removing the precoloured nodes and joining their neighbours to the matching period-nodes gives a graph G^′\hat G'G^′ with
H has a p-colouring respecting the precolouring  ⟺  G^′ is p-colourable.H \text{ has a } p\text{-colouring respecting the precolouring} \iff \hat G' \text{ is } p\text{-colourable.}H has a p-colouring respecting the precolouring⟺G^′ is p-colourable.

Significance

The result. Proposition 3.1 turns a family of constrained timetabling problems into one well-studied problem. Any exact or heuristic method for node colouring (sequential colouring, DSATUR, implicit enumeration; §3.2 of the paper) applies directly to course scheduling with forbidden and fixed periods, and lower bounds on the chromatic number become lower bounds on the number of periods. Proposition 3.2 adds that preassignments cost nothing for node colouring: a precoloured instance is again a plain colouring instance. For edge colouring the paper contrasts this with the NP-completeness of precoloured edge colouring.

The formalization. The results are proved on the page in a few lines and are not machine-checked anywhere. This mission makes the reduction precise. It writes out the graph G^\hat GG^ as a definition, isolates the consistency condition that Proposition 3.2 needs, and states the correspondence between colourings and schedules in a form other formal timetabling and scheduling developments can use. The definitions of course instances, CSUP and G^\hat GG^ can serve formal work on examination timetabling and on the complexity of timetabling problems.

Difficulty

The forward direction of Proposition 3.1 is direct: colour each lecture-node with its period and each period-node with itself. The converse is where care is needed. A colouring of G^\hat GG^ need not give period-node kkk the colour kkk; the colours of the period-nodes can be any permutation of the palette. The schedule must therefore be read through the colours of the period-nodes, and the fact that the ppp period-nodes form a clique is what makes this well defined.

For Proposition 3.2, the obvious reading of the page is false. If two adjacent lecture-nodes are precoloured with the same colour, no colouring respects the precolouring, yet removing both nodes deletes the edge between them and the reduced graph may still be colourable. The same happens when a node is precoloured with the colour of a period-node it is adjacent to. The proposition therefore needs a consistency condition the page leaves implicit. The page's "1–1 correspondence" between colourings fails when precolours are fixed colours of the palette, since G^′\hat G'G^′'s colourings can permute the colours of the period clique; the target is the equivalence of the proposition.

Formalization scope

Courses, students, lectures of a course and periods are indexed from 000 (Fin q, Fin r, Fin (lectures b), Fin p). A lecture is a dependent pair Σ b, Fin (lectures b), and the nodes of G^\hat GG^ are Lecture ⊕ Fin p. Graphs and colourings are Mathlib's SimpleGraph, SimpleGraph.Coloring and SimpleGraph.Colorable. Unavailability is per course and preassignment per lecture, as on the page. The set-valued constraint of the Figure 5 example ("1 lecture of K3K_3K3​ at period 1 or 2") is not modelled. Feasibility includes the clique on the lectures of each course even when no student takes the course, because the page's graph contains it. p=0p = 0p=0 is allowed.

The paper states Proposition 3.1 as "one can construct a graph G^\hat GG^ such that …". The existential form is trivially true (pick a complete graph on p+1p+1p+1 nodes or an edgeless graph according to the answer), so the goal is stated about the specific graph csupGraph P built in the proof.

Proposition 3.2 is stated for any graph whose period-nodes form a clique, with two disclosed consistency hypotheses: no precoloured node is adjacent to its own period-node, and no two adjacent nodes are precoloured with the same period-node's colour. A sanity file shows that the equivalence fails without them. "Precoloured" means "receives the colour of period-node kkk", the reading of the proof of Proposition 3.1.

Not targeted: the NP-completeness remarks (cited, not proved), the heuristics of §3.2–§3.4, and the hypergraph classroom model of §3.5, whose "1–1 correspondence" has the same palette-permutation issue as Proposition 3.2.

Contributions welcome: proofs of the milestones and the goal, and general lemmas about colourings of graphs containing a clique of size equal to the number of colours.

Selected references

  • D. de Werra, An introduction to timetabling, European Journal of Operational Research 19 (1985) 151–162. https://doi.org/10.1016/0377-2217(85)90167-5
  • M. R. Garey, D. S. Johnson, Computers and Intractability: A Guide to the Theory of NP-Completeness, W. H. Freeman, 1979 (NP-completeness of graph ppp-colourability, reference [13] of the paper).
  • D. Brélaz, New methods to color the vertices of a graph, Communications of the ACM 22 (1979) 251–256. https://doi.org/10.1145/359094.359101
7 thms2 active usersReviewed
🏆Completed
AnalysisOptimization·Captain: mikedeng1

Vertical Integration and Antitrust Policy: Integrating Successive Monopolies Lowers the Final Price and Raises Output, Joint Profit and Consumer SurplusResearch Paper

Motivation

In 1950 the United States Supreme Court appeared to be moving toward treating corporate integration, horizontal or vertical, as illegal per se under the antitrust laws. Joseph J. Spengler's note in the Journal of Political Economy argued that this conflates two different things: horizontal integration can suppress competition, but vertical integration, the joining of successive stages of production under one owner, can lower prices when the stages are already imperfectly competitive. The note is the standard origin of what industrial organization now calls double marginalization: when a monopolist upstream sells to a monopolist downstream, each adds its own markup, and the final price is higher than a single integrated monopolist would charge.

The argument underlies the modern economics of vertical mergers and vertical restraints (resale price maintenance, two-part tariffs, franchise fees) and the supply-chain coordination literature in operations research, where a wholesale-price contract between a supplier and a retailer reproduces the same distortion.

A short timeline: Cournot (1838, Chapter IX) analysed complementary monopolists selling inputs to a common product; Spengler (1950) gave the successive-monopoly version and drew the antitrust conclusion; Tirole's textbook (1988, §4.2) made it the canonical example of vertical externalities; Cachon and Lariviere (2005) and the coordination literature studied the same inefficiency in newsvendor supply chains.

Setting

A product passes through three successive stages A→B→CA\to B\to CA→B→C before reaching consumers. Production uses fixed proportions: one unit of stage A's product goes into one unit of B's, and one unit of B's into one unit of C's, so all stages handle the same quantity. Each stage has a constant unit variable cost Va,Vb,VcV_a,V_b,V_cVa​,Vb​,Vc​ (marginal cost equal to average variable cost at every relevant output).

Final demand is a function D:R→RD:\mathbb R\to\mathbb RD:R→R: D(p)D(p)D(p) units of CCC are bought at price ppp. A firm with constant unit cost ccc that sells at price ppp earns the profit (return above variable outlay)

πc(p)=(p−c) D(p),\pi_c(p)=(p-c)\,D(p),πc​(p)=(p−c)D(p),

and ppp is a profit-maximizing price at cost ccc when πc(x)≤πc(p)\pi_c(x)\le\pi_c(p)πc​(x)≤πc​(p) for every xxx.

Unintegrated chain. Stage A sells to B at a transfer price PaP_aPa​, B sells to C at PbP_bPb​. Their per-unit profits are Ra=Pa−VaR_a=P_a-V_aRa​=Pa​−Va​ and Rb=Pb−(Vb+Pa)R_b=P_b-(V_b+P_a)Rb​=Pb​−(Vb​+Pa​); horizontal integration within each stage lets these be positive "monopolistic surcharges". Stage C's unit cost is Cc=Vc+PbC_c=V_c+P_bCc​=Vc​+Pb​; it charges a profit-maximizing price PcP_cPc​ at that cost and sells Q=D(Pc)Q=D(P_c)Q=D(Pc​). The chain's aggregate profit is RaQ+RbQ+RcQR_aQ+R_bQ+R_cQRa​Q+Rb​Q+Rc​Q with Rc=Pc−(Vc+Pb)R_c=P_c-(V_c+P_b)Rc​=Pc​−(Vc​+Pb​).

Integrated firm. One firm owns all three stages. Its unit cost is Cc′=Va+Vb+VcC'_c=V_a+V_b+V_cCc′​=Va​+Vb​+Vc​; it charges a profit-maximizing price Pc′P'_cPc′​ at that cost and sells Q′=D(Pc′)Q'=D(P'_c)Q′=D(Pc′​), earning (Pc′−Cc′) Q′(P'_c-C'_c)\,Q'(Pc′​−Cc′​)Q′.

The price elasticity of demand at ppp is e(p)=−p D′(p)/D(p)e(p)=-p\,D'(p)/D(p)e(p)=−pD′(p)/D(p) (positive for a downward-sloping curve) and the marginal revenue is r(p)=p+D(p)/D′(p)r(p)=p+D(p)/D'(p)r(p)=p+D(p)/D′(p). The consumers' surplus gained when the price falls from PcP_cPc​ to Pc′P'_cPc′​ is ∫Pc′PcD(x) dx\int_{P'_c}^{P_c}D(x)\,dx∫Pc′​Pc​​D(x)dx.

Formalization targets

Goal: vertical integration benefits producer and consumer

For every non-increasing demand curve DDD, all unit costs Va,Vb,VcV_a,V_b,V_cVa​,Vb​,Vc​, and all transfer prices with Ra>0R_a>0Ra​>0, Rb>0R_b>0Rb​>0, if PcP_cPc​ is profit-maximizing at cost Vc+PbV_c+P_bVc​+Pb​, Pc′P'_cPc′​ is profit-maximizing at cost Va+Vb+VcV_a+V_b+V_cVa​+Vb​+Vc​, DDD is differentiable at PcP_cPc​ and Q=D(Pc)>0Q=D(P_c)>0Q=D(Pc​)>0, then

Pc′<Pc,D(Pc)<D(Pc′),RaQ+RbQ+RcQ<(Pc′−Cc′) Q′,P'_c<P_c,\qquad D(P_c)<D(P'_c),\qquad R_aQ+R_bQ+R_cQ<(P'_c-C'_c)\,Q',Pc′​<Pc​,D(Pc​)<D(Pc′​),Ra​Q+Rb​Q+Rc​Q<(Pc′​−Cc′​)Q′, 0<∫Pc′PcD(x) dx,Q (Pc−Pc′)≤∫Pc′PcD(x) dx.0<\int_{P'_c}^{P_c}D(x)\,dx,\qquad Q\,(P_c-P'_c)\le\int_{P'_c}^{P_c}D(x)\,dx.0<∫Pc′​Pc​​D(x)dx,Q(Pc​−Pc′​)≤∫Pc′​Pc​​D(x)dx.

The goal fixes no functional form and no numbers; it is the general statement behind the paper's "under all cases conceivable … within the framework here employed".

Milestones

  1. Footnote 6, equilibrium identities. At a profit-maximizing price, r=cr=cr=c, e=p/(p−r)=p/(p−c)e=p/(p-r)=p/(p-c)e=p/(p−r)=p/(p−c), and p=c e/(e−1)p=c\,e/(e-1)p=ce/(e−1) when c≠0c\ne0c=0.
  2. Section III, unitary elasticity. At zero cost, e=1e=1e=1; at positive cost, p>cp>cp>c and e>1e>1e>1.
  3. Section III, cost raises price. For c1<c2c_1<c_2c1​<c2​, profit-maximizing prices satisfy D(p2)≤D(p1)D(p_2)\le D(p_1)D(p2​)≤D(p1​), and p1<p2p_1<p_2p1​<p2​ under the goal's regularity hypotheses.
  4. Footnote 6, straight-line demand. For D(p)=b(a−p)D(p)=b(a-p)D(p)=b(a−p): p∗(c)=(a+c)/2p^*(c)=(a+c)/2p∗(c)=(a+c)/2, Δr=2Δp\Delta r=2\Delta pΔr=2Δp, e(p∗(c))=(a+c)/(a−c)e(p^*(c))=(a+c)/(a-c)e(p∗(c))=(a+c)/(a−c), the elasticity rises relatively more than the price, and the relative rise grows with ccc.
  5. Figure 1. With Dc(p)=85(140−p)D_c(p)=\tfrac85(140-p)Dc​(p)=58​(140−p) and Va=Vb=Vc=20V_a=V_b=V_c=20Va​=Vb​=Vc​=20: Pc=115P_c=115Pc​=115, Q=40Q=40Q=40, aggregate profit 2,2002{,}2002,200; Pc′=100P'_c=100Pc′​=100, Q′=64Q'=64Q′=64, profit 2,5602{,}5602,560; consumers' surplus rises by 780780780.

Significance

The result. The theorem shows that removing an upstream markup can only lower the final price and raise output, so that producers and consumers gain together. This is the economic content of the rule that vertical integration is not anticompetitive as such, and it is the reason modern merger guidelines credit the "elimination of double marginalization" as an efficiency of vertical mergers. Milestone 3, monotonicity of the monopoly price in cost, is the general comparative-statics fact used in tax incidence and cost pass-through.

Formalizing it. The result is classical and proved in every industrial-organization textbook, usually for linear demand. The mission states it for an arbitrary non-increasing demand curve, without concavity, continuity or uniqueness of the profit maximizer, which makes explicit which hypotheses the strict conclusions actually need. Related items on the platform formalize double marginalization in a different model, the newsvendor wholesale-price contract of Cachon and Lariviere, where the supplier-induced order quantity falls short of the integrated one; this mission covers the price-setting, deterministic-demand version.

Difficulty

The weak inequalities (Pc′≤PcP'_c\le P_cPc′​≤Pc​, Q≤Q′Q\le Q'Q≤Q′, profit ≤\le≤) follow from comparing the two maximization problems (the price comparison also uses Q>0Q>0Q>0: if D≡0D\equiv 0D≡0, every price is profit-maximizing). The strict inequalities do not: a demand curve with a kink can have the same profit-maximizing price at two different costs, so integration need not change the price at all. The strict claims therefore need a first-order condition at PcP_cPc​, and the argument has to combine global optimality (all prices) with local information (a derivative at one point) without assuming the profit function is concave or the maximizer unique. The consumers'-surplus clause requires a lower bound on an integral of a monotone, possibly discontinuous function.

Formalization scope

  • Prices, costs and quantities are real numbers; maximization is over all prices p∈Rp\in\mathbb Rp∈R. Demand is a function D:R→RD:\mathbb R\to\mathbb RD:R→R; the goal assumes only that it is non-increasing (Antitone D).
  • Profit-maximizing prices are hypotheses (IsProfitMax D c p), never closed forms; the closed form (a+c)/2(a+c)/2(a+c)/2 appears only for straight-line demand.
  • The transfer prices Pa,PbP_a,P_bPa​,Pb​ are arbitrary data with positive markups; they need not be profit-maximizing for Da,DbD_a,D_bDa​,Db​, which the paper draws only in its figure.
  • Explicit readings of the paper's prose. "Benefits both producer and consumer" and "will lower the price" become the four strict inequalities of the goal. "Aggregate profit" is the sum over the three stages, Q[Pc−(Va+Vb+Vc)]Q[P_c-(V_a+V_b+V_c)]Q[Pc​−(Va​+Vb​+Vc​)], not stage C's profit alone. Consumers' surplus "in the Marshallian sense" is the interval integral of DDD between the two prices; footnote 5's trapezoid formula is used only for the straight line of Figure 1. Elasticity is a positive number −pD′(p)/D(p)-pD'(p)/D(p)−pD′(p)/D(p). "Relatively greater increment in the elasticity" is made exact for straight-line demand as e(p∗(c′))/e(p∗(c))>p∗(c′)/p∗(c)e(p^*(c'))/e(p^*(c))>p^*(c')/p^*(c)e(p∗(c′))/e(p∗(c))>p∗(c′)/p∗(c); the literal Δe/e>Δc/c\Delta e/e>\Delta c/cΔe/e>Δc/c is false for small ccc. Footnote 6's e′=(p+Δp)/(p−2Δp)e'=(p+\Delta p)/(p-2\Delta p)e′=(p+Δp)/(p−2Δp) and "approximating 3Δp/p3\Delta p/p3Δp/p" are a printed slip; the exact e(p∗(c))=(a+c)/(a−c)e(p^*(c))=(a+c)/(a-c)e(p∗(c))=(a+c)/(a−c) is stated instead, and no approximation is formalized. Figure 1's demand line Dc(p)=85(140−p)D_c(p)=\tfrac85(140-p)Dc​(p)=58​(140−p) is the line through the three points the text gives.
  • Added hypotheses. Differentiability of DDD at PcP_cPc​ and D(Pc)>0D(P_c)>0D(Pc​)>0, which the paper's marginal-revenue reasoning presupposes. Every statement involving elasticity or marginal revenue carries differentiability and positive demand, because Lean's deriv and division return 000 on bad input.
  • Ruled out. Formalizations that hard-code linear demand in the goal, compare the integrated profit with stage C's profit alone, or prove only the weak (≤\le≤) inequalities do not capture the result.
  • Sections IV and the policy remarks of Section III (rent evasion, taxes, co-operatives) are not formalized.
  • Only Mathlib is needed: Fermat's rule (IsLocalMax.hasDerivAt_eq_zero), interval integrals of monotone functions, and real arithmetic. Proofs of the general milestones are reusable for any monopoly-pricing comparative statics.

Selected references

  • J. J. Spengler, Vertical integration and antitrust policy, Journal of Political Economy 58(4), 1950, 347–352. https://doi.org/10.1086/256964
  • A. A. Cournot, Recherches sur les principes mathématiques de la théorie des richesses, Hachette, 1838, Chapter IX.
  • J. Tirole, The Theory of Industrial Organization, MIT Press, 1988, §4.2.
  • G. P. Cachon and M. A. Lariviere, Supply chain coordination with revenue-sharing contracts: strengths and limitations, Management Science 51(1), 2005, 30–44. https://doi.org/10.1287/mnsc.1040.0215
7 thms2 active usersReviewed
🏆Completed
Algorithmic Game TheoryCombinatorics·Captain: mikedeng1

On Cores and Indivisibility 1: The Housing Market's Game Without Side Payments Is BalancedResearch Paper

Motivation

A market in which each trader owns one indivisible good has a basic coordination question: can all goods be reassigned so that no group of traders can withdraw its own goods and improve every member's outcome? Houses are the paper's running example. Monetary transfers and fractional houses are absent, so ordinary convex allocation arguments do not describe the setting. Shapley and Scarf use games without side payments to express what each coalition of owners can achieve, and identify a balance property of this game in their Section 4 theorem (Shapley and Scarf, 1974).

The paper states that a general balanced-game theorem gives a nonempty core once balance has been established. Its Section 4 contribution is the classification of this particular housing market game. The separate top-trading-cycles construction in Section 6 gives another route to a core allocation and is the subject of the second mission in this series (Shapley and Scarf, 1974).

Setting

Let NNN be a nonempty finite set of traders. Trader jjj brings one indivisible item jjj. Trader iii's ranking of item jjj is represented by a real number aija_{ij}aij​. Only comparisons within one trader's row matter: aij>aika_{ij}>a_{ik}aij​>aik​ means that iii prefers jjj to kkk, while equality represents indifference. No strict-preference or positivity assumption is imposed on the preference matrix A=(aij)A=(a_{ij})A=(aij​).

A coalition S⊆NS\subseteq NS⊆N can redistribute the items brought by its members. Its allocation matrix PPP has Pij=1P_{ij}=1Pij​=1 when trader iii receives item jjj, and zero otherwise. An SSS-allocation puts exactly one 1 in each column indexed by SSS and has zeros in rows and columns outside SSS. An SSS-permutation is an SSS-allocation with row sums at most one, so every member of SSS receives exactly one of the coalition's items. Rows index traders and columns index items.

For a proposed payoff vector x∈RNx\in\mathbb R^Nx∈RN, define the acceptability matrix

bS∣ij(x)={1,i∈S and xi≤aij,0,otherwise.b_{S|ij}(x)= \begin{cases} 1,& i\in S\text{ and }x_i\le a_{ij},\\ 0,&\text{otherwise}. \end{cases}bS∣ij​(x)={1,0,​i∈S and xi​≤aij​,otherwise.​

The coalition payoff set is

V(S)={x∈RN:some S-permutation P satisfies Pij≤bS∣ij(x) for all i,j}.V(S)=\{x\in\mathbb R^N:\text{some }S\text{-permutation }P \text{ satisfies }P_{ij}\le b_{S|ij}(x)\text{ for all }i,j\}.V(S)={x∈RN:some S-permutation P satisfies Pij​≤bS∣ij​(x) for all i,j}.

Thus a coalition can reach a payoff threshold if it can give each member an item that member values at least as highly. The comparison is weak, so ties count as acceptable. This is the characteristic function used in the paper's Section 4 (Shapley and Scarf, 1974, pp. 109–110 of the source printing).

A balanced family TTT is a family of nonempty coalitions with nonnegative real weights δS\delta_SδS​, zero outside TTT, such that every trader has total covering weight one:

∑S∈Tj∈SδS=1(j∈N).\sum_{\substack{S\in T\\j\in S}}\delta_S=1 \quad(j\in N).S∈Tj∈S​∑​δS​=1(j∈N).

The weights may be zero even for a coalition listed in TTT. A balanced game is a game without side payments whose feasible payoff sets obey

⋂S∈TV(S)⊆V(N)\bigcap_{S\in T}V(S)\subseteq V(N)S∈T⋂​V(S)⊆V(N)

for every balanced family TTT. This includes overlapping families, not merely partitions (Shapley and Scarf, 1974, pp. 108–109).

Formalization targets

The goal is the paper's Section 4 theorem:

For every finite nonempty N and every A:N×N→R,VA is a balanced game.\text{For every finite nonempty }N\text{ and every }A:N\times N\to\mathbb R,\quad V_A\text{ is a balanced game}.For every finite nonempty N and every A:N×N→R,VA​ is a balanced game.

It contains four requirements. For each nonempty SSS, VA(S)V_A(S)VA​(S) is closed; it is downward closed in the coordinates of SSS; and its payoff slice after removing the interiors of singleton payoff sets is bounded and nonempty. The fourth requirement is the balanced-family inclusion displayed above.

The milestones name the paper's intervening claims in their order: the three game conditions, the identity BN(x)=∑S∈TδSBS(x)B_N(x)=\sum_{S\in T}\delta_SB_S(x)BN​(x)=∑S∈T​δS​BS​(x), the doubly stochastic character of a balanced mixture D=∑S∈TδSPSD=\sum_{S\in T}\delta_SP_SD=∑S∈T​δS​PS​, and the existence of a grand-coalition permutation PN≤BN(x)P_N\le B_N(x)PN​≤BN​(x) when D≤BN(x)D\le B_N(x)D≤BN​(x). The final milestone states the matrix existence claim made at the end of Section 4, without committing the theorem statement to a particular construction.

Significance

The result establishes that the finite housing market falls under the paper's general balance framework. In the paper, the cited theorem that balanced games have nonempty cores then yields a core existence conclusion for this market. That general existence theorem is external to the Section 4 proof and is not asserted by this mission's goal (Shapley and Scarf, 1974, pp. 109–110).

The formal development supplies reusable definitions of games without side payments and balanced families alongside the market-specific allocation and acceptability matrices. It also gives precise targets for the matrix claims used in the paper. The source result is proved in print; these Lean statements are proposed formalization targets and their proof bodies remain open. Nearby platform items about transferable-utility games, including the Bondareva–Shapley goal, use a real value for each coalition and do not define this paper's payoff-set game. They are not substituted for these objects.

Difficulty

The challenge is the passage from coalition-wise feasibility to feasibility for all traders together. A balancing family can overlap: choosing one feasible permutation for each coalition does not immediately give a single permutation of NNN. Their weighted mixture has fractional matrix entries. The condition BN(x)≥DB_N(x)\ge DBN​(x)≥D also has to survive the move from such a mixture to an actual zero-one permutation matrix. Without that last assertion, the balancing equations alone do not prove the inclusion V(S)V(S)V(S) requires. Separately, the bounded nonempty payoff-slice condition must be checked for every nonempty coalition; merely proving closedness and downward closure would define a weaker class of games.

Formalization scope

Traders are an arbitrary finite nonempty Lean type, and payoffs live in N→RN\to\mathbb RN→R. The paper's ESE^SES is encoded as the coordinate subspace of vectors zero outside SSS; interiors are taken in the product topology on N→RN\to\mathbb RN→R. The boundedness and nonemptiness test applies to the intersection of that subspace with V(S)V(S)V(S) after removing the singleton interiors. All conditions defining a game quantify over nonempty coalitions. The market formula is also defined at S=∅S=\varnothingS=∅, where it yields all of RN\mathbb R^NRN.

Allocation matrices are real zero-one matrices. An SSS-permutation retains the paper's column, support, and row conditions; it is not replaced by an unconstrained permutation of all traders. The inequality between matrices is entrywise. The acceptability matrix has a 1 exactly when i∈Si\in Si∈S and xi≤aijx_i\le a_{ij}xi​≤aij​; its columns are not independently restricted to SSS. Balancing weights are nonnegative, may vanish inside the family, and cover every trader in NNN. These choices exclude the trivializations V(N)=RNV(N)=\mathbb R^NV(N)=RN, balance tested only on partitions, and coalitions using outsiders' items.

The definitions need finite-sum and matrix support from Mathlib, while the eventual proof can use Mathlib's doubly stochastic matrix and permutation-matrix library. Contributions that establish the stated game conditions or any of the four sourced matrix milestones are within scope. The paper's Section 8 counterexample and the optional superadditivity observation are outside this mission's attack path.

Selected references

  • Lloyd S. Shapley and Herbert Scarf, On cores and indivisibility, Journal of Mathematical Economics 1 (1974), 23–37. DOI: 10.1016/0304-4068(74)90033-0. The supplied scan has printed folios 104–123; Section 4 is on folios 109–111.
8 thms2 active usersReviewed
🏆Completed
Algorithmic Game TheoryOptimization·Captain: mikedeng1

Some Theoretical Aspects of Road Traffic Research II: Equal Journey Times on Alternative Routes — Exactly the Routes with bᵢ < t Are Used, qᵢ = pᵢ(1 − bᵢ/t)Research Paper

Motivation

Planning a road improvement requires an estimate of how traffic will redistribute over the routes affected. Because speed falls as flow rises, sending every vehicle along the route that is quickest today changes which route is quickest. J. G. Wardrop posed the question in its simplest setting in 1952: a given flow QQQ chooses among DDD alternative routes between one origin and one destination, and the journey time on each route rises with the flow on it. He proposed two criteria for the resulting distribution. The first, equal journey times, became known as Wardrop's first principle or user equilibrium: "the journey times on all the routes actually used are equal, and less than those which would be experienced by a single vehicle on any unused route." It describes the state in which no driver can shorten their trip by switching routes, and it is the equilibrium notion behind traffic-assignment models and the theory of selfish routing.

Timeline:

  • 1952. Wardrop states both criteria and, for parallel routes with journey times of the form (22), derives the closed-form equal-times split (23)–(24) (Wardrop 1952, p. 345).
  • 1956. Beckmann, McGuire and Winsten show that, on general networks with increasing link costs, the equal-times conditions are the optimality conditions of a convex program, which gives existence and uniqueness of link flows (Beckmann et al. 1956).
  • 2014. Kelly and Yudovina give a textbook treatment of the network case (Kelly–Yudovina 2014, ch. 4); its existence theorem is on Prove2Me for total, continuous, increasing delay functions.

Setting

There are DDD routes, i=1,…,Di = 1, \dots, Di=1,…,D. Route iii has two positive constants: bib_ibi​, its journey time when no additional traffic uses it, and pip_ipi​, the additional flow at which its speed would drop to zero. When an additional flow xxx uses route iii, its journey time is

ti(x)=bi1−x/pi,0≤x<pi.(22)t_i(x) = \frac{b_i}{1 - x/p_i}, \qquad 0 \le x < p_i. \tag{22}ti​(x)=1−x/pi​bi​​,0≤x<pi​.(22)

This form comes from a linear speed/flow relation on each route. A feasible split of the total flow QQQ is a vector q=(q1,…,qD)q = (q_1, \dots, q_D)q=(q1​,…,qD​) with 0≤qi<pi0 \le q_i < p_i0≤qi​<pi​ and ∑iqi=Q\sum_i q_i = Q∑i​qi​=Q. A feasible split qqq satisfies the equal-times criterion with common time ttt when

  • every used route (qi>0q_i > 0qi​>0) has ti(qi)=tt_i(q_i) = tti​(qi​)=t, and
  • every unused route (qi=0q_i = 0qi​=0) has t≤bit \le b_it≤bi​, so a single vehicle could not do better than ttt by moving to it.

Write U(t)={i:bi<t}U(t) = \{ i : b_i < t \}U(t)={i:bi​<t} for the routes whose empty-route time is below ttt. In Lean these objects are routeTime b p i x, IsFeasible p Q q, IsEqualTimes b p Q q t and usedSet b t, all in the namespace WardropTraffic.EqualTimes.

Formalization targets

Goal: the closed form (23)–(24)

For every QQQ, ttt and qqq, the split qqq is feasible and satisfies the equal-times criterion with common time ttt if and only if

qi={pi(1−bit)bi<t,0otherwise,Q=∑i∈U(t)pi−1t∑i∈U(t)pibi.q_i = \begin{cases} p_i\left(1 - \dfrac{b_i}{t}\right) & b_i < t,\\[4pt] 0 & \text{otherwise,}\end{cases} \qquad Q = \sum_{i \in U(t)} p_i - \frac{1}{t}\sum_{i \in U(t)} p_i b_i .qi​=⎩⎨⎧​pi​(1−tbi​​)0​bi​<t,otherwise,​Q=i∈U(t)∑​pi​−t1​i∈U(t)∑​pi​bi​.

This states which routes are used, the flow on each, and the relation between the total flow and the common journey time. The milestones are the steps of Wardrop's derivation:

  1. ti(x)≥bit_i(x) \ge b_iti​(x)≥bi​ for 0≤x<pi0 \le x < p_i0≤x<pi​, with equality exactly when x=0x = 0x=0;
  2. a route in use has bi<tb_i < tbi​<t;
  3. every route with bi<tb_i < tbi​<t is in use;
  4. on a route in use, qi=pi(1−bi/t)q_i = p_i(1 - b_i/t)qi​=pi​(1−bi​/t), equation (23).

Companion: the equal-times split exists and is unique

If 0<Q<∑ipi0 < Q < \sum_i p_i0<Q<∑i​pi​, there is exactly one pair (q,t)(q, t)(q,t) satisfying the criterion. This formalizes the paper's closing sentence, that the solution is found "by picking out the value of ttt which corresponds to the given QQQ".

Significance

The result. For parallel routes with journey times (22), the equilibrium is explicit. The common time ttt is the root of a single scalar equation (24), and the flows follow from ttt by (23). The derivation also shows a threshold structure: a route is used if and only if its empty-route time is below the equilibrium time. Adding flow raises ttt, and the routes enter the set in use one at a time, in increasing order of bib_ibi​. This structure is what the paper's second criterion (minimum average time, the next mission of this series) is compared with.

Formalizing it. The result is classical and its proof is elementary; it has not been machine-checked. The platform has the existence of a Wardrop equilibrium on general networks for delay functions that are total, continuous and increasing on R\mathbb RR, with no closed form. That model excludes the vertical asymptote of (22) at qi=piq_i = p_iqi​=pi​ and has no empty-route time bib_ibi​. This mission adds the closed-form characterization for Wardrop's own model, both directions of it, and the existence and uniqueness of the split, including the corner cases that the printed criterion leaves open.

Difficulty

Each step is short. The difficulty is in the boundaries. The paper labels the routes so that b1<⋯<bDb_1 < \dots < b_Db1​<⋯<bD​ and speaks of "the first jjj routes", with bj<t≯bj+1b_j < t \not> b_{j+1}bj​<t>bj+1​. A faithful formal version has to say what happens at t=bj+1t = b_{j+1}t=bj+1​, at ties among the bib_ibi​, at t≤min⁡ibit \le \min_i b_it≤mini​bi​ (no route is used), and at a route used near capacity. The printed criterion says "less than" for unused routes, yet the derivation's own case split allows equality. With the strict comparison, an equal-times split fails to exist at the values of QQQ where ttt coincides with some bkb_kbk​. The companion's uniqueness requires Q>0Q > 0Q>0: at Q=0Q = 0Q=0 every t≤min⁡ibit \le \min_i b_it≤mini​bi​ is a common time of the zero split. Existence requires a continuity and monotonicity argument for the right-hand side of (24) as a function of ttt.

Formalization scope

  • Routes are indexed by Fin D, and all quantities are real.
  • The standing hypotheses are bi>0b_i > 0bi​>0 and pi>0p_i > 0pi​>0 for every iii. Feasibility includes qi<piq_i < p_iqi​<pi​, the range in which (22) is a positive finite journey time. Without it, Lean's bi/0=0b_i/0 = 0bi​/0=0 would give a route at capacity journey time 000.
  • The criterion is formalized in the weak form t≤bit \le b_it≤bi​ on unused routes, as the paper's derivation uses it. Every split satisfying the printed strict form satisfies it, and the definitions file records the implication. The goal under the weak form is therefore stronger than under the strict one.
  • The ordering b1<⋯<bDb_1 < \dots < b_Db1​<⋯<bD​ is not assumed. "The first jjj routes" becomes the set U(t)={i:bi<t}U(t) = \{i : b_i < t\}U(t)={i:bi​<t}. This generalisation also covers ties.
  • No sign condition on ttt or QQQ is assumed in the goal. For t≤min⁡ibit \le \min_i b_it≤mini​bi​ the term 1/t1/t1/t multiplies an empty sum, and both sides of the equivalence force q=0q = 0q=0 and Q=0Q = 0Q=0.
  • The goal is a two-sided equivalence for arbitrary (Q,q,t)(Q, q, t)(Q,q,t). The companion requires 0<Q<∑ipi0 < Q < \sum_i p_i0<Q<∑i​pi​ and asserts existence and uniqueness. Together they rule out a vacuous reading in which no split satisfies the criterion.

The development needs only the definitions above and basic real analysis (the intermediate value theorem for the companion). The model of a finite family of parallel routes with hyperbolic journey times is reusable for the minimum-average-time criterion. Proofs of the milestones, of the goal and of the companion are welcome.

Selected references

  • J. G. Wardrop, Some theoretical aspects of road traffic research, Proc. Instn Civ. Engrs Part II 1 (1952), 325–362. https://doi.org/10.1680/ipeds.1952.11259
  • M. Beckmann, C. B. McGuire, C. B. Winsten, Studies in the Economics of Transportation, Yale University Press, 1956 (RAND RM-1488, 1955). https://www.rand.org/pubs/research_memoranda/RM1488.html
  • F. Kelly, E. Yudovina, Stochastic Networks, Cambridge University Press, 2014, ch. 4. https://doi.org/10.1017/CBO9781139565363
6 thms2 active usersReviewed
🏆Completed
Statistics·Captain: mikedeng1

Some Theoretical Aspects of Road Traffic Research I: Time-Mean Speed Equals Space-Mean Speed plus σₛ²/v̄ₛ, so v̄ₜ ≥ v̄ₛ with Equality Only Without Speed VariationResearch Paper

Why two traffic speed averages differ

A speed recorded as a vehicle passes a fixed point and a speed recorded among vehicles occupying a road segment answer different questions. Fast vehicles pass a detector more often per unit time; slow vehicles remain visible along the segment for longer. Traffic studies therefore need to identify which distribution a measurement samples before comparing average speeds. J. G. Wardrop made this distinction explicit in his 1952 treatment of road traffic, then quantified it through the variance of the spatial speed distribution (Wardrop 1952, pp. 327–331 and Appendix II).

The result belongs to the paper's mathematical account of traffic flow. It is useful even when the subsidiary streams do not describe a random vehicle process: the identities concern finite positive flows and speeds. The paper also applies the same distributions to speed samples from radar and aerial photographs and to an idealized count of overtaking events (Wardrop 1952, pp. 330, 333–334).

Traffic streams and their two distributions

A road's traffic stream is divided into CCC subsidiary streams, indexed by i=1,…,Ci=1,\ldots,Ci=1,…,C. Stream iii has flow qiq_iqi​, the number of vehicles passing a point per unit time, and speed viv_ivi​. Its concentration is ki=qi/vik_i=q_i/v_iki​=qi​/vi​, the number of vehicles occupying a unit road length. Total flow and concentration are Q=∑iqiQ=\sum_i q_iQ=∑i​qi​ and K=∑ikiK=\sum_i k_iK=∑i​ki​. The time frequency fi=qi/Qf_i=q_i/Qfi​=qi​/Q weights each stream by how often its vehicles pass a point. The space frequency fi′=ki/Kf'_i=k_i/Kfi′​=ki​/K weights it by the fraction of vehicles present along the road.

The time-mean speed is vˉt=∑iqivi/Q=∑ifivi\bar v_t=\sum_i q_i v_i/Q=\sum_i f_i v_ivˉt​=∑i​qi​vi​/Q=∑i​fi​vi​. The space-mean speed is vˉs=∑ikivi/K=∑ifi′vi\bar v_s=\sum_i k_i v_i/K=\sum_i f'_i v_ivˉs​=∑i​ki​vi​/K=∑i​fi′​vi​. Both are averages of the same speeds; the weights differ. Wardrop defines the space-distribution variance independently as σs2=∑iki(vi−vˉs)2/K\sigma_s^2=\sum_i k_i(v_i-\bar v_s)^2/Kσs2​=∑i​ki​(vi​−vˉs​)2/K, and the corresponding coefficient of variation as cs=σs/vˉsc_s=\sigma_s/\bar v_scs​=σs​/vˉs​ (equations (1)–(3), (7), pp. 328–331).

These are finite sums, not limits of a stochastic process. The model requires at least one subsidiary stream and positive flow and speed for each stream. Positive flows ensure that every speed in the equality criterion belongs to a present stream; positive speeds make concentration meaningful. The count CCC is allowed to be one. In that case both means coincide and the variance is zero, as the formulas require.

Formalization targets

The main target is Wardrop's equation (6), together with its stated comparison and equality case (p. 330; Appendix II, p. 356):

vˉt=vˉs+σs2vˉs,vˉs≤vˉt,vˉt=vˉs  ⟺  vi=vj for every i,j.\bar v_t=\bar v_s+\frac{\sigma_s^2}{\bar v_s},\qquad \bar v_s\le\bar v_t,\qquad \bar v_t=\bar v_s\iff v_i=v_j\text{ for every }i,j.vˉt​=vˉs​+vˉs​σs2​​,vˉs​≤vˉt​,vˉt​=vˉs​⟺vi​=vj​ for every i,j.

The subsidiary targets follow the paper's order. Equation (4) says kivi=qik_i v_i=q_iki​vi​=qi​ for each stream, giving equation (5), Q=KvˉsQ=K\bar v_sQ=Kvˉs​. Appendix II then uses the centered identity ∑ifi′(vi−vˉs)=0\sum_i f'_i(v_i-\bar v_s)=0∑i​fi′​(vi​−vˉs​)=0 and rewrites the time mean as vˉt=(∑ifi′vi2)/vˉs\bar v_t=(\sum_i f'_i v_i^2)/\bar v_svˉt​=(∑i​fi′​vi2​)/vˉs​. These three claims are the mission milestones. Equation (8) is included as a companion formulation:

vˉt=vˉs(1+cs2).\bar v_t=\bar v_s(1+c_s^2).vˉt​=vˉs​(1+cs2​).

The mission also records the paper's formulas for equally weighted time and space speed samples and the equivalent space- and time-frequency formulas for the idealized overtaking count. These companions use the same definitions without changing the main target (pp. 330–334).

What the result supplies

The identity gives an exact size and direction for the difference between the two averages. Since the variance is nonnegative and vˉs\bar v_svˉs​ is positive, the time mean cannot fall below the space mean. If all constituent speeds are equal, the difference vanishes; if any two present streams have different speeds, the difference is positive. The formula therefore lets a reader decide whether two reported speed averages can be compared directly, and it identifies the spatial variance as the quantity needed to convert between them.

The sample formulas sharpen that interpretation. Equal weights among vehicles passing a point make the time mean the arithmetic mean of the sampled speeds and the space mean their harmonic mean. Equal concentrations reverse which mean is arithmetic; the time mean becomes ∑ivi2/∑ivi\sum_i v_i^2/\sum_i v_i∑i​vi2​/∑i​vi​. The overtaking formulas express a single pairwise count using either frequency system, provided the speeds are ordered and the paper's assumption of no interference with overtaking is used (Wardrop 1952, pp. 330, 333–334).

Wardrop proved these formulas in print. The remaining work in this mission is a machine-checked proof of the finite-sum identities and their strict equality case. The proposal supplies typed statements and definitions, but the theorem proofs are open. The resulting concentration and frequency definitions are reusable in other traffic-flow formalizations; the statements also provide small algebraic interfaces for testing more elaborate traffic models.

Where the formal proof needs care

The relation looks like a routine identity for weighted means, but the two weight systems are coupled through ki=qi/vik_i=q_i/v_iki​=qi​/vi​. One cannot treat the time and space frequencies as independent arbitrary probability vectors and still obtain equation (6). The strict case needs more than nonnegativity of the variance: it needs the fact that every space weight is positive, so zero variance forces every constituent speed to equal the mean. The single-stream case and every denominator need the same attention.

The overtaking statement has a separate modelling boundary. Its algebraic equalities use a rate defined by pairwise speed differences. Wardrop's physical interpretation of that rate assumes that overtaking does not interfere with other overtaking. The mission records the identities for that idealized rate, without claiming that a measured road necessarily meets the physical assumption.

Formalization scope

Lean uses Fin C for the streams and real numbers for qiq_iqi​, viv_ivi​, kik_iki​, both means, the variance, and the overtaking rate. Finite sums are taken over all streams. The theorem hypotheses require 0<C0<C0<C, 0<qi0<q_i0<qi​, and 0<vi0<v_i0<vi​ for every iii. These requirements make QQQ, KKK, and vˉs\bar v_svˉs​ positive; Lean's total division would otherwise assign a zero value at a zero denominator that has no meaning in the paper's model. For the overtaking identity, StrictMono v retains Wardrop's ordering v1<⋯<vCv_1<\cdots<v_Cv1​<⋯<vC​.

The variance is defined from equation (7), ∑iki(vi−vˉs)2/K\sum_i k_i(v_i-\bar v_s)^2/K∑i​ki​(vi​−vˉs​)2/K. Defining it by rearranging equation (6) would make the target true by definition and would erase the mathematical claim. The standard deviation uses the real square root of that variance. An observation in the sample companion is represented as one subsidiary stream of equal time or space weight; this is the formal reading of the paper's sampling paragraphs. No probability-measure library is needed, since fif_ifi​ and fi′f'_ifi′​ are explicit finite weights.

A complete proof needs finite-sum rearrangements, elementary real division under positive denominators, nonnegative weighted squares, and the equality case of a positive weighted sum of squares. The definitions and the mean identities are welcome as separate reusable contributions. The mission does not include the paper's normal approximation for overtaking density in equation (11), which Wardrop presents as an approximation rather than an exact finite-sum theorem.

Selected references

  • J. G. Wardrop, Some theoretical aspects of road traffic research, Proceedings of the Institution of Civil Engineers, Part II 1 (1952), 325–362. DOI: 10.1680/ipeds.1952.11259.
5 thms2 active usersReviewed
🏆Completed
Algorithmic Game TheoryOptimization·Captain: mikedeng1

An Iterative Method of Solving a Game: For Every Vector System, min U(t)/t and max V(t)/t Converge to the Value of the GameResearch Paper

Motivation

A finite two-person zero-sum game is given by a real pay-off matrix, and its value can be computed by linear programming. In 1949 George W. Brown proposed a much simpler procedure, now called fictitious play: each player in turn plays a best pure reply to the accumulated play of the opponent so far, and the running averages are read off as estimates of the value (Brown, RAND P-78, 1949). Brown conjectured that both estimates converge to the value. Julia Robinson proved the conjecture in An Iterative Method of Solving a Game, Annals of Mathematics 54 (1951).

The result is the starting point of the theory of learning in games. Fictitious play is the basic model of boundedly rational players who best-respond to empirical frequencies, and the question "for which classes of games does it converge?" has driven a long line of work.

Timeline.

  • 1949–1951: Brown proposes the method and conjectures convergence for zero-sum games.
  • 1951: Robinson proves it for every vector system of every zero-sum matrix game; the statement contains no rate.
  • 1958: Shapiro extracts from Robinson's argument a rate: the gap (max⁡V(t)−min⁡U(t))/t(\max V(t) - \min U(t))/t(maxV(t)−minU(t))/t is O(t−1/(m+n−2))O(t^{-1/(m+n-2)})O(t−1/(m+n−2)) (doi:10.1002/cpa.3160110408).
  • 1964: Shapley gives a 3 × 3 bimatrix (non-zero-sum) game in which fictitious play does not converge (doi:10.1515/9781400882014-002).
  • 1996: Monderer and Shapley prove convergence for games with identical interests (doi:10.1006/jeth.1996.0014).
  • 2014: Daskalakis and Pan show that with adversarial tie-breaking the convergence can be much slower than the rate t−1/2t^{-1/2}t−1/2 conjectured by Karlin (arXiv:1412.4840).

Setting

Let A=(aij)A = (a_{ij})A=(aij​) be a real m×nm \times nm×n matrix, m,n≥1m, n \ge 1m,n≥1. The first player chooses a row iii, the second a column jjj, and the second pays the first aija_{ij}aij​. A mixed strategy is a probability vector x=(x1,…,xm)x = (x_1, \dots, x_m)x=(x1​,…,xm​) for the first player, or y=(y1,…,yn)y = (y_1, \dots, y_n)y=(y1​,…,yn​) for the second. For all mixed strategies,

min⁡j∑iaijxi≤max⁡i∑jaijyj.(1)\min_j \sum_i a_{ij} x_i \le \max_i \sum_j a_{ij} y_j. \tag{1}jmin​i∑​aij​xi​≤imax​j∑​aij​yj​.(1)

A pair (X,Y)(X, Y)(X,Y) for which equality holds is a solution, and the common number vvv is the value of the game. The minimax theorem says that a solution exists.

Write Ai⋅A_{i\cdot}Ai⋅​ for the iii-th row, A⋅jA_{\cdot j}A⋅j​ for the jjj-th column, and max⁡W\max WmaxW, min⁡W\min WminW for the largest and smallest component of a vector WWW. A vector system for AAA is a pair of sequences U(0),U(1),…U(0), U(1), \dotsU(0),U(1),… of nnn-vectors and V(0),V(1),…V(0), V(1), \dotsV(0),V(1),… of mmm-vectors with min⁡U(0)=max⁡V(0)\min U(0) = \max V(0)minU(0)=maxV(0) and

U(t+1)=U(t)+Ai⋅,V(t+1)=V(t)+A⋅j,U(t+1) = U(t) + A_{i\cdot}, \qquad V(t+1) = V(t) + A_{\cdot j},U(t+1)=U(t)+Ai⋅​,V(t+1)=V(t)+A⋅j​,

where vi(t)=max⁡V(t)v_i(t) = \max V(t)vi​(t)=maxV(t) and uj(t)=min⁡U(t)u_j(t) = \min U(t)uj​(t)=minU(t). In the alternate vector system the column satisfies uj(t+1)=min⁡U(t+1)u_j(t+1) = \min U(t+1)uj​(t+1)=minU(t+1) instead. A row iii is eligible in the interval (t,t′)(t, t')(t,t′) if vi(t1)=max⁡V(t1)v_i(t_1) = \max V(t_1)vi​(t1​)=maxV(t1​) for some t≤t1≤t′t \le t_1 \le t't≤t1​≤t′, and similarly a column jjj if uj(t2)=min⁡U(t2)u_j(t_2) = \min U(t_2)uj​(t2​)=minU(t2​) for some t≤t2≤t′t \le t_2 \le t't≤t2​≤t′.

With U(0)=V(0)=0U(0) = V(0) = 0U(0)=V(0)=0, U(t)/tU(t)/tU(t)/t is the payoff vector of the first player's empirical mixed strategy against each column, and V(t)/tV(t)/tV(t)/t that of the second player's against each row. In the Lean development these objects are vmax, vmin, IsVectorSystem, IsAltVectorSystem, RowEligible, ColEligible and IsSolution, in the namespace RobinsonFP.Convergence.

Formalization targets

Goal: the Theorem (p. 297)

For every vector system (U,V)(U, V)(U,V) for AAA, and vvv the value of the game,

lim⁡t→∞min⁡U(t)t=lim⁡t→∞max⁡V(t)t=v.\lim_{t\to\infty} \frac{\min U(t)}{t} = \lim_{t\to\infty} \frac{\max V(t)}{t} = v.t→∞lim​tminU(t)​=t→∞lim​tmaxV(t)​=v.

The statement holds for arbitrary initial vectors with min⁡U(0)=max⁡V(0)\min U(0) = \max V(0)minU(0)=maxV(0) and for every way of breaking ties.

Milestones, in the order of the proof

  1. Inequality (1).
  2. Lemma 1: lim inf⁡t→∞(max⁡V(t)−min⁡U(t))/t≥0\liminf_{t\to\infty} (\max V(t) - \min U(t))/t \ge 0liminft→∞​(maxV(t)−minU(t))/t≥0.
  3. Lemma 2: if every row and column is eligible in (s,s+t)(s, s+t)(s,s+t), then max⁡U(s+t)−min⁡U(s+t)≤2at\max U(s+t) - \min U(s+t) \le 2atmaxU(s+t)−minU(s+t)≤2at and max⁡V(s+t)−min⁡V(s+t)≤2at\max V(s+t) - \min V(s+t) \le 2atmaxV(s+t)−minV(s+t)≤2at, where a=max⁡i,j∣aij∣a = \max_{i,j}|a_{ij}|a=maxi,j​∣aij​∣.
  4. Lemma 3: under the same hypothesis, max⁡V(s+t)−min⁡U(s+t)≤4at\max V(s+t) - \min U(s+t) \le 4atmaxV(s+t)−minU(s+t)≤4at.
  5. Display (3) of the proof of Lemma 4: if some row or column is not eligible in (s,s+t∗)(s, s+t^*)(s,s+t∗), the gap max⁡V−min⁡U\max V - \min UmaxV−minU grows by less than 12εt∗\tfrac12 \varepsilon t^*21​εt∗ over that window, given the bound 12εt\tfrac12\varepsilon t21​εt for the vector systems of the submatrices.
  6. Lemma 4: for every ε>0\varepsilon > 0ε>0 there is t0t_0t0​, uniform over all vector systems for AAA, with max⁡V(t)−min⁡U(t)<εt\max V(t) - \min U(t) < \varepsilon tmaxV(t)−minU(t)<εt for t≥t0t \ge t_0t≥t0​.
  7. (max⁡V(t)−min⁡U(t))/t→0(\max V(t) - \min U(t))/t \to 0(maxV(t)−minU(t))/t→0.
  8. lim sup⁡min⁡U(t)/t≤v\limsup \min U(t)/t \le vlimsupminU(t)/t≤v and lim inf⁡max⁡V(t)/t≥v\liminf \max V(t)/t \ge vliminfmaxV(t)/t≥v.

Two further items are not milestones: the Theorem for the alternate vector system, which the paper says follows by the same proofs, and the bracketing min⁡U(t)/t≤v≤max⁡V(t′)/t′\min U(t)/t \le v \le \max V(t')/t'minU(t)/t≤v≤maxV(t′)/t′ when U(0)=V(0)=0U(0) = V(0) = 0U(0)=V(0)=0 (p. 297).

Significance

The Theorem shows that a payoff-based procedure with no linear algebra finds the value of every zero-sum matrix game. It was one of the first iterative methods for linear programs with a convergence proof, and it is the base case for every later convergence result about fictitious play: potential games, games with identical interests, 2×n2\times n2×n games, and continuous-time best-response dynamics.

The result is proved, and its proof is short. To our knowledge it has no machine-checked proof. The mission produces a Lean proof of the Theorem and its four lemmas, together with reusable definitions of vector systems and eligibility. A statement with an explicit rate, such as Shapiro's, or a proof for the alternate system, is a natural extension.

Difficulty

Lemmas 1–3 are elementary estimates. The difficulty is Lemma 4. The obvious approach follows a single run of the iteration and tries to show that the gap max⁡V(t)−min⁡U(t)\max V(t) - \min U(t)maxV(t)−minU(t) grows sublinearly. This fails because a run can spend arbitrarily long windows in which some row or column is never a best reply, and nothing about one fixed run controls the gap over such a window. What is needed is a bound that is uniform over all vector systems, whatever their initial vectors and tie-breaking, which is why t0t_0t0​ in Lemma 4 comes before the vector system, and why display (3) quantifies over every vector system of the smaller matrices. In Lean, this uniformity has to range over matrices of every smaller size, so the statements must be general in the index types.

Formalization scope

  • Rows and columns are indexed by finite nonempty types ι, κ (the paper's m,n≥1m, n \ge 1m,n≥1); Fin m, Fin n is a special case. The matrix is Matrix ι κ ℝ.
  • max⁡W\max WmaxW, min⁡W\min WminW are Finset.sup' and Finset.inf' over all indices, hence attained.
  • A vector system allows any maximizing row and minimizing column at each step (an existential per step). No tie-breaking rule is fixed, and the initial vectors are arbitrary subject to min⁡U(0)=max⁡V(0)\min U(0) = \max V(0)minU(0)=maxV(0). The case U(0)=V(0)=0U(0) = V(0) = 0U(0)=V(0)=0 is not imposed.
  • Time is a natural number. Limits are Tendsto … atTop (𝓝 ·); lim inf and lim sup of real sequences are stated in ε\varepsilonε-form (for every ε>0\varepsilon > 0ε>0, eventually), with no boundedness side conditions.
  • The value vvv is given by a solution: every statement about vvv assumes IsSolution A x y v, i.e. probability vectors xxx, yyy with min⁡j∑iaijxi=v=max⁡i∑jaijyj\min_j \sum_i a_{ij} x_i = v = \max_i \sum_j a_{ij} y_jminj​∑i​aij​xi​=v=maxi​∑j​aij​yj​. Such a solution exists by the minimax theorem, which is proved on the platform as MatousekLP.ZeroSum.minimax_equality in a different encoding. A statement with vvv free, or with "there exists vvv", would be false or would lose the identification with the value; neither is used.
  • In Lemmas 2 and 3, aaa is any upper bound on the ∣aij∣|a_{ij}|∣aij​∣. This is equivalent to the paper's a=max⁡i,j∣aij∣a = \max_{i,j}|a_{ij}|a=maxi,j​∣aij​∣.
  • In display (3), the bound for submatrices is assumed only for the submatrices that delete one row or one column, which makes the statement at least as strong as the paper's.
  • The paper's closing display on p. 301 prints lim⁡min⁡V(t)/t\lim \min V(t)/tlimminV(t)/t for lim⁡min⁡U(t)/t\lim \min U(t)/tlimminU(t)/t. The goal follows the statement of the Theorem on p. 297.

A general "restriction of a vector system to a submatrix" lemma would be reusable for later work on fictitious play. Proofs of any milestone are welcome, as are proofs of the two extra items.

Selected references

  • J. Robinson, An Iterative Method of Solving a Game, Annals of Mathematics 54(2), 296–301, 1951. https://doi.org/10.2307/1969530
  • G. W. Brown, Some notes on computation of games solutions, RAND Report P-78, 1949. https://www.rand.org/pubs/papers/P78.html
  • H. N. Shapiro, Note on a computation method in the theory of games, Communications on Pure and Applied Mathematics 11(4), 587–593, 1958. https://doi.org/10.1002/cpa.3160110408
  • L. S. Shapley, Some topics in two-person games, Advances in Game Theory, Annals of Mathematics Studies 52, 1964. https://doi.org/10.1515/9781400882014-002
  • D. Monderer, L. S. Shapley, Fictitious play property for games with identical interests, Journal of Economic Theory 68, 258–265, 1996. https://doi.org/10.1006/jeth.1996.0014
  • C. Daskalakis, Q. Pan, A counter-example to Karlin's strong conjecture for fictitious play, FOCS 2014. https://arxiv.org/abs/1412.4840
10 thms2 active usersReviewed
🏆Completed
Convex OptimizationLinear OptimizationOptimization·Captain: mikedeng1

Convex Programming with Set-Inclusive Constraints and Applications to Inexact Linear Programming: The Set-Inclusive LP Has the Same Feasible Set as the LP of Support FunctionalsResearch Paper

Motivation

A linear program max⁡c⋅x\max c\cdot xmaxc⋅x subject to Ax≤bAx\le bAx≤b, x≥0x\ge 0x≥0 assumes that the constraint matrix AAA is known exactly. In practice the columns of AAA — the activity vectors, describing how much of each resource one unit of activity jjj consumes — are estimates. A. L. Soyster's 1973 technical note in Operations Research (doi:10.1287/opre.21.5.1154) asked what a decision xxx should satisfy if every activity vector is known only to lie in a given convex set, and the decision has to be feasible for every possible realisation. He called this inexact linear programming, a term he attributes to K. O. Kortanek.

The note is the earliest formulation of what is now called robust linear optimization. Its answer — replace each uncertain column by its coordinatewise worst case — is the "Soyster model" that later work on robust optimization takes as its point of departure: Ben-Tal and Nemirovski (Math. Oper. Res. 1998; Math. Program. 2000) and Bertsimas and Sim (Oper. Res. 2004) both introduce their less conservative uncertainty sets as alternatives to it.

Setting

Fix integers m,n≥0m,n\ge0m,n≥0. Vectors in Rm\mathbb R^mRm are compared componentwise. For a set S⊆RmS\subseteq\mathbb R^mS⊆Rm and a scalar ttt, tS={ta:a∈S}tS=\{ta: a\in S\}tS={ta:a∈S}, and the sum of sets is Minkowski addition, S+T={s+t:s∈S, t∈T}S+T=\{s+t: s\in S,\ t\in T\}S+T={s+t:s∈S, t∈T}.

Let K1,…,Kn⊆RmK_1,\dots,K_n\subseteq\mathbb R^mK1​,…,Kn​⊆Rm be nonempty convex activity sets and K⊆RmK\subseteq\mathbb R^mK⊆Rm a nonempty convex resource set. Problem (I) is

sup⁡ c⋅xsubject tox1K1+x2K2+⋯+xnKn⊆K,xj≥0,\sup\ c\cdot x\quad\text{subject to}\quad x_1K_1+x_2K_2+\cdots+x_nK_n\subseteq K,\quad x_j\ge0,sup c⋅xsubject tox1​K1​+x2​K2​+⋯+xn​Kn​⊆K,xj​≥0,

and X⊆RnX\subseteq\mathbb R^nX⊆Rn denotes its set of feasible xxx. Problem (Ib) is the special case K=K(b)={y∈Rm:y≤b}K=K(b)=\{y\in\mathbb R^m: y\le b\}K=K(b)={y∈Rm:y≤b} for a right-hand side b∈Rmb\in\mathbb R^mb∈Rm.

The support functional of a set SSS is δ∗(y∣S)=sup⁡a∈Sy⋅a\delta^*(y\mid S)=\sup_{a\in S}y\cdot aδ∗(y∣S)=supa∈S​y⋅a, a value in [−∞,+∞][-\infty,+\infty][−∞,+∞]. With eie_iei​ the iii-th unit vector, the auxiliary matrix Aˉ\bar AAˉ is the m×nm\times nm×n matrix with entries

aˉij=δ∗(ei∣Kj)=sup⁡aj∈Kjaij,\bar a_{ij}=\delta^*(e_i\mid K_j)=\sup_{a_j\in K_j}a_{ij},aˉij​=δ∗(ei​∣Kj​)=aj​∈Kj​sup​aij​,

defined when all of these are finite, and LP(Aˉ)(\bar A)(Aˉ) is the linear program max⁡c⋅x\max c\cdot xmaxc⋅x subject to Aˉx≤b\bar Ax\le bAˉx≤b, x≥0x\ge0x≥0. Finally MMM is the set of m×nm\times nm×n matrices (a1,…,an)(a_1,\dots,a_n)(a1​,…,an​) whose jjj-th column lies in KjK_jKj​.

In the application, the activity sets are Euclidean balls Kj={a∈Rm:∥a−aj∥2≤ρj}K_j=\{a\in\mathbb R^m:\|a-a_j\|_2\le\rho_j\}Kj​={a∈Rm:∥a−aj​∥2​≤ρj​} around nominal columns aja_jaj​ of a matrix A0A_0A0​, with radii ρj≥0\rho_j\ge0ρj​≥0.

Formalization targets

Goal: the THEOREM (p. 1156)

Assume every KjK_jKj​ is nonempty and convex and δ∗(ei∣Kj)<∞\delta^*(e_i\mid K_j)<\inftyδ∗(ei​∣Kj​)<∞ for all i,ji,ji,j. Then

{x:x feasible for (Ib)}={x:Aˉx≤b, x≥0},\{x : x\ \text{feasible for (Ib)}\}=\{x : \bar Ax\le b,\ x\ge 0\},{x:x feasible for (Ib)}={x:Aˉx≤b, x≥0},

and for every objective ccc, the optimal solutions of (Ib) and of LP(Aˉ)(\bar A)(Aˉ) coincide.

Milestones

  1. Feasibility for (I) is equivalent to x≥0x\ge0x≥0 and ∑jxjaj∈K\sum_j x_ja_j\in K∑j​xj​aj​∈K for every choice aj∈Kja_j\in K_jaj​∈Kj​ (p. 1154).
  2. LEMMA (p. 1155): XXX is convex.
  3. If δ∗(ei∣Kj)=∞\delta^*(e_i\mid K_j)=\inftyδ∗(ei​∣Kj​)=∞ for some iii, every feasible xxx of (Ib) has xj=0x_j=0xj​=0 (p. 1155).
  4. Compact activity sets have δ∗(ei∣Kj)<∞\delta^*(e_i\mid K_j)<\inftyδ∗(ei​∣Kj​)<∞ (p. 1156).
  5. xxx is feasible for (Ib) iff Ax≤bAx\le bAx≤b for every A∈MA\in MA∈M and x≥0x\ge0x≥0 (p. 1156).
  6. Every A∈MA\in MA∈M satisfies A≤AˉA\le\bar AA≤Aˉ entrywise (proof of THEOREM).
  7. Feasible for LP(Aˉ)(\bar A)(Aˉ) implies feasible for (Ib) (proof of THEOREM).
  8. Feasible for (Ib) implies ∑jxjsup⁡aj∈Kjaij≤bi\sum_j x_j\sup_{a_j\in K_j}a_{ij}\le b_i∑j​xj​supaj​∈Kj​​aij​≤bi​ for every iii, i.e. feasible for LP(Aˉ)(\bar A)(Aˉ) (proof of THEOREM).
  9. For Euclidean balls, δ∗(ei∣Kj)=aij+ρj\delta^*(e_i\mid K_j)=a_{ij}+\rho_jδ∗(ei​∣Kj​)=aij​+ρj​, so aˉj=aj+ρje\bar a_j=a_j+\rho_jeaˉj​=aj​+ρj​e with eee the all-ones vector (p. 1157).
  10. Inexact LP over balls: (Ib) has the same feasible and optimal solutions as max⁡c⋅x\max c\cdot xmaxc⋅x subject to ∑jxj(aj+ρje)≤b\sum_j x_j(a_j+\rho_je)\le b∑j​xj​(aj​+ρj​e)≤b, x≥0x\ge0x≥0 (p. 1157).

Significance

The THEOREM turns a semi-infinite constraint — one linear inequality for every matrix in MMM, of which there are typically uncountably many — into a single linear program of the original size, whose data are the support functionals of the activity sets. Any LP solver then solves the uncertain problem. The hypersphere corollary shows the cost of this guarantee concretely: every entry of column jjj is inflated by the full radius ρj\rho_jρj​, which is why the model is called conservative and why later robust-optimization work introduced ellipsoidal and budgeted uncertainty sets as less conservative alternatives. The LEMMA classifies (I) as a convex program in general, for resource sets that are not half-space intersections.

The results are proved in the paper and are standard. To our knowledge they have no machine-checked proof in Lean or Mathlib. The mission produces a formal statement of the set-inclusive constraint as an actual Minkowski-sum inclusion, the support-functional reduction with its finiteness hypotheses made explicit, and the Euclidean-ball computation — a base that robust-counterpart results for other uncertainty sets can be compared against.

Difficulty

The individual arguments are short; the work is in the bookkeeping that the paper leaves implicit. The step from "for every A∈MA\in MA∈M" to Aˉ\bar AAˉ uses that the supremum of a sum of independent terms is the sum of suprema, which needs every KjK_jKj​ nonempty and the scalars xjx_jxj​ nonnegative; with an empty activity set the Minkowski sum is empty and every x≥0x\ge0x≥0 becomes feasible. The support functional is valued in the extended reals, and its conversion to a real matrix entry is exact only under the finiteness assumption, which the paper secures by deleting columns. The ball computation needs the Euclidean norm and its dual characterisation of the maximum of a coordinate over a ball.

Formalization scope

  • Vectors are Fin m → ℝ and Fin n → ℝ, with indices 0,…,m−10,\dots,m-10,…,m−1 in place of 1,…,m1,\dots,m1,…,m; the order on vectors is componentwise.
  • Feasibility of (I) is the Minkowski-sum inclusion (∑ j, x j • K j) ⊆ R (pointwise set operations) together with x≥0x\ge0x≥0. It is not defined as "for every choice aj∈Kja_j\in K_jaj​∈Kj​", which would make milestones 1 and 5 trivial, and Aˉ\bar AAˉ is constructed from the KjK_jKj​, not an arbitrary matrix dominating MMM, which would make the goal trivial.
  • δ∗\delta^*δ∗ is valued in EReal. The entries of Aˉ\bar AAˉ are its real conversions, so every statement mentioning Aˉ\bar AAˉ assumes Kj≠∅K_j\neq\emptysetKj​=∅ and δ∗(ei∣Kj)<∞\delta^*(e_i\mid K_j)<\inftyδ∗(ei​∣Kj​)<∞, the paper's standing assumptions (pp. 1154–1156). Convexity of the KjK_jKj​ is also kept as a hypothesis wherever the paper has it, although only the LEMMA uses convexity (of KKK).
  • An optimal solution is a feasible point attaining the maximum of c⋅xc\cdot xc⋅x; the paper writes sup⁡\supsup and does not discuss attainment. Because the goal identifies the feasible sets, the two problems also have equal suprema.
  • Hyperspheres use the Euclidean norm (EuclideanSpace ℝ (Fin m)), not the sup norm of Fin m → ℝ, with radii ρj≥0\rho_j\ge0ρj​≥0.
  • The support functional restates the published FenchelRobust.Counterpart.supportFun with the same body.
  • Not formalized: Magnanti's extension to ≥\ge≥ and === rows (p. 1156), and the remarks on (GLP) and stochastic programming. Contributions of proofs of any milestone, and of an EReal statement equating the optimal values, are welcome.

Selected references

  • A. L. Soyster, Convex Programming with Set-Inclusive Constraints and Applications to Inexact Linear Programming, Operations Research 21(5), 1154–1157, 1973. https://doi.org/10.1287/opre.21.5.1154
  • G. B. Dantzig, Linear Programming and Extensions, Princeton University Press, 1963. https://doi.org/10.1515/9781400884179
  • A. Ben-Tal and A. Nemirovski, Robust Convex Optimization, Mathematics of Operations Research 23(4), 769–805, 1998. https://doi.org/10.1287/moor.23.4.769
  • A. Ben-Tal and A. Nemirovski, Robust solutions of Linear Programming problems contaminated with uncertain data, Mathematical Programming 88, 411–424, 2000. https://doi.org/10.1007/PL00011380
  • D. Bertsimas and M. Sim, The Price of Robustness, Operations Research 52(1), 35–53, 2004. https://doi.org/10.1287/opre.1030.0065
12 thms2 active usersReviewed
🏆Completed
Algorithmic Game TheoryGraph Theory·Captain: mikedeng1

Graphs and Cooperation in Games: The Unique Fair Allocation Rule, the Shapley Value of the Graph-Restricted Game, Is Totally Stable for Superadditive GamesResearch Paper

Motivation

Classical cooperative game theory assumes that any coalition of players can form and coordinate. In many settings cooperation is mediated by pairwise relationships: communication lines, contracts, alliances, or trade links. Roger Myerson's discussion paper Graphs and Cooperation in Games (Northwestern University, 1976; published in Mathematics of Operations Research 2(3), 1977, doi:10.1287/moor.2.3.225) models such a cooperation structure as a graph on the set of players and asks how the players should share the worth of the game when only linked players can coordinate directly.

The answer, now called the Myerson value, is the starting point of the literature on communication situations and network games. It underlies later work on network formation (Jackson and Wolinsky, A strategic model of social and economic networks, JET 1996) and on allocation rules for networks, and it is a standard textbook example of an axiomatic solution concept.

Timeline:

  • 1953. Shapley defines the Shapley value φ\varphiφ for transferable-utility games by efficiency, symmetry, a carrier axiom and additivity (Shapley 1953).
  • 1976–1977. Myerson introduces cooperation graphs, the fairness (equal gains from each link) condition, proves existence and uniqueness of the fair allocation rule, identifies it as the Shapley value of the graph-restricted game, proves its total stability for superadditive games, and extends existence and uniqueness to games without transferable utility in graph function form.

Setting

Let NNN be a nonempty finite set of players and CLCLCL the set of nonempty coalitions S⊆NS\subseteq NS⊆N. A game in characteristic function form is a vector v∈RCLv\in\mathbb R^{CL}v∈RCL; vSv_SvS​ is the transferable wealth coalition SSS can divide.

A link n:mn{:}mn:m is an unordered pair of distinct players and a graph ggg is a set of links; GRGRGR is the set of all graphs, gˉN\bar g^Ngˉ​N the complete graph, g∖n:mg\setminus n{:}mg∖n:m the graph with one link removed, and ∣g∣|g|∣g∣ the number of links. Players a,ba,ba,b are connected in SSS by ggg if a=b∈Sa=b\in Sa=b∈S or a path of links of ggg joins them through players of SSS only; the classes form the partition S/gS/gS/g of SSS, and N/gN/gN/g is the set of connected components of ggg. The graph-restricted game is

(v/g)S=∑T∈S/gvT.(v/g)_S=\sum_{T\in S/g}v_T .(v/g)S​=T∈S/g∑​vT​.

An allocation rule is a function Y:GR→RNY:GR\to\mathbb R^NY:GR→RN, with Yn(g)Y_n(g)Yn​(g) the payoff of player nnn under cooperation structure ggg. It is a fair allocation rule for vvv if

  1. (efficiency, (7)) ∑n∈SYn(g)=vS\sum_{n\in S}Y_n(g)=v_S∑n∈S​Yn​(g)=vS​ for every ggg and every component S∈N/gS\in N/gS∈N/g, and
  2. (equity, (10)) Yn(g)−Yn(g∖n:m)=Ym(g)−Ym(g∖n:m)Y_n(g)-Y_n(g\setminus n{:}m)=Y_m(g)-Y_m(g\setminus n{:}m)Yn​(g)−Yn​(g∖n:m)=Ym​(g)−Ym​(g∖n:m) for every ggg and every link n:m∈gn{:}m\in gn:m∈g.

YYY is totally stable if Yn(g)≥Yn(g∖n:m)Y_n(g)\ge Y_n(g\setminus n{:}m)Yn​(g)≥Yn​(g∖n:m) for every ggg and every link n:m∈gn{:}m\in gn:m∈g, and vvv is superadditive if vS∪T≥vS+vTv_{S\cup T}\ge v_S+v_TvS∪T​≥vS​+vT​ for disjoint S,T∈CLS,T\in CLS,T∈CL.

A game in graph function form assigns to every pair (S,g)(S,g)(S,g) with S∈N/gS\in N/gS∈N/g a closed, comprehensive (closed under decreasing coordinates), proper (∅≠W≠RS\emptyset\ne W\ne\mathbb R^S∅=W=RS) set w(S,g)⊆RSw(S,g)\subseteq\mathbb R^Sw(S,g)⊆RS of feasible payoffs; its fair allocation rule replaces (7) by (14), (Yn(g))n∈S∈∂w(S,g)(Y_n(g))_{n\in S}\in\partial w(S,g)(Yn​(g))n∈S​∈∂w(S,g).

Formalization targets

Goal: Theorem 3 (p. 8)

If vvv is superadditive, then the fair allocation rule YYY for vvv is totally stable:

Yn(g)≥Yn(g∖n:m)for all g∈GR, n:m∈g.Y_n(g)\ge Y_n(g\setminus n{:}m)\qquad\text{for all } g\in GR,\ n{:}m\in g .Yn​(g)≥Yn​(g∖n:m)for all g∈GR, n:m∈g.

Theorem 1 (p. 7) and Theorem 4 (p. 10)

Every v∈RCLv\in\mathbb R^{CL}v∈RCL has a unique fair allocation rule; every game www in graph function form has a unique YYY satisfying (14) and (10).

Theorem 2 (p. 8)

The fair allocation rule is

Y(g)=φ(v/g)for all g∈GR,in particular Y(gˉN)=φ(v).Y(g)=\varphi(v/g)\quad\text{for all }g\in GR,\qquad\text{in particular } Y(\bar g^N)=\varphi(v).Y(g)=φ(v/g)for all g∈GR,in particular Y(gˉ​N)=φ(v).

The milestones follow the paper's Section 7: the steps of the proof of Theorem 4 (displays (15)–(17)), Theorem 4, Theorem 1, the decomposition of v/gv/gv/g and the efficiency and equity of φ(v/g)\varphi(v/g)φ(v/g) (proof of Theorem 2), Theorem 2, and the monotonicity of v/gv/gv/g and φ(v/g)\varphi(v/g)φ(v/g) in a link (proof of Theorem 3). Theorem 3 is the goal because its proof uses the formula of Theorem 2, whose proof uses the uniqueness of Theorem 1, which is the transferable-utility case of Theorem 4: all four numbered results lie on one path.

Significance

The theorems give an axiomatic foundation for allocation in networks: two natural requirements, component-wise efficiency and equal gains from each link, single out one rule, and that rule is an explicit formula built from the Shapley value. At the complete graph it recovers the Shapley value itself, so the result is also a new characterization of the Shapley value. Total stability says that, for superadditive games, no player has an incentive to break a link, which connects the allocation rule to the question of which networks form.

The results are proved in the paper. A search of the platform found no formalization of cooperation graphs, the graph-restricted game, the Myerson value or total stability; the Shapley value is available as a platform definition and is reused. This mission produces machine-checked statements of all four theorems and of the intermediate steps of their proofs, together with a reusable definition layer for communication situations.

Difficulty

The equity condition (10) relates the payoff at a graph to the payoff at a graph with one fewer link, and it constrains only pairs of linked players; it is not evident that these conditions, together with efficiency on components, determine the rule at every graph, nor that they are consistent. Uniqueness and existence must hold simultaneously for all 2∣gˉN∣2^{|\bar g^N|}2∣gˉ​N∣ graphs, and the constraints couple each graph to all of its subgraphs and each player to every other player of its component. In the graph function form, efficiency becomes a boundary condition on a closed comprehensive set, and the existence and uniqueness of the relevant extremal point depend on all three properties of w(S,g)w(S,g)w(S,g).

Identifying the rule with φ(v/g)\varphi(v/g)φ(v/g) requires the efficiency of the Shapley value on each component of ggg, which is not the efficiency of φ\varphiφ on NNN, and equity requires tracking how the partitions S/gS/gS/g change when a link is removed. Total stability is false for general games: without superadditivity a player can gain by cutting a link, so the hypothesis cannot be dropped.

Formalization scope

Players are Fin n, with 0<n0<n0<n in every theorem as the paper assumes NNN nonempty; the paper's player kkk is index k−1k-1k−1. The general game carrier has its own definition module, and the graph-specific definitions build on it. Graphs are SimpleGraph (Fin n): gˉN\bar g^Ngˉ​N is ⊤, the empty graph ⊥, h⊆gh\subseteq gh⊆g is h ≤ g and h⊂gh\subset gh⊂g is h < g. A game is a function Finset (Fin n) → ℝ; its value at ∅\emptyset∅ is a junk coordinate that no definition reads, and no theorem assumes v∅=0v_\emptyset=0v∅​=0. Superadditivity quantifies over nonempty coalitions only. The Shapley value is the platform definition Supermodularity.Cooperative.ShapleyValue, applied after resetting the value at ∅\emptyset∅ to 000. RS\mathbb R^SRS is ↥S → ℝ with the product topology, and ∂\partial∂ is the topological frontier.

Explicit readings of the typescript:

  • The printed definition of "connected in SSS by ggg" (p. 3) asks ni∈Sn^i\in Sni∈S only for i≥1i\ge1i≥1; the formalization requires every vertex of the path, including the start, to lie in SSS, which makes S/gS/gS/g the partition of SSS the paper describes.
  • Comprehensiveness (p. 10) prints "∀n∈N\forall n\in N∀n∈N" for coordinates of vectors in RS\mathbb R^SRS; read as n∈Sn\in Sn∈S.
  • Display (17) writes Yn(h)Y_n(h)Yn​(h) under the index m∈Sm\in Sm∈S; read as Ym(h)Y_m(h)Ym​(h), as in (18b).
  • The proof headed "PROOF OF THEOREM 4." on p. 13 is the proof of Theorem 3.
  • "The unique fair allocation rule" in Theorems 2 and 3 is stated for every fair allocation rule; existence and uniqueness are Theorem 1.
  • The paper's NNN is nonempty; every theorem carries the corresponding hypothesis 0<n0<n0<n.

The equity and stability conditions quantify over links of ggg only. Quantifying over all pairs of players would make Theorem 1 false and the goal vacuous, so that reading is ruled out. Likewise (14) is boundary membership, not membership in w(S,g)w(S,g)w(S,g).

Contributions welcome: general lemmas on the partitions S/gS/gS/g (refinement under link deletion, restriction to components), Möbius inversion over the subgraph lattice of a finite simple graph, the carrier and null-player properties of the Shapley value, and the extremal-point lemma for closed comprehensive sets. These are reusable beyond this mission.

Selected references

  • R. B. Myerson, Graphs and Cooperation in Games, Discussion Paper No. 246, CMS-EMS, Northwestern University, September 1976; published in Mathematics of Operations Research 2(3):225–229, 1977. https://doi.org/10.1287/moor.2.3.225
  • L. S. Shapley, A Value for n-Person Games, in Contributions to the Theory of Games II, Annals of Mathematics Studies 28, Princeton University Press, 1953, pp. 307–317. https://doi.org/10.1515/9781400881970-018
  • M. O. Jackson and A. Wolinsky, A Strategic Model of Social and Economic Networks, Journal of Economic Theory 71(1):44–74, 1996. https://doi.org/10.1006/jeth.1996.0108
18 thms2 active usersReviewed
🏆Completed
Dynamic ProgrammingMarkov ChainStochastic Systems·Captain: mikedeng1

Quality Control under Markovian Deterioration 1: A Discounted-Optimal Policy Produces, Inspects, Produces Again and Revises on Successive Intervals of the BeliefResearch Paper

Motivation

A production process deteriorates over time, and the state it is in cannot be observed directly. Each period the operator chooses among three actions: produce without looking, produce and inspect the item (which reveals the current state at a cost), or revise the process back to its good state. This is one of the earliest partially observed Markov decision problems with a costly observation action, and it is the prototype of the inspection and machine-replacement models that followed in operations research and maintenance theory. Ross (Management Science 17(9), 1971) set it up for a countable state space, reduced it to a fully observed problem on beliefs, and determined the structure of an optimal policy for two states.

Intuition suggests a three-region policy for two states: produce while the probability of the bad state is small, inspect at intermediate probabilities, revise when it is large. Ross showed that the true structure has up to four regions: produce, inspect, produce again, revise. This mission formalizes that structure theorem and the general results it rests on.

Setting

The underlying process has a countable set of states 0,1,2,…0,1,2,\dots0,1,2,…, with transition probabilities PijP_{ij}Pij​ from state iii at the end of a period to state jjj at the beginning of the next. In state iii, producing without inspection costs CiC_iCi​, producing with inspection costs IiI_iIi​, and revising costs RiR_iRi​; costs are bounded, and future costs are discounted by β∈(0,1)\beta\in(0,1)β∈(0,1). A revision puts the process in state 000.

The decision maker tracks a belief P=(P0,P1,… )P=(P_0,P_1,\dots)P=(P0​,P1​,…), a probability vector on the states, ranging over

S={P:Pi≥0, ∑iPi=1}.S=\Big\{P: P_i\ge0,\ \sum_iP_i=1\Big\}.S={P:Pi​≥0, i∑​Pi​=1}.

Producing without inspection moves the belief to TPTPTP, with (TP)i=∑jPjPji(TP)_i=\sum_jP_jP_{ji}(TP)i​=∑j​Pj​Pji​. Inspecting reveals the state; if it is iii, the next belief is the row ei=(Pi0,Pi1,… )e^i=(P_{i0},P_{i1},\dots)ei=(Pi0​,Pi1​,…). Revising leads to e0e^0e0.

The β\betaβ-discounted optimal cost VβV_\betaVβ​ is the limit of value iteration: V0=0V^0=0V0=0 and

Vn+1(P)=min⁡{∑iPiCi+βVn(TP); ∑iPiIi+β∑iPiVn(ei); ∑iPiRi+βVn(e0)}.V^{n+1}(P)=\min\Big\{\sum_iP_iC_i+\beta V^n(TP);\ \sum_iP_iI_i+\beta\sum_iP_iV^n(e^i);\ \sum_iP_iR_i+\beta V^n(e^0)\Big\}.Vn+1(P)=min{i∑​Pi​Ci​+βVn(TP); i∑​Pi​Ii​+βi∑​Pi​Vn(ei); i∑​Pi​Ri​+βVn(e0)}.

The three terms with VnV^nVn replaced by VβV_\betaVβ​ form the right side of the optimality equation (1). The β\betaβ-optimal produce, inspect and revise regions are the sets of beliefs at which the corresponding term equals Vβ(P)V_\beta(P)Vβ​(P), and a stationary rule is β\betaβ-optimal when it always selects an action attaining the minimum.

In the two-state process of §3, state 000 is good and state 111 is bad: P00=1−πP_{00}=1-\piP00​=1−π, P11=1P_{11}=1P11​=1, C0=0C_0=0C0​=0, C1=CC_1=CC1​=C, I0=I1=II_0=I_1=II0​=I1​=I, R0=R1=RR_0=R_1=RR0​=R1​=R, with C<I<RC<I<RC<I<R. The belief is a number P∈[0,1]P\in[0,1]P∈[0,1], the probability of the bad state, TP=P+π−πPTP=P+\pi-\pi PTP=P+π−πP, and the optimality equation becomes

Vβ(P)=min⁡{CP+βVβ(TP); I+βPVβ(1)+β(1−P)Vβ(π); R+βVβ(π)}.(3)V_\beta(P)=\min\{CP+\beta V_\beta(TP);\ I+\beta PV_\beta(1)+\beta(1-P)V_\beta(\pi);\ R+\beta V_\beta(\pi)\}.\tag{3}Vβ​(P)=min{CP+βVβ​(TP); I+βPVβ​(1)+β(1−P)Vβ​(π); R+βVβ​(π)}.(3)

Formalization targets

Goal: Theorem 3.3, the four-region structure

There are thresholds π≤P1≤P2≤P3\pi\le P_1\le P_2\le P_3π≤P1​≤P2​≤P3​ with P2≤1P_2\le1P2​≤1 such that the rule

produce on [0,P1),inspect on [P1,P2),produce on [P2,P3),revise on [P3,1]\text{produce on }[0,P_1),\quad\text{inspect on }[P_1,P_2),\quad\text{produce on }[P_2,P_3),\quad\text{revise on }[P_3,1]produce on [0,P1​),inspect on [P1​,P2​),produce on [P2​,P3​),revise on [P3​,1]

is β\betaβ-optimal, and P3≤1P_3\le1P3​≤1 whenever revising is β\betaβ-optimal at some belief. Degenerate thresholds (empty intervals) are allowed, so the statement fixes only the order of the regions, not their number.

Milestones

  1. (1): value iteration converges on SSS, VβV_\betaVβ​ is bounded, solves (1), and is its unique bounded solution.
  2. Lemma 2.1: VβV_\betaVβ​ is concave on SSS.
  3. Theorem 2.2: the β\betaβ-optimal inspect and revise regions are convex.
  4. (3): the two-state optimality equation, as an instance of (1).
  5. Lemma 3.1: in the two-state model VβV_\betaVβ​ is nondecreasing on [0,1][0,1][0,1].
  6. Lemma 3.2: for 0≤P≤π0\le P\le\pi0≤P≤π, producing is strictly better than inspecting and than revising.

Significance

Theorem 3.3 reduces the search for an optimal policy in the two-state problem to the choice of three numbers, and it fixes the order of the regions: there is never a revise region below an inspect region, and inspection never occurs below the deterioration probability π\piπ. Together with Theorems 3.4 and 3.7 of the same paper (separate missions in this series), it is the basis for computing optimal inspection policies by searching over thresholds. Theorem 2.2 holds for any countable state space and is the general form of the observation that, in partially observed problems with linear-in-belief action costs, the regions of the "information" and "reset" actions are convex while the region of the passive action need not be.

The results are proved in the paper. As far as a search of the Prove2Me library shows (October 2026), none of them is formalized. Related formal work treats other models: belief-state reductions of finite POMDPs, and abstract contraction models for discounted dynamic programming. The mission produces machine-checked versions of the general model's optimality equation, the concavity of its value function, the convexity of two of its regions, and the two-state structure theorem.

Difficulty

The paper's proofs are short and lean on facts quoted from the literature. Theorem 3.3's proof is two sentences long. Filling it in requires several facts that the paper leaves implicit. The revise region of the two-state model is a closed right-hand interval. The inspect region meets [0,1][0,1][0,1] in an interval, through the affine embedding P↦(1−P,P)P\mapsto(1-P,P)P↦(1−P,P) of [0,1][0,1][0,1] into SSS. The half-open endpoints of the rule select optimal actions. That last point needs continuity of VβV_\betaVβ​ inside (0,1)(0,1)(0,1), a consequence of concavity, and Lemma 3.2 at the left end. The naive reading of the printed theorem, with all three thresholds in [0,1][0,1][0,1], is false in general (see below), so the threshold bookkeeping cannot be skipped.

On the general side, the optimality equation (1) is quoted from Blackwell. Here it must be proved for value iteration on the belief simplex of a countable state space, where the inspect term is an infinite series of values at the rows eie^iei. Its convergence and the contraction estimates use the boundedness of the costs.

Formalization scope

The general model is a structure over a type ι with [Countable ι], a distinguished state i₀, a transition matrix Pm, costs C I R : ι → ℝ and β. A separate predicate Model.Valid requires nonnegative entries, rows with HasSum (Pm i) 1, bounded costs and 0 < β < 1. The simplex uses HasSum P 1, never tsum, so it consists of genuine probability vectors. VβV_\betaVβ​ is defined as limUnder atTop of value iteration from V0=0V^0=0V0=0, which is the paper's own characterization in the proof of Lemma 2.1. It is not an arbitrary function assumed to satisfy (1). The paper's definition as an infimum over measurable policies is not formalized; the policy class would be a separate mission. Regions are subsets of SSS.

The two-state model is the instance ι = Fin 2 with P00=1−πP_{00}=1-\piP00​=1−π, P01=πP_{01}=\piP01​=π, P10=0P_{10}=0P10​=0, P11=1P_{11}=1P11​=1, and its value at the scalar belief PPP is the general VβV_\betaVβ​ at (1−P,P)(1-P,P)(1−P,P). The general Lemma 2.1 and Theorem 2.2 therefore apply to it without restatement. Standing hypotheses of §3 are 0<β<10<\beta<10<β<1, 0≤π≤10\le\pi\le10≤π≤1 and 0<C<I<R0<C<I<R0<C<I<R. 0<C0<C0<C is implicit in the paper, where the good state costs 000 and the bad state CCC. "β\betaβ-optimal rule" means a rule selecting a minimizer of the right side of (3) at every P∈[0,1]P\in[0,1]P∈[0,1], the criterion the paper quotes on p. 588. "Every β\betaβ-optimal policy produces" (Lemma 3.2) means that producing is the unique minimizer.

Threshold repair. The paper prints π≤P1≤P2≤P3≤1\pi\le P_1\le P_2\le P_3\le1π≤P1​≤P2​≤P3​≤1. This is false when revising is never optimal, for instance when R>C/(1−β(1−π))R>C/(1-\beta(1-\pi))R>C/(1−β(1−π)): then always producing is optimal and revising at P=1P=1P=1 is strictly worse, so no rule revising on a nonempty [P3,1][P_3,1][P3​,1] is optimal. The goal keeps P3≤1P_3\le1P3​≤1 exactly when the β\betaβ-optimal revise region is nonempty and otherwise allows P3>1P_3>1P3​>1; the rest of the printed chain, π≤P1≤P2≤1\pi\le P_1\le P_2\le1π≤P1​≤P2​≤1, is kept. Adding the hypothesis R<C/(1−β(1−π))R<C/(1-\beta(1-\pi))R<C/(1−β(1−π)) instead would drop a case the paper covers.

The statement admits no trivializing reading. The thresholds are quantified existentially, but the rule must be optimal at every belief in [0,1][0,1][0,1], VβV_\betaVβ​ is pinned down by its definition, and the paper's numbers (C=4C=4C=4, π=0.1\pi=0.1π=0.1, I=6I=6I=6, R=10R=10R=10, β=0.9\beta=0.9β=0.9) satisfy all hypotheses.

Infrastructure needed: tsum manipulations on the belief simplex (linearity of TTT, summability of ∑iPiV(ei)\sum_iP_iV(e^i)∑i​Pi​V(ei) for bounded VVV), a sup-norm contraction argument for value iteration, and closure of concavity under minima and pointwise limits. The value-iteration and contraction lemmas are reusable for any discounted model with bounded costs. Contributions of intermediate lemmas, such as continuity of the two-state VβV_\betaVβ​ on (0,1](0,1](0,1] or the bridge identities T(1−P,P)=(1−TP,TP)T(1-P,P)=(1-TP,TP)T(1−P,P)=(1−TP,TP), are welcome.

Selected references

  • S. M. Ross, Quality Control under Markovian Deterioration, Management Science 17(9):587–596, 1971. https://doi.org/10.1287/mnsc.17.9.587
  • D. Blackwell, Discounted Dynamic Programming, Annals of Mathematical Statistics 36(1):226–235, 1965. https://doi.org/10.1214/aoms/1177700285
  • K. J. Åström, Optimal Control of Markov Processes with Incomplete State Information, Journal of Mathematical Analysis and Applications 10(1):174–205, 1965. https://doi.org/10.1016/0022-247X(65)90154-X
9 thms2 active usersReviewed
🏆Completed
CombinatoricsGraph Theory·Captain: mikedeng1

Zur allgemeinen Kurventheorie I: Menger's Theorem for Finite Graphs, If No Fewer Than n Points Separate Two Finite Sets P and Q, Then n Disjoint Paths Join P to QResearch Paper

Motivation

Menger's theorem is the oldest of the min–max theorems of combinatorial optimization. It says that the largest number of disjoint paths joining two sets of vertices of a finite graph equals the smallest number of vertices whose removal disconnects them. The max-flow/min-cut theorem of Ford and Fulkerson (1956), the Kőnig–Egerváry theorem on bipartite matchings (1931), Whitney's characterization of kkk-connected graphs (1932) and the integrality of network-flow polytopes all belong to its family. In operations research it underlies network reliability (how many vertex failures a network survives) and disjoint routing.

Karl Menger proved it in 1927, in a paper on curves. In Zur allgemeinen Kurventheorie (Fund. Math. 10, pp. 96–115) the graph statement is a lemma, Satz δ (p. 101), on the way to characterizing the order of a point of a regular curve by the number of arcs ending there (the subject of mission II of this series).

Timeline.

  • 1927. Menger states Satz β for compact regular one-dimensional spaces and proves its finite case, Satz δ, for finite unions of arcs, by induction on the number of arcs (Menger 1927).
  • 1931. Kőnig observes that one step of the induction, called "offenbar" on p. 102, is in the bipartite case exactly his matching theorem, and supplies it (Kőnig 1931, see the references). Kőnig's 1936 book gives the first complete graph-theoretic proof.
  • 1932. Whitney derives the two-vertex form for kkk-connected graphs.
  • 1956. Ford and Fulkerson's max-flow/min-cut theorem gives the flow-theoretic proof; Dantzig and Fulkerson connect it to LP duality.

Setting

Let GGG be a finite simple graph on a vertex set VVV, and let P,Q⊆VP, Q \subseteq VP,Q⊆V be disjoint sets of vertices.

A set S⊆VS \subseteq VS⊆V separates PPP and QQQ if every walk of GGG from a vertex of PPP to a vertex of QQQ passes through a vertex of SSS. The set SSS may contain vertices of PPP and of QQQ; in particular S=PS = PS=P always separates.

GGG is nnn-point connected between PPP and QQQ ("n-punktig zusammenhängend", p. 100) if no set of fewer than nnn vertices separates PPP and QQQ:

∣S∣≥nfor every S separating P and Q.|S| \ge n \quad\text{for every } S \text{ separating } P \text{ and } Q .∣S∣≥nfor every S separating P and Q.

A family of nnn disjoint PPP–QQQ paths consists of paths W1,…,WnW_1, \dots, W_nW1​,…,Wn​ of GGG, each from a vertex of PPP to a vertex of QQQ, whose vertex sets are pairwise disjoint, end vertices included.

The degree (Grad) of GGG is its number of edges. A part of GGG is a spanning subgraph H≤GH \le GH≤G; it is proper if it lacks an edge of GGG. GGG is irreducibly nnn-point connected between PPP and QQQ if it is nnn-point connected and no proper part is. For a separating set SSS, the side K1K_1K1​ of SSS towards PPP is formed by the components of G−SG - SG−S that meet P−SP - SP−S, together with their edges to S−PS - PS−P; the side K2K_2K2​ towards QQQ is defined symmetrically.

In Lean these are Menger27.Graphs.Separates, NPointConnected, HasDisjointPaths, IrreduciblyNPointConnected and sidePart.

Formalization targets

Goal: Satz δ (p. 101)

G is n-point connected between disjoint P and Q⟹G contains n disjoint P–Q paths.G \text{ is } n\text{-point connected between disjoint } P \text{ and } Q \quad\Longrightarrow\quad G \text{ contains } n \text{ disjoint } P\text{–}Q \text{ paths.}G is n-point connected between disjoint P and Q⟹G contains n disjoint P–Q paths.

This is the direction Menger states; the converse (disjoint paths force every separator to be large) is immediate and is not part of the mission.

Milestones: the proof of Satz δ, in the paper's order (pp. 101–102)

  1. A graph nnn-point connected between PPP and QQQ has at least nnn edges.
  2. If it has exactly nnn edges, it consists of nnn disjoint PPP–QQQ paths.
  3. It contains an irreducibly nnn-point connected part K′K'K′.
  4. If K′K'K′ is irreducible and has more than nnn edges, it has a vertex s∉P∪Qs \notin P \cup Qs∈/P∪Q on one of its edges.
  5. Through such an sss passes a set SSS of exactly nnn vertices separating PPP and QQQ in K′K'K′.
  6. For an nnn-vertex separating set SSS with ∣S∩P∣=p|S \cap P| = p∣S∩P∣=p, the side K1K_1K1​ is (n−p)(n-p)(n−p)-point connected between P−SP - SP−S and S−PS - PS−P.
  7. n−pn - pn−p disjoint paths in K1K_1K1​ and n−qn - qn−q disjoint paths in K2K_2K2​ (with q=∣S∩Q∣q = |S \cap Q|q=∣S∩Q∣) combine into nnn disjoint PPP–QQQ paths in GGG.

Significance

The result. Satz δ is the vertex form of Menger's theorem for two sets, from which the other standard forms follow: the two-vertex form, Whitney's theorem, the edge form (through line graphs), Kőnig's theorem (for bipartite GGG with PPP, QQQ the two sides) and, through a standard reduction, integral max-flow/min-cut for unit capacities. Menger used it as the finite step of his theorem on nnn-legs at points of regular curves.

Formalizing it. The theorem is proved, with many published proofs. Mathlib at the pinned revision has edge connectivity of simple graphs but no vertex separators between sets and no form of Menger's theorem; nothing on Prove2Me states it in set form. The mission produces a statement of Satz δ about Mathlib's SimpleGraph, together with the intermediate claims of Menger's own induction, so that the original argument, including the step Kőnig completed, can be checked. Related posed items on the platform are the two-vertex Whitney theorem Balinski61.Whitney.whitney_theorem (internally disjoint paths between two vertices) and Kőnig's theorem MatousekLP.Integrality.konig; neither is the set form stated here, and neither is proved yet.

Difficulty

The obvious argument, choosing disjoint paths one at a time, fails: a first path chosen badly can block every completion, so the paths must be chosen together. Menger's induction avoids this by passing to an irreducible part and cutting it at an nnn-vertex separator, but it needs a vertex outside P∪QP \cup QP∪Q to cut at (milestone 4). When every vertex of the irreducible part lies in P∪QP \cup QP∪Q the part is bipartite between PPP and QQQ, and the claim is then Kőnig's matching theorem rather than an observation; this is the gap of 1927. The gluing step (milestone 7) is also more delicate than on the page: the paths of the two sides must meet the separator only at their ends, which depends on how the sides are cut out.

Formalization scope

Representation. Menger's gewöhnlich eindimensionaler Raum, a finite union of arcs meeting at most in end points, is read as a finite simple graph G : SimpleGraph V with [Fintype V]; PPP and QQQ are Finset V. Vertices are the points of P∪QP \cup QP∪Q and the end and branch points (Menger's punktförmige Stücke); edges are the arcs between them, subdivided so that there are no loops or parallel edges. Subdivision changes neither separation nor the number of disjoint paths, and a separating point inside an arc can be moved to an end of the arc. Menger's degree (the number of arcs between consecutive punktförmige Stücke) becomes the number of edges, which a subdivision only increases; every milestone stays true.

Conventions and explicit readings of the paper's phrases.

  • Separation is phrased through walks: every walk from PPP to QQQ meets SSS. Separators may meet PPP and QQQ.
  • Disjointness of PPP and QQQ ("fremden", p. 100) is a hypothesis of every theorem, not part of the definition. Paths are disjoint including their end points; with P∩Q=∅P \cap Q = \emptysetP∩Q=∅ every path has an edge.
  • "Teil" is a spanning subgraph H ≤ G; "echter Teil" is H < G.
  • "Offenbar enthält K′ ein punktförmiges Stück s …" (p. 102) is read as: a vertex s∉P∪Qs \notin P \cup Qs∈/P∪Q lying on an edge of K′K'K′.
  • "In K′ − s sind n − 1 Punkte … so dass … S = {s, s₂, … sₙ}" is read as: a separating set of exactly nnn vertices containing sss.
  • "Besteht aus n Bögen" (milestone 2) is read as: nnn disjoint PPP–QQQ paths covering every edge.
  • The side K1K_1K1​ is constructed from GGG, PPP and SSS (sidePart G P S), not quantified over; it has no edges at the vertices of S∩PS \cap PS∩P, matching Menger's K1⊆K′−SK_1 \subseteq K' - SK1​⊆K′−S considered between P−S⋅PP - S\cdot PP−S⋅P and S−S⋅PS - S\cdot PS−S⋅P.
  • The subtractions n−pn - pn−p and n−qn - qn−q are exact, since ∣S∣=n|S| = n∣S∣=n.
  • On p. 101 the induction hypothesis is printed as "Satz γ"; it is Satz δ.

Trivializations ruled out. Forcing separators to avoid P∪QP \cup QP∪Q, counting internally disjoint or edge-disjoint paths, or allowing two paths to share an end vertex would each change the theorem; none is done. No hypothesis restricts nnn, and n=0n = 0n=0 is the trivial case, not an excluded one.

Needed infrastructure. Walk surgery (prefixes up to the first visit of a set, concatenation, conversion of walks to paths), transfer of walks along SimpleGraph inclusions, and well-founded induction on the number of edges. Separators and disjoint path families between sets are reusable beyond this mission, for Whitney's theorem, Kőnig's theorem and flow integrality. Proofs by any method are welcome, including a proof of the goal through max-flow/min-cut or an independent argument (Göring's) bypassing the milestones.

Selected references

  • K. Menger, Zur allgemeinen Kurventheorie, Fundamenta Mathematicae 10 (1927), 96–115. https://doi.org/10.4064/fm-10-1-96-115
  • D. Kőnig, Gráfok és mátrixok, Matematikai és Fizikai Lapok 38 (1931), 116–119 (no DOI; English discussion in Diestel, Graph Theory, §2.1 and §3.3).
  • H. Whitney, Congruent graphs and the connectivity of graphs, American Journal of Mathematics 54 (1932), 150–168. https://doi.org/10.2307/2371086
  • L. R. Ford, D. R. Fulkerson, Maximal flow through a network, Canadian Journal of Mathematics 8 (1956), 399–404. https://doi.org/10.4153/CJM-1956-045-5
  • F. Göring, Short proof of Menger's theorem, Discrete Mathematics 219 (2000), 295–296. https://doi.org/10.1016/S0012-365X(00)00088-1
  • R. Diestel, Graph Theory, 5th ed., Springer, 2017, §3.3. https://doi.org/10.1007/978-3-662-53622-3
10 thms2 active usersReviewed
🏆Completed
CombinatoricsGraph TheoryLinear Optimization·Captain: mikedeng1

Integer Programming Formulation of Traveling Salesman Problems: The Miller–Tucker–Zemlin Constraints Exactly Describe the Itineraries with at Most p Cities per TourResearch Paper

Why this formulation matters

The traveling salesman problem asks for a shortest closed route through a set of cities. Writing it as an integer program requires linear constraints whose integer solutions are exactly the routes. The assignment constraints (each city entered once and left once) are not enough: their integer solutions include collections of disjoint cycles, called subtours, that never pass through the starting city. Some extra family of constraints must rule these out.

In 1960 C. E. Miller, A. W. Tucker and R. A. Zemlin gave such a family using one auxiliary real variable per city (J. ACM 7(4), 326–329). Their MTZ constraints have polynomially many rows, n2−nn^2-nn2−n for nnn cities, whereas the subtour elimination constraints of Dantzig, Fulkerson and Johnson (1954) (Oper. Res. 2(4)) have one row per subset of cities. They also handle a generalization: a salesman who returns to base several times, visiting at most ppp cities per trip. This is the basic form of a capacitated vehicle routing problem. MTZ-type constraints remain standard in vehicle routing models and in textbook formulations of the TSP. Their linear relaxations are known to be weaker than those of the subtour elimination formulation (Padberg and Sung, 1991).

The paper attributes the model to Tucker and reports five machine experiments with Gomory's all-integer algorithm. The computational part is outside this mission.

Setting

There are nnn cities 1,…,n1,\dots,n1,…,n and a base city 000. A tour is a succession of visits to cities without stopping at city 000. In problem (1) the salesman leaves 000, visits each of the nnn cities exactly once and returns to 000, possibly several times, with at most ppp cities per tour. Formally, an itinerary is a list I=(T1,…,Tt)I=(T_1,\dots,T_t)I=(T1​,…,Tt​) of tours. Each tour is a nonempty list of cities other than 000 of length at most ppp, and each city 1,…,n1,\dots,n1,…,n occurs exactly once in the concatenation of the tours. The number ttt of tours is the number of returns to 000. Tour (c1,…,ck)(c_1,\dots,c_k)(c1​,…,ck​) travels the arcs (0,c1),(c1,c2),…,(ck,0)(0,c_1),(c_1,c_2),\dots,(c_k,0)(0,c1​),(c1​,c2​),…,(ck​,0). aij(I)a_{ij}(I)aij​(I) denotes the number of times III travels the arc (i,j)(i,j)(i,j). For real distances dijd_{ij}dij​, the length of III is the sum of dijd_{ij}dij​ over the arcs it travels.

Problem (2) has non-negative integer variables xijx_{ij}xij​ (0≤i≠j≤n0\le i\ne j\le n0≤i=j≤n) and real variables u1,…,unu_1,\dots,u_nu1​,…,un​:

min⁡∑∑0≤i≠j≤ndijxijs.t.∑i=0i≠jnxij=1 (j≥1),∑j=0j≠inxij=1 (i≥1),ui−uj+p xij≤p−1 (1≤i≠j≤n).\min \sum\sum_{0\le i\ne j\le n} d_{ij}x_{ij}\quad\text{s.t.}\quad \sum_{\substack{i=0\\ i\ne j}}^{n} x_{ij}=1\ (j\ge1),\quad \sum_{\substack{j=0\\ j\ne i}}^{n} x_{ij}=1\ (i\ge1),\quad u_i-u_j+p\,x_{ij}\le p-1\ (1\le i\ne j\le n).min∑0≤i=j≤n∑​dij​xij​s.t.i=0i=j​∑n​xij​=1 (j≥1),j=0j=i​∑n​xij​=1 (i≥1),ui​−uj​+pxij​≤p−1 (1≤i=j≤n).

When the number of tours ttt is fixed, the relation ∑i=1nxi0=t\sum_{i=1}^n x_{i0}=t∑i=1n​xi0​=t is added. With t=1t=1t=1 and p≥np\ge np≥n, (1) is the standard traveling salesman problem.

Formalization targets

Goal: the equivalence of (1) and (2)

For every n≥0n\ge0n≥0 and every p≥1p\ge1p≥1:

{ x:∃u, (x,u) feasible for (2) }  =  { a(I):I a legitimate itinerary of (1) },\{\,x : \exists u,\ (x,u)\ \text{feasible for (2)}\,\} \;=\; \{\,a(I) : I \text{ a legitimate itinerary of (1)}\,\},{x:∃u, (x,u) feasible for (2)}={a(I):I a legitimate itinerary of (1)},

with ∑i=1nxi0\sum_{i=1}^n x_{i0}∑i=1n​xi0​ equal to the number of tours t(I)t(I)t(I), and with the uiu_iui​ in the converse taken to be non-negative integers. In addition, ∑∑i≠jdij aij(I)\sum\sum_{i\ne j} d_{ij}\,a_{ij}(I)∑∑i=j​dij​aij​(I) equals the length of III for all real ddd. The paper says that (2) "will be shown to be equivalent to (1)". Its "burden of proof" is that the two feasible sets correspond and the two objectives agree, and the goal states exactly that.

Milestones, in the order of the paper's proof

  1. The constraints of (2) force xij∈{0,1}x_{ij}\in\{0,1\}xij​∈{0,1} (p. 327).
  2. Along a path r0,…,rmr_0,\dots,r_mr0​,…,rm​ of non-base cities with all xrkrk+1=1x_{r_kr_{k+1}}=1xrk​rk+1​​=1, ur0−urm≤−mu_{r_0}-u_{r_m}\le-mur0​​−urm​​≤−m (p. 328).
  3. A feasible xxx has no cycle that avoids city 000, so all tours include city 0 (pp. 327–328).
  4. For p≥1p\ge1p≥1, no tour of a feasible xxx visits more than ppp cities (p. 328).
  5. The converse: ui=u_i=ui​= the position of city iii in its tour makes (a(I),u)(a(I),u)(a(I),u) feasible, with 1≤ui≤p1\le u_i\le p1≤ui​≤p (p. 328).
  6. Under x=a(I)x=a(I)x=a(I) the objective of (2) is the distance travelled in (1) (p. 327).
  7. An itinerary with ttt tours of at most ppp cities requires tp≥ntp\ge ntp≥n (p. 326).

Significance

The result. The theorem justifies using (2) in place of (1). Because the feasible sets match and the objectives agree, an optimal solution of (2) is an optimal itinerary of (1), and the same holds with the number of tours fixed. It also shows that a compact, polynomial-size family of linear inequalities in auxiliary potentials excludes every subtour. The same idea, with the uiu_iui​ read as loads or arrival times, underlies the standard capacity and time-window constraints of vehicle routing.

Formalizing it. The result is classical and its proof is short, but the paper argues informally. It follows successor chains, treats "a tour" without defining an itinerary, and leaves several steps implicit, including the hypothesis p≥1p\ge1p≥1 and the distinctness of rp+1r_{p+1}rp+1​ and r1r_1r1​. No machine-checked statement of the MTZ equivalence is recorded on the platform. The remaining work is the whole formal proof: the combinatorics that turns a 0/1 matrix with unit row and column sums and no subtours into a list of tours, the converse labelling, and the bookkeeping identity between the two objectives.

Difficulty

The inequalities themselves are elementary. Each milestone about (2) is a short computation with the potentials uiu_iui​. The work is in the passage from a feasible matrix xxx to an itinerary. The successor walk from city 000 must be shown to terminate at 000 and to cover every arc of xxx. The resulting tours must be listed so that their arc counts reproduce xxx exactly, including the number of arcs leaving 000. That number is not constrained directly in (2). It equals ∑ixi0\sum_{i}x_{i0}∑i​xi0​ only through a counting argument on the row and column sums. A proof that only shows some itinerary exists does not establish the correspondence the paper claims.

Formalization scope

Cities are Fin (n + 1) with 0 the base city, which is the paper's indexing. The commitments, each also stated in the items' Formalization Notes, are:

  • An itinerary is a List of tours, each tour a List of cities. The paper's "legitimate itinerary" is read as: every tour nonempty, free of 0, of length at most ppp; the concatenation duplicate-free; every city 1,…,n1,\dots,n1,…,n present.
  • "A feasible solution to (2) has xijx_{ij}xij​ which do define a legitimate itinerary" is read as x=a(I)x=a(I)x=a(I), the arc counts of III, together with ∑i=1nxi0=t(I)\sum_{i=1}^n x_{i0}=t(I)∑i=1n​xi0​=t(I) ("The number of returns to city 0 is given by ∑xi0\sum x_{i0}∑xi0​"). Arc counts are counts, so xij∈{0,1}x_{ij}\in\{0,1\}xij​∈{0,1} is a theorem, not an encoding choice.
  • "Together with appropriate uiu_iui​" is made explicit as the existence of natural-number uiu_iui​, following the paper's remark that the uiu_iui​ may be taken non-negative integers. The labelling ui=ju_i=jui​=j is a definition.
  • Problem (2) has no variables xiix_{ii}xii​. The matrix xxx is indexed by all pairs and the clause xii=0x_{ii}=0xii​=0 encodes their absence. u0u_0u0​ exists in the encoding but appears in no constraint.
  • xij∈Nx_{ij}\in\mathbb Nxij​∈N ("non-negative integers"), ui∈Ru_i\in\mathbb Rui​∈R ("arbitrary real numbers"), and p−1p-1p−1 and p xijp\,x_{ij}pxij​ are computed in R\mathbb RR.
  • Added hypothesis p≥1p\ge1p≥1 in the goal and in milestone 4. The paper does not state it, and the claim is false without it: for n=1n=1n=1, p=0p=0p=0, x01=x10=1x_{01}=x_{10}=1x01​=x10​=1 is feasible for (2) but no itinerary exists.
  • The distances dijd_{ij}dij​ are arbitrary reals, with no sign, symmetry or triangle condition, as on the page.
  • Milestone 2 states the exact summed bound −m-m−m. The page prints the weaker j+1−kj+1-kj+1−k.
  • Milestone 3 excludes every cycle of xxx avoiding 000. The page argues for the cycle met while following successors from 000, by an argument that applies to any such cycle.

Not formalized: the constraint and variable counts and the elimination of xi0,x0jx_{i0},x_{0j}xi0​,x0j​ "to produce an equivalent problem with n2+nn^2+nn2+n inequalities and n2n^2n2 variables" (p. 328), which the paper does not make precise, and the machine experiments (pp. 328–329).

Trivializing readings are ruled out. The goal identifies xxx with the arc counts of an itinerary, not merely the existence of some itinerary. The hypotheses are satisfiable: for n=3n=3n=3, p=2p=2p=2, the itinerary [[1,2],[3]][[1,2],[3]][[1,2],[3]] with u=(1,2,1)u=(1,2,1)u=(1,2,1) is feasible for (2), while the subtour x01=x10=x23=x32=1x_{01}=x_{10}=x_{23}=x_{32}=1x01​=x10​=x23​=x32​=1 is not, for any uuu. Contributions welcome: proofs of the milestones, a reusable library of "functional digraph with unit in- and out-degree" decompositions, and the optimization corollary (equal optimal values of (1) and (2)).

Selected references

  • C. E. Miller, A. W. Tucker, R. A. Zemlin, Integer Programming Formulation of Traveling Salesman Problems, Journal of the ACM 7(4), 326–329, 1960. https://doi.org/10.1145/321043.321046
  • G. Dantzig, R. Fulkerson, S. Johnson, Solution of a Large-Scale Traveling-Salesman Problem, Operations Research 2(4), 393–410, 1954. https://doi.org/10.1287/opre.2.4.393
  • M. Padberg, T.-Y. Sung, An analytical comparison of different formulations of the travelling salesman problem, Mathematical Programming 52, 315–357, 1991. https://doi.org/10.1007/BF01582894
  • R. E. Gomory, Outline of an algorithm for integer solutions to linear programs, Bulletin of the AMS 64(5), 275–278, 1958. https://doi.org/10.1090/S0002-9904-1958-10224-4
9 thms2 active usersReviewed
🏆Completed
Convex OptimizationFunctional AnalysisOptimization·Captain: mikedeng1

Régularisation d'inéquations variationnelles par approximations successives I: Every Weak Cluster Point of the Regularized Iterates Solves the Monotone Variational InequalityResearch Paper

Motivation

The proximal point algorithm is a basic iterative scheme of convex optimization and monotone operator theory. To solve a problem governed by a monotone operator, it replaces the problem by a sequence of better-conditioned problems, each regularized by a quadratic term centred at the previous iterate. Augmented Lagrangian methods, the Douglas–Rachford and ADMM splitting schemes, and many bundle methods can all be read as instances of it.

The scheme first appeared in a five-page note by Bernard Martinet in the Revue française d'informatique et de recherche opérationnelle (1970), under the name régularisation par approximations successives. Martinet stated it for a monotone variational inequality on a bounded closed convex subset of a Hilbert space and proved that the weak cluster points of the iterates are solutions. This mission formalizes that first convergence theorem as it was originally stated.

Timeline.

  • 1966–1967: Hartman–Stampacchia and Lions–Stampacchia prove existence of solutions for monotone, hemicontinuous variational inequalities on bounded closed convex sets (Lions–Stampacchia 1967). Minty's lemma characterizes the solution set by the inequality with the operator evaluated at the variable point.
  • 1970: Martinet introduces the regularization iteration (2) and proves Théorème 1 below (Martinet 1970). In §IV of the same note he states the convex-minimization version.
  • 1976: Rockafellar extends the method to maximal monotone operators, allowing inexact steps and variable step sizes, and proves weak convergence of the whole sequence when a zero exists (Rockafellar 1976).
  • 1991: Güler constructs an example in which the iterates converge weakly but not strongly (Güler 1991).

Setting

Let HHH be a real Hilbert space with inner product ⟨⋅,⋅⟩\langle\cdot,\cdot\rangle⟨⋅,⋅⟩ and norm ∥⋅∥\|\cdot\|∥⋅∥. Let H′H'H′ be its dual, and write (φ,y)(\varphi, y)(φ,y) for the value of a functional φ∈H′\varphi\in H'φ∈H′ at y∈Hy\in Hy∈H. Let C⊆HC\subseteq HC⊆H be convex, closed and bounded, and let T:H→H′T:H\to H'T:H→H′ be

  • monotone on CCC: (Tx−Ty, x−y)≥0(Tx-Ty,\,x-y)\ge0(Tx−Ty,x−y)≥0 for all x,y∈Cx,y\in Cx,y∈C;
  • hemicontinuous on CCC: for all x,y∈Cx,y\in Cx,y∈C, the map t↦T((1−t)x+ty)t\mapsto T((1-t)x+ty)t↦T((1−t)x+ty), t∈[0,1]t\in[0,1]t∈[0,1], is continuous into H′H'H′ with its weak topology.

The variational inequality (1) asks for xˉ∈C\bar x\in Cxˉ∈C such that

(Txˉ, x−xˉ)≥0∀x∈C.(T\bar x,\, x-\bar x)\ge 0\qquad\forall x\in C .(Txˉ,x−xˉ)≥0∀x∈C.

Its solution set is denoted MMM (solSet T C in Lean).

Martinet's regularization algorithm starts from x0∈Cx^0\in Cx0∈C. Given xn∈Cx^n\in Cxn∈C, it determines xn+1∈Cx^{n+1}\in Cxn+1∈C such that

(Txn+1, x−xn+1)+⟨xn+1−xn, x−xn+1⟩≥0∀x∈C.(2)(Tx^{n+1},\, x-x^{n+1})+\langle x^{n+1}-x^n,\, x-x^{n+1}\rangle\ge 0\qquad\forall x\in C. \tag{2}(Txn+1,x−xn+1)+⟨xn+1−xn,x−xn+1⟩≥0∀x∈C.(2)

In words, xn+1x^{n+1}xn+1 solves the variational inequality for the operator T+( ⋅ −xn)T+(\,\cdot\,-x^n)T+(⋅−xn), which is strongly monotone. A point x~\tilde xx~ is a weak cluster point of (xn)(x^n)(xn) if every neighbourhood of x~\tilde xx~ in the weak topology contains xnx^nxn for infinitely many nnn.

Formalization targets

Goal: Théorème 1

x~ a weak cluster point of (xn) ⟹ x~∈M.\tilde x \text{ a weak cluster point of } (x^n)\ \Longrightarrow\ \tilde x\in M .x~ a weak cluster point of (xn) ⟹ x~∈M.

Every weak cluster point of the regularized iterates solves (1). The paper's Lemme 2 states the same thing. The goal assumes neither that (1) has a solution nor that TTT is bounded on CCC.

Milestones, in the order the paper uses them

  1. §2.1: (1) has at least one solution when C≠∅C\neq\emptysetC=∅, so M≠∅M\neq\emptysetM=∅.
  2. §2.2: the step (2) has exactly one solution xn+1∈Cx^{n+1}\in Cxn+1∈C for every xn∈Cx^n\in Cxn∈C.
  3. §2.3, (5): Minty's characterization M={xˉ∈C∣(Tx, x−xˉ)≥0 ∀x∈C}M=\{\bar x\in C\mid (Tx,\,x-\bar x)\ge0\ \forall x\in C\}M={xˉ∈C∣(Tx,x−xˉ)≥0 ∀x∈C}.
  4. §2.3, (7): for every xˉ∈M\bar x\in Mxˉ∈M, ∥xn+1−xˉ∥2≤∥xn−xˉ∥2−∥xn+1−xn∥2\|x^{n+1}-\bar x\|^2\le\|x^n-\bar x\|^2-\|x^{n+1}-x^n\|^2∥xn+1−xˉ∥2≤∥xn−xˉ∥2−∥xn+1−xn∥2.
  5. Lemme 1: ∥xn+1−xn∥→0\|x^{n+1}-x^n\|\to0∥xn+1−xn∥→0.
  6. §2.3, (8): lim inf⁡n(Txn+1, x−xn+1)≥0\liminf_n (Tx^{n+1},\,x-x^{n+1})\ge0liminfn​(Txn+1,x−xn+1)≥0 for every x∈Cx\in Cx∈C.
  7. §2.3, (9): lim inf⁡n(Tx, x−xn)≥0\liminf_n (Tx,\,x-x^{n})\ge0liminfn​(Tx,x−xn)≥0 for every x∈Cx\in Cx∈C.
  8. Corollaire (stronger than the goal): if M={xˉ}M=\{\bar x\}M={xˉ}, then xn⇀xˉx^n\rightharpoonup\bar xxn⇀xˉ.

Significance

The result. Théorème 1 is the first convergence theorem for the proximal point method. The method only needs to solve strongly monotone subproblems, and those are well posed even when the original problem is not. Together with the existence result, the theorem says the iterates accumulate weakly only at solutions. When the solution is unique, the whole sequence converges weakly (the Corollaire). The later theory of Rockafellar, Brézis–Lions and the splitting literature refines this statement.

Formalizing it. The result has been proved since 1970. What this mission adds is a machine-checked version that follows the original hypotheses: an operator into the dual, hemicontinuity rather than continuity, and no maximality assumption. The cited ingredients, the Lions–Stampacchia existence theorem in an infinite-dimensional Hilbert space and Minty's lemma, are not in Mathlib as far as this mission is aware. Formalizing them is part of the work and is reusable well beyond this paper. The milestone items on the platform are statements awaiting proof. None of them has a machine-checked proof yet.

Difficulty

Lemme 1 and inequality (7) follow from the defining inequality (2) and the algebra of the inner product. The difficulty is at two other points.

First, the iterates satisfy the variational inequality only approximately, and only with TTT evaluated at the iterate. A weak cluster point gives no control over TxnTx^{n}Txn, because TTT is merely hemicontinuous and is not assumed weakly continuous or bounded. The obvious idea, to pass to the limit in (Txn+1, x−xn+1)≥−εn(Tx^{n+1},\,x-x^{n+1})\ge -\varepsilon_n(Txn+1,x−xn+1)≥−εn​, fails for this reason. Passing to the limit requires the reformulation in which TTT is evaluated at a fixed point of CCC. That reformulation is Minty's characterization (5), and proving it uses hemicontinuity along segments.

Second, the proof of Lemme 1 needs a solution of (1) to exist. In infinite dimensions that is the Lions–Stampacchia theorem. Its standard proof goes through Brouwer's fixed point theorem on finite-dimensional sections together with weak compactness of CCC, and this is the heaviest item of the mission.

Formalization scope

  • HHH is a real Hilbert space: NormedAddCommGroup H, InnerProductSpace ℝ H, CompleteSpace H. The paper says only "espace de Hilbert". Its ordered inequalities force real scalars.
  • H′H'H′ is StrongDual ℝ H, and (φ,y)(\varphi,y)(φ,y) is φ y. TTT is not replaced by a map H→HH\to HH→H through the Riesz isomorphism.
  • Hemicontinuity is weak-* continuity: for x,y∈Cx,y\in Cx,y∈C and every z∈Hz\in Hz∈H, the map t↦(T((1−t)x+ty),z)t\mapsto (T((1-t)x+ty),z)t↦(T((1−t)x+ty),z) is continuous on [0,1][0,1][0,1]. Since HHH is reflexive, this is the paper's weak topology on H′H'H′. It is not strengthened to continuity of TTT.
  • The algorithm is a relation (IsRegSeq): any sequence with x0∈Cx^0\in Cx0∈C that satisfies (2) at every step. Existence and uniqueness of the step are milestone 2, not built into a definition.
  • A weak cluster point is MapClusterPt in WeakSpace ℝ H, a cluster point in the weak topology. It is not a cluster point in the norm topology, which would make the goal weaker.
  • lim inf⁡nan≥0\liminf_n a_n\ge0liminfn​an​≥0 in (8) and (9) is stated as ∀ε>0\forall\varepsilon>0∀ε>0, eventually an≥−εa_n\ge-\varepsilonan​≥−ε. Filter.liminf on R\mathbb RR returns a junk value on sequences that are unbounded below.
  • "C nonempty" is added to the existence milestone. The paper leaves it implicit, and the claim is false for C=∅C=\emptysetC=∅.
  • In Lean the sequence is called xxx and an arbitrary point of CCC is called yyy. The paper uses the letter xxx for both.

A trivializing formalization is ruled out. The goal does not assume M≠∅M\neq\emptysetM=∅, boundedness of TTT, or strong cluster points. Its hypotheses are satisfiable: H=RH=\mathbb RH=R, C=[−1,1]C=[-1,1]C=[−1,1], (Tx,y)=xy(Tx,y)=xy(Tx,y)=xy, xn=2−nx^n=2^{-n}xn=2−n is an instance, checked locally.

Not formalized: Remarques 1 and 2 of §II (a variable-weight variant of (2), whose printed form is apparently misprinted, and the removal of boundedness of CCC under a coercivity condition), because the paper gives neither a proof. Théorème 2 (§III) and the convex-minimization §IV are not formalized either. §IV is the subject of the companion mission.

Contributions are welcome on each milestone, and especially on the general infrastructure: Minty's lemma, Hartman–Stampacchia/Lions–Stampacchia existence for monotone hemicontinuous operators, and the fact that bounded sequences in a Hilbert space have weak cluster points. A proved Brouwer fixed point theorem (AGT.brouwer_fixed_point) and a Banach–Alaoglu theorem (FamousTheorems.banach_alaoglu) are available on the platform as tools.

Selected references

  • B. Martinet, Brève communication. Régularisation d'inéquations variationnelles par approximations successives, Revue française d'informatique et de recherche opérationnelle, série rouge, 4(R-3) (1970), 154–158. https://doi.org/10.1051/m2an/197004R301541
  • J.-L. Lions, G. Stampacchia, Variational inequalities, Communications on Pure and Applied Mathematics 20 (1967), 493–519. https://doi.org/10.1002/cpa.3160200302
  • R. T. Rockafellar, Monotone operators and the proximal point algorithm, SIAM Journal on Control and Optimization 14 (1976), 877–898. https://doi.org/10.1137/0314056
  • O. Güler, On the convergence of the proximal point algorithm for convex minimization, SIAM Journal on Control and Optimization 29 (1991), 403–419. https://doi.org/10.1137/0329022
10 thms2 active usersReviewed
🏆Completed
Convex OptimizationLinear algebraOptimization·Captain: mikedeng1

Strongly Regular Generalized Equations III: Reduced-Form Criterion — a Linear Generalized Equation over a Polyhedral Set Is Strongly Regular Iff Its Reduced Form Is Uniquely Solvable on LResearch Paper

Motivation

Many problems in optimization and equilibrium modelling, among them linear and nonlinear complementarity problems, variational inequalities over polyhedra, and the Karush–Kuhn–Tucker conditions of nonlinear programs, can be written as a single generalized equation

0∈f(x)+∂ψC(x),0\in f(x)+\partial\psi_C(x),0∈f(x)+∂ψC​(x),

where ∂ψC\partial\psi_C∂ψC​ is the normal-cone operator of a closed convex set CCC. S. M. Robinson introduced strong regularity of such an inclusion at a solution x0x_0x0​ in Strongly regular generalized equations (1980) and proved an implicit-function theorem for it: when the linearised inclusion has a locally unique, Lipschitz inverse, solutions of the perturbed problem exist, are locally unique and depend Lipschitz-continuously on the perturbation. Strong regularity has since become the standard stability notion behind sensitivity analysis and the local convergence of Newton-type methods for variational problems; see Dontchev and Rockafellar, Implicit Functions and Solution Mappings (Springer, 2nd ed. 2014, doi:10.1007/978-1-4939-1037-3).

Strong regularity depends only on the linearisation, so deciding it means deciding it for a linear generalized equation. For a general polyhedral set CCC the paper's appendix does this by a reduction: locally around x0x_0x0​ the problem is equivalent to a homogeneous problem on a cone, the reduced form, and strong regularity is equivalent to unique solvability of that reduced form. This mission formalizes that appendix and the criterion it yields.

Setting

Work in Rn\mathbb R^nRn with the standard inner product, which identifies Rn\mathbb R^nRn with its dual. For C⊆RnC\subseteq\mathbb R^nC⊆Rn the normal cone at xxx is

∂ψC(x)={y:⟨y,c−x⟩≤0 for all c∈C} if x∈C,∂ψC(x)=∅ if x∉C.\partial\psi_C(x)=\{y:\langle y,c-x\rangle\le 0\ \text{for all } c\in C\}\ \text{if } x\in C,\qquad \partial\psi_C(x)=\emptyset\ \text{if } x\notin C.∂ψC​(x)={y:⟨y,c−x⟩≤0 for all c∈C} if x∈C,∂ψC​(x)=∅ if x∈/C.

A set is polyhedral convex if it is the intersection of finitely many closed half-spaces. Fix a nonempty polyhedral convex CCC, an n×nn\times nn×n real matrix AAA and a∈Rna\in\mathbb R^na∈Rn, and consider

0∈Ax+a+∂ψC(x).(A.1)0\in Ax+a+\partial\psi_C(x).\qquad\text{(A.1)}0∈Ax+a+∂ψC​(x).(A.1)

It is strongly regular at a solution x0x_0x0​ with constant λ\lambdaλ if there are neighbourhoods UUU of 000 and VVV of x0x_0x0​ such that for each y∈Uy\in Uy∈U the perturbed inclusion

y∈Ax+a+∂ψC(x)(A.2)y\in Ax+a+\partial\psi_C(x)\qquad\text{(A.2)}y∈Ax+a+∂ψC​(x)(A.2)

has exactly one solution x=s(y)x=s(y)x=s(y) in VVV, and ∥s(y1)−s(y2)∥≤λ∥y1−y2∥\|s(y_1)-s(y_2)\|\le\lambda\|y_1-y_2\|∥s(y1​)−s(y2​)∥≤λ∥y1​−y2​∥ on UUU.

The reduction uses the following objects, all built from the data:

  • y0:=Ax0+ay_0:=Ax_0+ay0​:=Ax0​+a;
  • the face F:=∂ψC∗(−y0)F:=\partial\psi_C^*(-y_0)F:=∂ψC∗​(−y0​), the set of maximisers of ⟨−y0,⋅⟩\langle -y_0,\cdot\rangle⟨−y0​,⋅⟩ over CCC (it contains x0x_0x0​);
  • the tangent cone T:=TF(x0)=∂ψF(x0)∘T:=T_F(x_0)=\partial\psi_F(x_0)^\circT:=TF​(x0​)=∂ψF​(x0​)∘, the polar of the normal cone of FFF at x0x_0x0​;
  • the subspace LLL parallel to FFF (the direction of its affine hull) and the orthogonal projector PLP_LPL​;
  • the lineality space MMM of TTT, the subspace L∩M⊥L\cap M^\perpL∩M⊥, and the cone K:=T∩M⊥K:=T\cap M^\perpK:=T∩M⊥.

The reduced form of (A.1) at x0x_0x0​ is the inclusion z∈PLAw+∂ψT(w)z\in P_LAw+\partial\psi_T(w)z∈PL​Aw+∂ψT​(w) for z∈Lz\in Lz∈L; in an orthonormal basis adapted to MMM, L∩M⊥L\cap M^\perpL∩M⊥ and L⊥L^\perpL⊥ it is z∈Bw+∂ψRr×K(w)z\in Bw+\partial\psi_{\mathbb R^r\times K}(w)z∈Bw+∂ψRr×K​(w) with an (r+s)×(r+s)(r+s)\times(r+s)(r+s)×(r+s) matrix BBB. It is vacuous when L={0}L=\{0\}L={0}.

Formalization targets

Goal: Theorem A.4 (p. 60)

If x0x_0x0​ solves (A.1), then (A.1) is strongly regular at x0x_0x0​ if and only if

L={0}or∀z∈L ∃! w∈Rn: z∈PLAw+∂ψT(w).L=\{0\}\quad\text{or}\quad\forall z\in L\ \exists!\,w\in\mathbb R^n:\ z\in P_LAw+\partial\psi_T(w).L={0}or∀z∈L ∃!w∈Rn: z∈PL​Aw+∂ψT​(w).

No Lipschitz constant is fixed: the left side is "strongly regular for some λ\lambdaλ".

Milestones

  1. Proposition A.1 (p. 58): for x0∈Cx_0\in Cx0​∈C, (C−x0)∩U=TC(x0)∩U(C-x_0)\cap U=T_C(x_0)\cap U(C−x0​)∩U=TC​(x0​)∩U for some neighbourhood UUU of 000.
  2. Proposition A.2 (p. 58): on F=∂ψC∗(−y0)F=\partial\psi_C^*(-y_0)F=∂ψC∗​(−y0​), ∂ψF(x)=∂ψC(x)+y0R+\partial\psi_F(x)=\partial\psi_C(x)+y_0\mathbb R_+∂ψF​(x)=∂ψC​(x)+y0​R+​, and ∂ψC∗(−y)⊂F\partial\psi_C^*(-y)\subset F∂ψC∗​(−y)⊂F for yyy near y0y_0y0​.
  3. Proposition A.3 (p. 58): for x0∈Fx_0\in Fx0​∈F, near the origin, 0∈(y0+k)+∂ψC(x0+h)0\in(y_0+k)+\partial\psi_C(x_0+h)0∈(y0​+k)+∂ψC​(x0​+h) iff 0∈PLk+∂ψT(h)0\in P_Lk+\partial\psi_T(h)0∈PL​k+∂ψT​(h).
  4. The correspondence (A.4) (p. 60): for xxx near x0x_0x0​ and small yyy, (A.2) holds iff 0∈PL(Ah−y)+∂ψT(h)0\in P_L(Ah-y)+\partial\psi_T(h)0∈PL​(Ah−y)+∂ψT​(h) with h=x−x0h=x-x_0h=x−x0​.

Companions

  • Corollary 3.2 (p. 53), in two items. Sufficiency: the reduced form is vacuous, or B11B_{11}B11​ is nonsingular and the Schur complement B/B11B/B_{11}B/B11​ is positive definite. Characterisation when K=R+sK=\mathbb R^s_+K=R+s​: strongly regular iff vacuous, or B11B_{11}B11​ nonsingular and B/B11B/B_{11}B/B11​ a P-matrix.
  • The 3 × 3 linear complementarity example of §4 (p. 53): strongly regular at x0=(1,0,0)x_0=(1,0,0)x0​=(1,0,0), and not strongly regular once the entry 555 of AAA becomes 444.

Significance

Theorem A.4 turns a local stability property, defined through neighbourhoods and an inverse map, into a finite-dimensional algebraic question about one homogeneous problem on a polyhedral cone. Combined with the Schur-complement criterion of Theorem 3.1, it gives checkable conditions (Corollary 3.2): nonsingularity of a block and positive definiteness, or the P-matrix property, of its Schur complement. Through the KKT reformulation of §4 this is the route by which strong second-order sufficiency and linear independence of binding constraint gradients imply strong regularity in nonlinear programming. The example of p. 53 shows the criterion deciding cases where AAA itself is neither positive definite nor a P-matrix.

The results are classical and proved in the paper; to our knowledge none of them has a machine-checked proof. The formalization adds a coordinate-free statement of the reduced form, which the paper writes only in an adapted basis; a Lean account of exposed faces and tangent cones of polyhedra, with their local conic structure (Propositions A.1–A.2), which the paper lists "without proof" and cites to Rockafellar; and checked versions of the corollary and the example.

Difficulty

The definition of strong regularity is local, while condition (ii) is global on LLL. The obvious argument, "linearise and read off the inverse", does not apply, because ∂ψC\partial\psi_C∂ψC​ is a set-valued map whose graph changes shape from point to point. The step that carries the weight is Proposition A.3: a perturbation of y0y_0y0​ may move the solution off the face FFF, and only polyhedrality, through the finitely many values of ∂ψC\partial\psi_C∂ψC​ on FFF and the local conic structure of A.1–A.2, rules this out uniformly in a neighbourhood. The direction from strong regularity to (ii) needs positive homogeneity of the reduced form to pass from uniqueness near 000 to uniqueness on all of LLL. The direction from (ii) to strong regularity needs the Lipschitz property of a single-valued inverse of a polyhedral multifunction (Robinson 1979, cited as [12, Proposition 2]), which is not elementary.

Formalization scope

  • The space is EuclideanSpace ℝ (Fin n), with inclusions written as memberships: (A.2) is y−(Ax+a)∈∂ψC(x)y-(Ax+a)\in\partial\psi_C(x)y−(Ax+a)∈∂ψC​(x). A matrix acts through Matrix.toEuclideanLin. The normal cone carries the clause x∈Cx\in Cx∈C, so ∂ψC(x)=∅\partial\psi_C(x)=\emptyset∂ψC​(x)=∅ off CCC; without it every inclusion would be satisfiable at points outside CCC and the statements would change meaning.
  • TC(x0)T_C(x_0)TC​(x0​) is the polar of the normal cone, as on p. 58, not the closure of the cone of feasible directions. FFF is the set of maximisers of ⟨−y0,⋅⟩\langle -y_0,\cdot\rangle⟨−y0​,⋅⟩ (the sign matters: the opposite face would make the theorem false). LLL is the direction of the affine span of FFF, and PLP_LPL​ is Mathlib's Submodule.starProjection.
  • The reduced form is stated basis-free on LLL; ∂ψT\partial\psi_T∂ψT​ is the normal cone of TTT in all of Rn\mathbb R^nRn. In Corollary 3.2, B11B_{11}B11​ and B/B11B/B_{11}B/B11​ are expressed through projectors onto MMM and L∩M⊥L\cap M^\perpL∩M⊥. Only the case K=R+sK=\mathbb R^s_+K=R+s​ is stated in a basis, an orthonormal basis of L∩M⊥L\cap M^\perpL∩M⊥ in which KKK is the orthant.
  • "Positive definite" does not require symmetry. "Strongly regular" without a constant is existential in λ\lambdaλ, with λ\lambdaλ real.
  • Corollary 3.2's second sentence refers on the page to "(3.8)", an evident slip for (3.9); it is formalized for (3.9).
  • The standing assumption "C nonempty polyhedral convex" is a hypothesis of every item.
  • A trivializing formalization is ruled out: strong regularity requires existence, uniqueness in VVV and the Lipschitz bound together, and condition (ii) requires existence and uniqueness for every z∈Lz\in Lz∈L.
  • Needed infrastructure: faces and tangent cones of polyhedra and their local structure (Minkowski–Weyl, finitely many faces), orthogonal decompositions, and Lipschitz continuity of single-valued polyhedral inverses. All of this is reusable beyond this mission. Proofs of the propositions, of the correspondence, and of the companions are welcome independently.

Selected references

  • S. M. Robinson, Strongly regular generalized equations, Mathematics of Operations Research 5(1), 43–62, 1980. https://doi.org/10.1287/moor.5.1.43
  • S. M. Robinson, Generalized equations and their solutions, Part I: Basic theory, Mathematical Programming Study 10, 128–141, 1979. https://doi.org/10.1007/BFb0120850
  • R. T. Rockafellar, Convex Analysis, Princeton University Press, 1970. https://doi.org/10.1515/9781400873173
  • A. L. Dontchev and R. T. Rockafellar, Implicit Functions and Solution Mappings, 2nd ed., Springer, 2014. https://doi.org/10.1007/978-1-4939-1037-3
  • R. W. Cottle, Manifestations of the Schur complement, Linear Algebra and its Applications 8, 189–211, 1974. https://doi.org/10.1016/0024-3795(74)90066-4
6 thms2 active usersReviewed
🏆Completed
CombinatoricsLinear OptimizationOptimization·Captain: mikedeng1

On the Job-Shop Scheduling Problem: The Integer Program (2)–(7) with 0–1 Variables y_jk Attains Exactly the Minimum Make-SpanResearch Paper

Motivation

The job-shop scheduling problem asks how to time a set of tasks on shared machines so that every product is finished as early as possible. Around 1959 several authors proposed to solve it with Gomory's then new integer programming (Gomory 1958). The obstacle is the noninterference condition: two tasks on the same machine must not overlap, so one of them must finish before the other starts. That is an "either-or" condition. It describes a nonconvex set, and classical linear programming cannot express it.

A. S. Manne's note On the Job-Shop Scheduling Problem (Operations Research 8 (1960) 219–223) writes the either-or condition as two linear inequalities in integers. It adds one 0–1 variable per pair of tasks that compete for a machine, and it uses a large constant derived from a bound TTT on the start days. This is the origin of the big-M disjunctive formulation, which remains the standard textbook integer program for job shops and, more broadly, the standard way to linearize a disjunction of two linear inequalities.

Timeline. Johnson (1954) introduced the make-span criterion for two- and three-stage production schedules. Bowman (1959) and Wagner (1959) proposed integer programs for machine scheduling. Manne (1960), stimulated by Bowman's paper, gave the formulation stated here. He counted its unknowns as 275 for 5 machines with 10 tasks each, against 600 for Wagner's formulation on the same example (p. 222).

Setting

There are n≥1n\ge1n≥1 tasks and MMM machines. Task jjj requires the single machine μ(j)\mu(j)μ(j) for aja_jaj​ consecutive days, where aja_jaj​ is an integer. An integer horizon TTT bounds the start days: the integer unknown xj∈{0,1,…,T}x_j\in\{0,1,\dots,T\}xj​∈{0,1,…,T} is the day on which task jjj begins. A pair (j,k)(j,k)(j,k) with j<kj<kj<k and μ(j)=μ(k)\mu(j)=\mu(k)μ(j)=μ(k) is a conflicting pair. For each such pair the tasks must not overlap:

xj−xk≥akor elsexk−xj≥aj.(1)x_j-x_k\ge a_k\quad\text{or else}\quad x_k-x_j\ge a_j. \tag{1}xj​−xk​≥ak​or elsexk​−xj​≥aj​.(1)

The instance may also impose precedence xj+aj≤xkx_j+a_j\le x_kxj​+aj​≤xk​ for given pairs (5a), exact delays xj+aj+Θjk=xkx_j+a_j+\Theta_{jk}=x_kxj​+aj​+Θjk​=xk​ for given pairs (5c), and delivery dates xj+aj≤djx_j+a_j\le d_jxj​+aj​≤dj​ for given tasks (6). A schedule is an x∈{0,…,T}nx\in\{0,\dots,T\}^nx∈{0,…,T}n satisfying (1), (5a), (5c) and (6). Its make-span is

ms⁡(x)=max⁡j (xj+aj),\operatorname{ms}(x)=\max_{j}\,(x_j+a_j),ms(x)=jmax​(xj​+aj​),

the calendar time needed for all jobs when the shop starts on day 000.

Manne's integer program has integer unknowns xjx_jxj​ with 0≤xj≤T0\le x_j\le T0≤xj​≤T, one integer yjky_{jk}yjk​ for each conflicting pair, and the minimand ttt, subject to (5a), (5c), (6),

0≤yjk≤1,(2)0\le y_{jk}\le 1,\tag{2}0≤yjk​≤1,(2) (T+ak) yjk+(xj−xk)≥ak,(3)(T+a_k)\,y_{jk}+(x_j-x_k)\ge a_k,\tag{3}(T+ak​)yjk​+(xj​−xk​)≥ak​,(3) (T+aj)(1−yjk)+(xk−xj)≥aj,(4)(T+a_j)(1-y_{jk})+(x_k-x_j)\ge a_j,\tag{4}(T+aj​)(1−yjk​)+(xk​−xj​)≥aj​,(4)

and xj+aj≤tx_j+a_j\le txj​+aj​≤t for every jjj (7). The value yjk=1y_{jk}=1yjk​=1 means that jjj precedes kkk; yjk=0y_{jk}=0yjk​=0 means that kkk precedes jjj.

Formalization targets

Goal: the integer program solves the make-span problem

For every instance and every integer t∗t^\astt∗,

t∗=min⁡{t: ∃ x,y integer satisfying 0≤xj≤T and (2)–(7)}  ⟺  t∗=min⁡x schedulems⁡(x).t^\ast=\min\{t:\ \exists\,x,y\ \text{integer satisfying } 0\le x_j\le T \text{ and } (2)\text{–}(7)\}\iff t^\ast=\min_{x\ \text{schedule}}\operatorname{ms}(x).t∗=min{t: ∃x,y integer satisfying 0≤xj​≤T and (2)–(7)}⟺t∗=x schedulemin​ms(x).

Both minima are required to exist. In particular the program has an optimum exactly when a schedule exists. The paper claims this when it says that "the problem now consists of the minimization of ttt" subject to (2)–(7) (p. 221).

Milestones

  1. Pair equivalence (p. 220). If ∣xj−xk∣≤T|x_j-x_k|\le T∣xj​−xk​∣≤T, some integer yjky_{jk}yjk​ satisfies (2)–(4) if and only if (1) holds.
  2. Equal start days are excluded (p. 220). If xj=xkx_j=x_kxj​=xk​ and aj,ak>0a_j,a_k>0aj​,ak​>0, no yjky_{jk}yjk​ satisfies (2)–(4).
  3. Feasibility correspondence (pp. 220–221). For fixed xxx and ttt, some yyy makes (x,y,t)(x,y,t)(x,y,t) feasible for (2)–(7) if and only if xxx is a schedule with xj+aj≤tx_j+a_j\le txj​+aj​≤t for all jjj.
  4. The yjky_{jk}yjk​ must be discrete (p. 222). With yjky_{jk}yjk​ real in [0,1][0,1][0,1] and 0<aj,ak≤T0<a_j,a_k\le T0<aj​,ak​≤T, conditions (3)–(4) admit xj=xkx_j=x_kxj​=xk​, where (1) fails.
  5. Counting unknowns (pp. 221–222). With MMM machines of ppp tasks each, n=Mpn=Mpn=Mp and there are M p(p−1)/2M\,p(p-1)/2Mp(p−1)/2 conflicting pairs; for M=5M=5M=5, p=10p=10p=10 this gives 50+225=27550+225=27550+225=275 unknowns.

Significance

The result. The goal certifies that a single integer program, with one binary variable per conflicting pair, computes the optimal make-span of a job shop with precedence, exact delays and delivery dates. The same pattern is used whenever a disjunction f≥0f\ge0f≥0 or g≥0g\ge0g≥0 of bounded linear forms has to be put into a mixed-integer program: a binary variable selects the active branch, and a constant at least as large as the range of the inactive form switches the other branch off. Milestone 1 is that pattern in its simplest form, and milestone 4 shows why the binary variable cannot be relaxed.

Formalizing it. The paper's argument is informal. It rests on a summary table of admissible values of yjky_{jk}yjk​ that holds only when the gap ∣xj−xk∣|x_j-x_k|∣xj​−xk​∣ is large enough. A machine-checked version fixes the exact hypotheses: integrality of yjky_{jk}yjk​, the bound ∣xj−xk∣≤T|x_j-x_k|\le T∣xj​−xk​∣≤T, and nonemptiness of the task set. To the best of the curators' knowledge, no machine-checked proof of the correctness of the big-M job-shop formulation exists; the definitions here can serve later scheduling missions that need a disjunctive integer program.

Difficulty

The mathematics is elementary, and the difficulty lies in stating it exactly. The obvious reading, "(3)–(4) are equivalent to (1)", is false without the bound ∣xj−xk∣≤T|x_j-x_k|\le T∣xj​−xk​∣≤T. For instance, with yjk=0y_{jk}=0yjk​=0 condition (4) reads xj−xk≤Tx_j-x_k\le Txj​−xk​≤T, which cuts off valid orders if start days may lie beyond the horizon. It is also false for real yjky_{jk}yjk​. Equally, "minimize ttt subject to (7)" equals the maximum of xj+ajx_j+a_jxj​+aj​ only after the optimum over ttt and over xxx are interchanged and the empty task set is excluded. A naive formalization that states the schedule side as "the least ttt with (7)" proves nothing about the make-span.

Formalization scope

Tasks are Fin n (the paper's task jjj is index j−1j-1j−1), machines Fin M. Start days, durations, horizon, delays, delivery dates, yjky_{jk}yjk​ and ttt are integers (ℤ), so that xj−xkx_j-x_kxj​−xk​ and 1−yjk1-y_{jk}1−yjk​ are not truncated. Durations are not assumed positive except in milestones 2 and 4, where positivity is necessary. One definitions file, ManneJobShop.Formulation.Model, holds the instance, the conflicting pairs, schedules, the make-span (Finset.sup', so n≥1n\ge1n≥1 is required via [NeZero n]) and the integer program.

Explicit readings of loose phrases:

  • "a (large) integer TTT that will constitute a redundant upper bound upon the unknowns xjx_jxj​" (p. 219): both the schedule problem and the integer program restrict start days to 0≤xj≤T0\le x_j\le T0≤xj​≤T. Redundancy is not assumed.
  • "The effect of conditions (3) and (4) may therefore be summarized as follows" (p. 220): stated as the equivalence of milestone 1 and the exclusion of milestone 2, not row by row (for 0<xj−xk<ak0<x_j-x_k<a_k0<xj​−xk​<ak​, condition (3) forces yjk=1y_{jk}=1yjk​=1, not {0,1}\{0,1\}{0,1}).
  • "the minimization of ttt" (p. 221): IsLeast of the feasible values of ttt, matched against IsLeast of the set of make-spans of schedules.
  • "necessarily of a discrete nature" (p. 222): existence of a real yjk∈[0,1]y_{jk}\in[0,1]yjk​∈[0,1] satisfying (3)–(4) at xj=xkx_j=x_kxj​=xk​ when 0<aj,ak≤T0<a_j,a_k\le T0<aj​,ak​≤T ("large" TTT read as T≥aj,akT\ge a_j,a_kT≥aj​,ak​).
  • "mmm possible conflicting pairs of machine assignments" (p. 222): pairs j<kj<kj<k on the same machine, one yjky_{jk}yjk​ each.
  • "If task jjj is the last task which the shop is to perform upon the item" (p. 221): a delivery date may be attached to any task, which contains the paper's case.

Trivializing formalizations are ruled out: the make-span is a maximum, not a restatement of (7); yjky_{jk}yjk​ is an integer; the horizon appears on both sides; the goal is stated for every instance with n≥1n\ge1n≥1, including infeasible ones. The (5b) example is (5a) for two pairs. Wagner's comparison, the remarks on Gomory's algorithm, Dantzig's secondary constraints and Monte Carlo methods, and the economic discussion of the make-span are not formalized. Proofs of every milestone and of the goal are welcome.

Selected references

  • A. S. Manne, On the Job-Shop Scheduling Problem, Operations Research 8(2) (1960) 219–223. https://doi.org/10.1287/opre.8.2.219
  • E. H. Bowman, The Schedule-Sequencing Problem, Operations Research 7(5) (1959) 621–624. https://doi.org/10.1287/opre.7.5.621
  • H. M. Wagner, An Integer Linear-Programming Model for Machine Scheduling, Naval Research Logistics Quarterly 6(2) (1959) 131–140. https://doi.org/10.1002/nav.3800060205
  • R. E. Gomory, Outline of an Algorithm for Integer Solutions to Linear Programs, Bulletin of the AMS 64(5) (1958) 275–278. https://doi.org/10.1090/S0002-9904-1958-10224-4
  • S. M. Johnson, Optimal Two- and Three-Stage Production Schedules with Setup Times Included, Naval Research Logistics Quarterly 1(1) (1954) 61–68. https://doi.org/10.1002/nav.3800010110
7 thms2 active usersReviewed
🏆Completed
Machine LearningProbabilityTheoretical Computer Science·Captain: mikedeng1

The Weighted Majority Algorithm 6: Under the Weak Independence Condition, the Randomized Master WMR Has E(m) ≤ E(ln(w_init/w_fin))/(1−β)Research Paper

Motivation

Prediction with expert advice asks a learner to predict a binary label in each of a sequence of trials, having seen the predictions of a pool of nnn prediction algorithms (the experts), and to make not many more mistakes than the best of them, with no probabilistic assumption on how the instances and labels are generated. Littlestone and Warmuth's Weighted Majority Algorithm (Littlestone, Warmuth 1994) maintains a weight for each pool member, predicts by a weighted vote, and shrinks the weights of members that err. Its mistake bounds are the origin of the multiplicative-weights method used throughout online learning, game theory and optimization (Arora, Hazan, Kale 2012).

A deterministic master with binary predictions can be forced to err in every trial in which the weight is split evenly, which costs it a factor of about two against the best expert. Section 6 of the paper introduces a randomized master, WMR, which predicts 111 with probability equal to the weighted average prediction of the pool. Theorem 6.1 bounds its expected number of mistakes under a precisely stated condition on how its randomization interacts with the choice of instances and labels.

Timeline:

  • 1989: Littlestone and Warmuth's technical report and FOCS paper introduce the Weighted Majority Algorithm and its randomized variant.
  • 1991: Maass independently analyses the case β=0\beta = 0β=0 with binary pool predictions and a lazy update ([Maa91], cited in the paper).
  • 1994: the journal version states the weak independence condition and proves Theorem 6.1 (p. 240).
  • 1997: Freund and Schapire's Hedge algorithm recasts the randomized master as a distribution over experts in a decision-theoretic setting (Freund, Schapire 1997).

Setting

A pool of nnn algorithms is run for ttt trials on a probability space (Ω,F,P)(\Omega, \mathcal F, P)(Ω,F,P). In trial jjj the pool member iii predicts xi(j)∈[0,1]x_i^{(j)} \in [0,1]xi(j)​∈[0,1], the label is ρ(j)∈{0,1}\rho^{(j)} \in \{0,1\}ρ(j)∈{0,1}, and the master predicts λ(j)∈{0,1}\lambda^{(j)} \in \{0,1\}λ(j)∈{0,1}. All of these are random variables; deterministic sequences are a special case. Write x(j)=(x1(j),…,xn(j))x^{(j)} = (x_1^{(j)}, \dots, x_n^{(j)})x(j)=(x1(j)​,…,xn(j)​).

Each member carries a weight. The initial weights wi(1)w_i^{(1)}wi(1)​ are positive, and the update step (5.1) multiplies the weight of member iii in trial jjj by a factor FFF that depends on β\betaβ, xi(j)x_i^{(j)}xi(j)​ and ρ(j)\rho^{(j)}ρ(j):

wi(j+1)=F wi(j),β∣xi(j)−ρ(j)∣≤F≤1−(1−β) ∣xi(j)−ρ(j)∣,w_i^{(j+1)} = F\,w_i^{(j)}, \qquad \beta^{|x_i^{(j)}-\rho^{(j)}|} \le F \le 1-(1-\beta)\,|x_i^{(j)}-\rho^{(j)}|,wi(j+1)​=Fwi(j)​,β∣xi(j)​−ρ(j)∣≤F≤1−(1−β)∣xi(j)​−ρ(j)∣,

where 0≤β<10 \le \beta < 10≤β<1 and 00=10^0 = 100=1. WMR updates in every trial. Let s(j)=∑iwi(j)s^{(j)} = \sum_i w_i^{(j)}s(j)=∑i​wi(j)​, so s(1)=winits^{(1)} = w_{\mathrm{init}}s(1)=winit​ and s(t+1)=wfins^{(t+1)} = w_{\mathrm{fin}}s(t+1)=wfin​, and let

γ(j)=∑i=1nwi(j)xi(j)s(j)\gamma^{(j)} = \frac{\sum_{i=1}^n w_i^{(j)} x_i^{(j)}}{s^{(j)}}γ(j)=s(j)∑i=1n​wi(j)​xi(j)​​

be the weighted average prediction. WMR predicts 111 with probability γ(j)\gamma^{(j)}γ(j). Its number of mistakes is m=∑j=1t∣λ(j)−ρ(j)∣m = \sum_{j=1}^t |\lambda^{(j)} - \rho^{(j)}|m=∑j=1t​∣λ(j)−ρ(j)∣.

The weak independence condition (p. 238) requires, for j=1,…,tj = 1, \dots, tj=1,…,t,

E(λ(j) ∣ (x(1),ρ(1)),…,(x(j),ρ(j)))=γ(j)almost surely.\mathbf E\big(\lambda^{(j)} \,\big|\, (x^{(1)},\rho^{(1)}), \dots, (x^{(j)},\rho^{(j)})\big) = \gamma^{(j)} \quad \text{almost surely}.E(λ(j)​(x(1),ρ(1)),…,(x(j),ρ(j)))=γ(j)almost surely.

The conditioning includes the current predictions of the pool and the current label. It allows instances and labels to depend on the master's past predictions, and it holds, for instance, when WMR draws one uniform number r∈[0,1]r \in [0,1]r∈[0,1] and predicts 111 whenever γ(j)≥r\gamma^{(j)} \ge rγ(j)≥r, provided the instances and labels are generated independently of rrr.

Formalization targets

Goal: Theorem 6.1

Under the weak independence condition, and with wfin>0w_{\mathrm{fin}} > 0wfin​>0 almost surely,

E(m)≤E(ln⁡(winit/wfin))1−β.\mathbf E(m) \le \frac{\mathbf E\big(\ln(w_{\mathrm{init}}/w_{\mathrm{fin}})\big)}{1-\beta}.E(m)≤1−βE(ln(winit​/wfin​))​.

The statement fixes neither the pool, nor the update factors within (5.1), nor the distribution of instances and labels.

Milestone: expected mistakes equal expected loss of the weighted average

The step of the proof on p. 240: under the weak independence condition, E(∣λ(j)−ρ(j)∣∣Fj)=∣γ(j)−ρ(j)∣\mathbf E(|\lambda^{(j)}-\rho^{(j)}| \mid \mathcal F_j) = |\gamma^{(j)}-\rho^{(j)}|E(∣λ(j)−ρ(j)∣∣Fj​)=∣γ(j)−ρ(j)∣ almost surely, and hence

E(m)=E(∑j=1t∣γ(j)−ρ(j)∣).\mathbf E(m) = \mathbf E\Big(\sum_{j=1}^t |\gamma^{(j)}-\rho^{(j)}|\Big).E(m)=E(j=1∑t​∣γ(j)−ρ(j)∣).

Significance

Theorem 6.1 gives the randomized master the same bound that Theorem 5.2 gives the deterministic master WMC, whose predictions are allowed to lie in [0,1][0,1][0,1]. With equal initial weights, ln⁡(winit/wfin)≤ln⁡n+miln⁡(1/β)\ln(w_{\mathrm{init}}/w_{\mathrm{fin}}) \le \ln n + m_i \ln(1/\beta)ln(winit​/wfin​)≤lnn+mi​ln(1/β) for every pool member iii with total loss mim_imi​, and the bound yields Corollary 6.1 (p. 241): E(m)≤(ln⁡n+E(mi)ln⁡(1/β))/(1−β)\mathbf E(m) \le (\ln n + \mathbf E(m_i)\ln(1/\beta))/(1-\beta)E(m)≤(lnn+E(mi​)ln(1/β))/(1−β). For β\betaβ close to 111 this is better by nearly a factor of two than the bound for the deterministic binary master WMG. The weak independence condition is also what makes the bound valid against labels that adapt to the master's past predictions, which is the setting of later regret analyses.

The result is proved in the paper; this mission produces a machine-checked version. The platform has proofs of the randomized weighted majority bound in the form of Hazan's Lemma 1.4 and of Mohri et al.'s Theorem 8.4, but both state an expectation over the algorithm's internal distribution with deterministic data, unit weights and one fixed update rule. Neither covers random instances and labels, the conditional-expectation condition, or the whole class of updates (5.1).

Difficulty

The pathwise part of the argument is the loss bound for the weighted average (Lemma 5.3, posed in the companion mission on WMC). The new difficulty is probabilistic. The predictions, labels and weights are random and may depend on each other across trials, so the mistake indicator ∣λ(j)−ρ(j)∣|\lambda^{(j)}-\rho^{(j)}|∣λ(j)−ρ(j)∣ cannot be replaced by ∣γ(j)−ρ(j)∣|\gamma^{(j)}-\rho^{(j)}|∣γ(j)−ρ(j)∣ pointwise. The replacement holds only after conditioning on the σ\sigmaσ-algebra Fj\mathcal F_jFj​, and requires that ρ(j)\rho^{(j)}ρ(j) is Fj\mathcal F_jFj​-measurable and binary, so that the indicator is affine in λ(j)\lambda^{(j)}λ(j). A reading that conditions on less (dropping the current label) or uses unconditional expectations does not support this step when the label depends on earlier randomness.

A second difficulty is that E(ln⁡(winit/wfin))\mathbf E(\ln(w_{\mathrm{init}}/w_{\mathrm{fin}}))E(ln(winit​/wfin​)) may be infinite: the weights can become arbitrarily small with positive probability.

Formalization scope

The pool is Fin n; trials are indexed from 000 to t−1t-1t−1, so totalWeight … 0 is winitw_{\mathrm{init}}winit​ and totalWeight … t is wfinw_{\mathrm{fin}}wfin​. The probability space is a measure P with IsProbabilityMeasure P. Predictions, labels and master predictions are real-valued measurable random variables; pool predictions lie in [0,1][0,1][0,1] and labels and master predictions in {0,1}\{0,1\}{0,1} on every sample path. Initial weights are deterministic and positive. The update factor of member iii in trial jjj is a measurable function Fj,i(x,r)F_{j,i}(x, r)Fj,i​(x,r) of the member's prediction and the label, satisfying (5.1) on every sample path; the weights are computed from it, so they are random variables determined by the predictions and labels. Fj\mathcal F_jFj​ is the supremum of the σ\sigmaσ-algebras generated by the pairs (x(k),ρ(k))(x^{(k)}, \rho^{(k)})(x(k),ρ(k)), k≤jk \le jk≤j, and the weak independence condition is stated with Mathlib's conditional expectation P[λ j | 𝓕 j].

Expectations in the goal are lower Lebesgue integrals in [0,∞][0,\infty][0,∞], so the right-hand side may be +∞+\infty+∞ and no integrability of the logarithm is assumed. The hypothesis wfin>0w_{\mathrm{fin}} > 0wfin​>0 almost surely excludes the case where the paper's bound is infinite and Lean's ln⁡0=0\ln 0 = 0ln0=0 would make the literal statement false. A formalization that replaces the conditional expectation by the unconditional one, takes the logarithm's Bochner integral (which is 000 when the logarithm is not integrable), or restricts to deterministic instances and labels does not state Theorem 6.1.

A complete development needs the pathwise loss bound of Lemma 5.3 for this weight model, the pull-out property of conditional expectations for bounded measurable factors, and the exchange of expectation and finite sums. The weight model and the filtration are reusable for Theorem 6.3 and for the lazy variant of the Appendix. Proofs of the milestone and of the goal are welcome, as are formalizations of Corollary 6.1.

Selected references

  • N. Littlestone, M. K. Warmuth, The Weighted Majority Algorithm, Information and Computation 108(2), 212–261, 1994. https://doi.org/10.1006/inco.1994.1009
  • Y. Freund, R. E. Schapire, A Decision-Theoretic Generalization of On-Line Learning and an Application to Boosting, Journal of Computer and System Sciences 55(1), 119–139, 1997. https://doi.org/10.1006/jcss.1997.1504
  • S. Arora, E. Hazan, S. Kale, The Multiplicative Weights Update Method: a Meta-Algorithm and Applications, Theory of Computing 8, 121–164, 2012. https://doi.org/10.4086/toc.2012.v008a006
  • N. Cesa-Bianchi, G. Lugosi, Prediction, Learning, and Games, Cambridge University Press, 2006. https://doi.org/10.1017/CBO9780511546921
3 thms2 active usersReviewed
🏆Completed
Machine LearningTheoretical Computer Science·Captain: mikedeng1

The Weighted Majority Algorithm 3: On a Countably Infinite Pool, WMI2 Makes at Most inf_i (log(Ŵ(1)/W(i)) + m_i log(1/β) + log 2)/log(1/u) MistakesResearch Paper

Motivation

In prediction with expert advice, a master algorithm predicts a binary label in each of a sequence of trials, after seeing the predictions of a pool of other algorithms (the "experts"), and is charged one mistake whenever its prediction differs from the label. No probabilistic assumption is made on the sequence: the goal is a bound on the master's mistakes, valid for every sequence, in terms of the mistakes of the best pool member. The Weighted Majority Algorithm of Littlestone and Warmuth (Inform. and Comput. 108, 1994) achieves this for a finite pool of nnn members with O(log⁡n+mi)O(\log n + m_i)O(logn+mi​) mistakes, where mim_imi​ is the number of mistakes of member iii.

Many natural pools are infinite: all programs in an enumeration, all hypotheses of a countable class, all values of a discretised parameter. Section 4 of the paper asks whether a master can compete with every member of a countably infinite pool A1,A2,…A_1, A_2, \dotsA1​,A2​,…, making at most c(log⁡i+mi)c(\log i + m_i)c(logi+mi​) mistakes for every iii, while keeping only finitely many weights at any time. Running the Weighted Majority Algorithm on infinitely many weights would give such a bound, but cannot be implemented.

Timeline. Barzdin and Freivalds (1972, 1974) studied prediction of a sequence by an enumerable family of functions and gave an essentially optimal bound for the case of a pool containing a member consistent with the whole sequence (β=0\beta = 0β=0 below). Littlestone and Warmuth's earlier versions of the paper (1989) introduced an algorithm WMI for infinite pools; the journal version (1994) replaced it by WMI2\mathrm{WMI}_2WMI2​, which matches the Barzdin–Freivalds bound when β=0\beta = 0β=0 and a consistent member exists, and extends it to pools in which every member may err.

Setting

Fix a parameter β\betaβ with 0≤β<10 \le \beta < 10≤β<1 and put u=(1+β)/2u = (1+\beta)/2u=(1+β)/2. Fix two real functions WWW and W^\hat WW^ on the positive integers with

W(i)>0,∑iW(i)<∞,W^(i)≥∑j≥iW(j),lim⁡i→∞W^(i)=0.W(i) > 0, \qquad \sum_{i} W(i) < \infty, \qquad \hat W(i) \ge \sum_{j \ge i} W(j), \qquad \lim_{i \to \infty} \hat W(i) = 0 .W(i)>0,i∑​W(i)<∞,W^(i)≥j≥i∑​W(j),i→∞lim​W^(i)=0.

W(i)W(i)W(i) is the initial weight of the pool member AiA_iAi​, and W^(i)\hat W(i)W^(i) bounds the weight of the tail Ai,Ai+1,…A_i, A_{i+1}, \dotsAi​,Ai+1​,….

A sequence of TTT trials gives, for each trial ttt, the prediction xt(i)∈{0,1}x_t(i) \in \{0,1\}xt​(i)∈{0,1} of every pool member and a label ρt∈{0,1}\rho_t \in \{0,1\}ρt​∈{0,1}. Member AiA_iAi​ makes at most mim_imi​ mistakes: xt(i)≠ρtx_t(i) \ne \rho_txt​(i)=ρt​ for at most mim_imi​ trials ttt.

The master WMI2\mathrm{WMI}_2WMI2​ keeps an active pool A1,…,AlA_1, \dots, A_lA1​,…,Al​ and a weight for each active member. With mmm the number of its own mistakes so far, let

θ(m)=um+1 W^(1)(1−β)(m+1)(m+2).\theta(m) = \frac{u^{m+1}\,\hat W(1)}{(1-\beta)(m+1)(m+2)} .θ(m)=(1−β)(m+1)(m+2)um+1W^(1)​.

Initially, and after each trial in which it errs, WMI2\mathrm{WMI}_2WMI2​ raises lll (starting from l=0l = 0l=0) to the least value with W^(l+1)≤θ(m)\hat W(l+1) \le \theta(m)W^(l+1)≤θ(m); a newly activated AiA_iAi​ gets weight W(i)W(i)W(i). In a trial it computes the active weight q0q_0q0​ predicting 000 and q1q_1q1​ predicting 111; it predicts 000 if q0>q1+θ(m)q_0 > q_1 + \theta(m)q0​>q1​+θ(m), predicts 111 if q1>q0+θ(m)q_1 > q_0 + \theta(m)q1​>q0​+θ(m), and may predict either otherwise. After a mistake, every active member that disagreed with the label has its weight multiplied by β\betaβ. The weights ωi\omega_iωi​ of the analysis are the current weight of an active member and W(i)W(i)W(i) for an inactive one.

Formalization targets

The goal is Theorem 4.1, part 3 (p. 227). Let mmm be the total number of mistakes of WMI2\mathrm{WMI}_2WMI2​ on the sequence.

Goal: the mistake bound of WMI2\mathrm{WMI}_2WMI2​

If 0<β<10 < \beta < 10<β<1, then

m≤inf⁡i≥1log⁡(W^(1)/W(i))+milog⁡(1/β)+log⁡2log⁡(1/u),m \le \inf_{i \ge 1} \frac{\log\bigl(\hat W(1)/W(i)\bigr) + m_i \log(1/\beta) + \log 2}{\log(1/u)} ,m≤i≥1inf​log(1/u)log(W^(1)/W(i))+mi​log(1/β)+log2​,

and if β=0\beta = 0β=0 and mi=0m_i = 0mi​=0 for some iii, then m≤1+log⁡2(W^(1)/W(i))m \le 1 + \log_2\bigl(\hat W(1)/W(i)\bigr)m≤1+log2​(W^(1)/W(i)).

Milestone: the size of the active pool (Theorem 4.1, part 1)

At the beginning of any trial, lll is the minimum lll with W^(l+1)≤θ(m)\hat W(l+1) \le \theta(m)W^(l+1)≤θ(m), where mmm counts the mistakes made in prior trials.

Milestone: the weight invariant (Theorem 4.1, part 2)

After any initial sequence of trials in which mmm mistakes have been made,

∑i=1∞ωi≤(2−1m+1)um W^(1).\sum_{i=1}^{\infty} \omega_i \le \Bigl(2 - \frac{1}{m+1}\Bigr) u^{m}\, \hat W(1) .i=1∑∞​ωi​≤(2−m+11​)umW^(1).

Significance

The result. The bound holds simultaneously for every pool member, so the master competes with the best member of an infinite pool, paying log⁡(W^(1)/W(i))\log(\hat W(1)/W(i))log(W^(1)/W(i)) for the position of that member in the enumeration. With W(i)=1/(i(i+1))W(i) = 1/(i(i+1))W(i)=1/(i(i+1)) and W^(i)=1/i\hat W(i) = 1/iW^(i)=1/i (the paper's Corollary 4.1) this is O(log⁡i+mi)O(\log i + m_i)O(logi+mi​) mistakes, with an active pool that grows exponentially in the number of mistakes but is finite at every time. Different choices of WWW trade the mistake bound against the growth of the active pool. The same analysis shows how the predictions can be computed from finite-precision approximations of the weights, which is the reason for the slack band in the prediction rule. Its β=0\beta = 0β=0 case recovers the Barzdin–Freivalds bound.

Formalizing it. The theorem is proved in the paper; no machine-checked version is known to exist, and there is no formalization of the Weighted Majority Algorithm on infinite pools on Prove2Me. The work is to formalize the paper's proof: the size statement for the active pool, the inductive invariant for the total weight, and the final logarithmic bound. The definition of a run of WMI2\mathrm{WMI}_2WMI2​, with free predictions in the slack band and lazily activated weights, is reusable for other lazy-activation algorithms on countable pools, and the paper's Corollaries 4.1–4.3 are direct instances once the goal is proved.

Difficulty

The ordinary Weighted Majority analysis tracks the total weight of the whole pool, which shrinks by the factor uuu after each mistake. For WMI2\mathrm{WMI}_2WMI2​ that argument does not apply as is: the master only sees the active weights, and the inactive tail, whose weight is unknown to the algorithm and charged at its initial value, may vote with the label. The obvious bound on the tail is too weak if applied with a fixed slack; it must shrink with the number of mistakes at the right rate so that the accumulated overhead stays below a constant factor. The slack band in the prediction rule interacts with this: when the master errs inside the band, the active majority may not have been wrong by much, and the shrinkage factor must be recovered from the band's width. The factor 2−1/(m+1)2 - 1/(m+1)2−1/(m+1) is where these effects are balanced.

Formalization scope

The pool is indexed by ℕ+ and trials by Fin T; false encodes the prediction 000, true the prediction 111. IsWMI2Run is a relation between the input sequence and the master's predictions, the weights wt(i)w_t(i)wt​(i) and the active-pool sizes ltl_tlt​ at every trial boundary t∈{0,…,T}t \in \{0, \dots, T\}t∈{0,…,T}; a prediction inside the slack band is unconstrained, so the theorems hold for every run. Only active weights are constrained; the analysis uses omega, which counts inactive members at W(i)W(i)W(i). The bound mim_imi​ is any upper bound on the mistakes of AiA_iAi​. The tail hypothesis is stated with a tsum together with Summable W, and the milestone on the total weight asserts summability of ω\omegaω in its conclusion, so it cannot hold through the value 000 that Lean assigns to a divergent series. The infimum in the goal is stated as a bound for every iii, which is equivalent. Logarithms in the ratio are natural logarithms (the base cancels); the β=0\beta = 0β=0 bound uses Real.logb 2. The paper requires WWW and W^\hat WW^ to be computable; this only makes the algorithm implementable, and the formal statements hold for arbitrary real functions with the stated analytic properties.

A statement for an algorithm whose runs do not exist would be vacuous; runs of WMI2\mathrm{WMI}_2WMI2​ exist for every sequence under the hypotheses (this has been checked locally in Lean), because W^→0\hat W \to 0W^→0 and θ(m)>0\theta(m) > 0θ(m)>0 keep the active pool finite.

Needed infrastructure: finite sums over the active pool, tsum manipulations for sequences that agree with WWW outside a finite set, and real logarithm inequalities. Contributions welcome: proofs of the two milestones and the goal, and the Corollaries 4.1–4.3 as follow-up statements.

Selected references

  • N. Littlestone, M. K. Warmuth, The Weighted Majority Algorithm, Information and Computation 108(2), 212–261, 1994. https://doi.org/10.1006/inco.1994.1009
  • J. M. Barzdin, R. V. Freivalds, On the prediction of general recursive functions, Soviet Mathematics Doklady 13, 1224–1228, 1972.
  • J. M. Barzdin, R. V. Freivalds, Prognozirovanie i predel'nyi sintez effektivno perechislimykh klassov funktsii [Prediction and limit synthesis of effectively enumerable classes of functions], in Theory of Algorithms and Programs (J. M. Barzdin, ed.), Vol. 1, 101–111, Latvian State University, 1974 (in Russian).
  • N. Littlestone, M. K. Warmuth, The Weighted Majority Algorithm, Proceedings of the 30th Annual Symposium on Foundations of Computer Science, 256–261, IEEE, 1989 (cited in the journal paper as [LW89a]).
4 thms2 active usersReviewed
PreviousPage 29 of 45Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me