Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Operations Research

2,210 missions · 1,092 completed

The discipline of applying mathematical analysis to complex decision problems in operations: allocating scarce resources, scheduling, routing, inventory, and the design of service and production systems. Drawing on mathematical programming, stochastic modeling, queueing, simulation, and game-theoretic reasoning, it seeks policies that perform provably well in systems shaped by constraints, congestion, and uncertainty.

Missions

Open1118Completed1092All2210
🏆Completed
CombinatoricsOptimization·Captain: mikedeng1

A Functional Equation and Its Application to Resource Allocation and Sequencing Problems 2: Under Precedence Constraints, All Deadlines Can Be Met iff They Are Met in Order of Modified DeadlinesResearch Paper

Motivation

A single machine must process nnn jobs, each with a processing time and a deadline, and some jobs must be finished before others may start. The first question of any planner is whether the deadlines can be met at all. Without precedence constraints the answer is classical: Jackson's rule (J. R. Jackson, 1955, reported by W. E. Smith, 1956) says that all jobs can be completed on time if and only if they are completed on time when sequenced by earliest deadline first. Precedence constraints break this rule, because the earliest-deadline order may put a job before one of its required predecessors.

E. L. Lawler and J. M. Moore (Management Science 16 (1969) 77–84) repair the rule by replacing each deadline by a modified deadline that accounts for the deadlines of the job's successors. Their §2 Theorem says that a single sequence, the one in increasing order of modified deadlines, decides feasibility. They use it as the first step of their dynamic programming method for sequencing with deadlines and precedence constraints: because the sequence does not depend on processing times, the jobs to be scheduled on time can always be taken in this one fixed order.

Setting

There are nnn jobs 1,…,n1,\dots,n1,…,n. Job jjj has a processing time aj≥0a_j \ge 0aj​≥0 and a deadline dj∈Rd_j \in \mathbb Rdj​∈R. A sequence σ\sigmaσ lists every job exactly once; the machine starts at time 000 and processes the jobs in the order of σ\sigmaσ, one after another, without idle time. The completion time Cj(σ)C_j(\sigma)Cj​(σ) of job jjj is the sum of the processing times of jjj and of all jobs before it in σ\sigmaσ. Job jjj is on time in σ\sigmaσ if Cj(σ)≤djC_j(\sigma) \le d_jCj​(σ)≤dj​.

Precedence constraints are a partial order ρ\rhoρ on the jobs (reflexive, antisymmetric, transitive). If iρji\rho jiρj and i≠ji \ne ji=j, job iii must precede job jjj; such a jjj is a successor of iii, and every job counts as one of its own successors. A sequence is consistent with ρ\rhoρ if no job appears before a job that must precede it. The jobs are numbered so that iρji\rho jiρj implies i≤ji \le ji≤j.

For a number ε\varepsilonε the modified deadline of job jjj is

dˉj=min⁡{ dk∣jρk }+jε,\bar d_j = \min\{\, d_k \mid j\rho k \,\} + j\varepsilon ,dˉj​=min{dk​∣jρk}+jε,

the earliest deadline among jjj and its successors, plus a tie-breaking term. The paper takes ε\varepsilonε to be "a small number"; here that means ε>0\varepsilon > 0ε>0 and nε<dl−dkn\varepsilon < d_l - d_knε<dl​−dk​ whenever dk<dld_k < d_ldk​<dl​.

Formalization targets

Goal: the §2 Theorem (p. 78)

Let σ∗\sigma^*σ∗ be the sequence in which dˉj\bar d_jdˉj​ increases. Then

(∃ σ consistent with ρ: Cj(σ)≤dj  ∀j)  ⟺  Cj(σ∗)≤dj  ∀j.\Big(\exists\,\sigma \text{ consistent with } \rho:\ C_j(\sigma) \le d_j\ \ \forall j\Big)\iff C_j(\sigma^*) \le d_j\ \ \forall j .(∃σ consistent with ρ: Cj​(σ)≤dj​  ∀j)⟺Cj​(σ∗)≤dj​  ∀j.

Milestones (from §2 and the proof of the Theorem, p. 78)

  1. For distinct jobs, iρj⇒dˉi<dˉji\rho j \Rightarrow \bar d_i < \bar d_jiρj⇒dˉi​<dˉj​.
  2. The sequence σ∗\sigma^*σ∗ is consistent with ρ\rhoρ (the "if" part of the Theorem).
  3. If dˉj<dˉi\bar d_j < \bar d_idˉj​<dˉi​, then jjj or some successor kkk of jjj has dk≤did_k \le d_idk​≤di​.
  4. In an on-time sequence consistent with ρ\rhoρ, two adjacent jobs i,ji, ji,j (in this order) with dˉi>dˉj\bar d_i > \bar d_jdˉi​>dˉj​ can be interchanged, and the result is again on time and consistent with ρ\rhoρ.

Significance

The Theorem reduces a question over all n!n!n! sequences consistent with ρ\rhoρ to the evaluation of one sequence, and the sequence depends only on the deadlines and on ρ\rhoρ, not on the processing times. This independence is what the paper's later sections rely on: it lets a subset-selection dynamic program (Eq. (1) of the paper) process jobs in a fixed order. Without precedence constraints (ρ\rhoρ the identity) the Theorem is Jackson's rule. The operational form, "always take next, from among the available jobs, a job which has a successor with the earliest possible deadline", is a list-scheduling rule of the same kind as the backward rule of Lawler (1973) for 1∣prec∣fmax⁡1\mid prec\mid f_{\max}1∣prec∣fmax​.

The result has been proved on paper since 1969. As far as is known it has no machine-checked proof. This mission produces a formal proof of the Theorem and of the exchange step behind it, stated on the same sequence and completion-time model as the platform's existing single-machine scheduling missions.

Difficulty

The obvious argument is the exchange argument for Jackson's rule: swap an adjacent pair that is out of order and check that nothing becomes late. Two things fail without care. First, the swap must not violate precedence; this is why the deadline of a job is replaced by the minimum over its successors. Second, after the swap, job iii completes when job jjj used to complete, but did_idi​ need not be at least djd_jdj​: one must find a successor of jjj that is later in the sequence, on time, and due no later than iii. That step uses the smallness of ε\varepsilonε: with a large ε\varepsilonε the tie-breaking term outweighs a difference of deadlines, and the Theorem fails (three jobs without precedence, a=(2,4,3)a = (2,4,3)a=(2,4,3), d=(7,9,8)d = (7,9,8)d=(7,9,8), ε=3\varepsilon = 3ε=3). Finally, the exchange step must be turned into a terminating transformation of an arbitrary feasible sequence into σ∗\sigma^*σ∗, a bubble-sort argument over lists.

Formalization scope

  • Jobs are Fin n, 0-based: the Lean job j is the paper's job j+1j+1j+1, and the tie-break is ((j:N)+1)ε((j:\mathbb N)+1)\varepsilon((j:N)+1)ε. Processing times and deadlines are real.
  • Sequences and completion times are the published platform definitions MooreLateJobs.Shared.IsSchedule and MooreLateJobs.Shared.completionTime (a duplicate-free list of all jobs; start at time 000, no idle time). Idle time never helps meet a deadline, so this loses nothing. Consistency with ρ\rhoρ is the published LawlerPrec.MinMax.IsFeasible.
  • The modified deadline minimizes over insert j {k | ρ j k}, which is nonempty; for the reflexive ρ\rhoρ of the paper this is {k∣jρk}\{k \mid j\rho k\}{k∣jρk} ("considering a job to be one of its own successors").
  • Explicit readings of the paper's phrases:
    • "ε\varepsilonε is a small number": ε>0\varepsilon > 0ε>0 and nε<dl−dkn\varepsilon < d_l - d_knε<dl​−dk​ whenever dk<dld_k < d_ldk​<dl​. A fixed ε\varepsilonε is quantified universally, not hidden under an existential.
    • "the sequence obtained by ordering jobs according to increasing values of dˉj\bar d_jdˉj​": any duplicate-free list of all jobs along which dˉj\bar d_jdˉj​ strictly increases. Under the hypotheses the dˉj\bar d_jdˉj​ are distinct, so exactly one such list exists.
    • "iρj implies dˉi<dˉj\bar d_i < \bar d_jdˉi​<dˉj​": stated for i≠ji \ne ji=j, since ρ\rhoρ is reflexive.
    • The pair condition "a consecutive pair with dˉi>dˉj\bar d_i > \bar d_jdˉi​>dˉj​" of milestone 3 is dropped, since the claim does not use it.
  • Added hypothesis: aj≥0a_j \ge 0aj​≥0. The paper uses it tacitly ("jjj will remain on time since it will be earlier in the sequence") and the Theorem is false without it.
  • The milestones assume only what they use (for instance, milestone 1 needs transitivity, the numbering and ε>0\varepsilon > 0ε>0). The goal assumes the full partial order of the paper.
  • Trivializing formalizations ruled out: ε=0\varepsilon = 0ε=0 or an unconstrained ε\varepsilonε; a minimum over a possibly empty set, which Lean would assign a junk value; completion times not tied to the order of the list; and dropping "consistent with the precedence constraints" from the left-hand side, which turns the Theorem into a false variant of Jackson's rule.
  • Not in scope: the "order of computational steps" remarks, §3 and the later sections (other missions of this series).

Related platform items: Jackson's rule for unrestricted jobs is already posed as MooreLateJobs.NumLate.jackson (Moore 1968) and is not re-posed here; Lawler's 1∣prec∣fmax⁡1\mid prec\mid f_{\max}1∣prec∣fmax​ theorem is posed as LawlerPrec.MinMax.sequencing_theorem. Contributions welcome: general list-exchange lemmas (adjacent swaps, bubble-sort termination toward a sorted list) are reusable well beyond this mission.

Selected references

  • E. L. Lawler, J. M. Moore, A Functional Equation and Its Application to Resource Allocation and Sequencing Problems, Management Science 16(1) (1969) 77–84. https://doi.org/10.1287/mnsc.16.1.77
  • J. R. Jackson, Scheduling a Production Line to Minimize Maximum Tardiness, Research Report 43, Management Science Research Project, UCLA, 1955.
  • W. E. Smith, Various Optimizers for Single-Stage Production, Naval Research Logistics Quarterly 3 (1956) 59–66. https://doi.org/10.1002/nav.3800030106
  • E. L. Lawler, Optimal Sequencing of a Single Machine Subject to Precedence Constraints, Management Science 19(5) (1973) 544–546. https://doi.org/10.1287/mnsc.19.5.544
8 thms3 active usersReviewed
🏆Completed
Markov ChainProbabilityStochastic Systems·Captain: mikedeng1

Stochastic Processes Occurring in the Theory of Queues and their Analysis by the Method of the Imbedded Markov Chain: In GI/M/s, a Positive Wait Is Exponential and a Positive Queue GeometricResearch Paper

Motivation

A many-server queue in which customers arrive at the epochs of a renewal process and are served for exponential times is the basic model of a telephone exchange, a call centre, or a bank of identical machines. Its continuous-time queue-length process is not Markovian unless the arrivals are Poisson, so Erlang's birth–death formulas for M/M/s do not apply. In 1953 D. G. Kendall showed how to analyse such systems by the method of the imbedded Markov chain: observe the system only at the arrival epochs, where the number of customers present does form a Markov chain, and read the equilibrium behaviour off that chain (Kendall 1953).

Timeline:

  • Erlang (1908–1929) treated M/M/s, where the queue length is itself Markovian.
  • Kendall (1951) treated M/G/1 by a chain imbedded at departure epochs.
  • W. L. Smith (Kendall's ref. [19]) observed that for a single server, under restrictions on the input law, exponential service gives an exponential waiting time apart from an atom at zero.
  • Kendall (1953), this paper, treated GI/M/s for every input law and every number of servers sss, and showed that Smith's restrictions are unnecessary.
  • Foster (1953) gave the criterion for ergodicity of a denumerable chain through a summable invariant vector, which is the step Kendall's argument relies on.

Setting

Customers arrive with independent inter-arrival times of law AAA on [0,∞)[0,\infty)[0,∞) and mean aaa, 0<a<∞0<a<\infty0<a<∞. There are s≥1s\ge 1s≥1 servers and a single queue served first come, first served. Service times are independent of one another and of the input, negative-exponential with mean bbb, 0<b<∞0<b<\infty0<b<∞. The relative traffic intensity is ρ=b/(sa)\rho=b/(sa)ρ=b/(sa).

The state of the imbedded chain at an arrival epoch is the number i∈{0,1,2,… }i\in\{0,1,2,\dots\}i∈{0,1,2,…} of persons found ahead (waiting or in service) by the arriving customer. Its transition matrix P=[pij]P=[p_{ij}]P=[pij​] of eq. (8) is given in three blocks, written with the death-process probabilities [n∣m]=∫0∞(mn)(1−e−u/b)ne−(m−n)u/b dA(u)[n\mid m]=\int_0^\infty\binom{m}{n}(1-e^{-u/b})^n e^{-(m-n)u/b}\,dA(u)[n∣m]=∫0∞​(nm​)(1−e−u/b)ne−(m−n)u/bdA(u) of (9)–(10), the probabilities {n∣s;m}\{n\mid s;m\}{n∣s;m} of (11)–(12), and the Poisson probabilities (n∣s)=∫0∞e−su/b(su/b)n/n! dA(u)(n\mid s)=\int_0^\infty e^{-su/b}(su/b)^n/n!\,dA(u)(n∣s)=∫0∞​e−su/b(su/b)n/n!dA(u) of (13)–(14):

pij={(i+1−j∣s)j≥s, j≤i+1,[ i+1−j∣i+1 ]i<s, j<s, j≤i+1,{s−j∣s; i−s+1}i≥s, j<s,0j>i+1.p_{ij}=\begin{cases}(i+1-j\mid s) & j\ge s,\ j\le i+1,\\ [\,i+1-j\mid i+1\,] & i<s,\ j<s,\ j\le i+1,\\ \{s-j\mid s;\,i-s+1\} & i\ge s,\ j<s,\\ 0 & j>i+1.\end{cases}pij​=⎩⎨⎧​(i+1−j∣s)[i+1−j∣i+1]{s−j∣s;i−s+1}0​j≥s, j≤i+1,i<s, j<s, j≤i+1,i≥s, j<s,j>i+1.​

The key function is

F(λ)=∫0∞e−(1−λ)su/b dA(u).F(\lambda)=\int_0^\infty e^{-(1-\lambda)su/b}\,dA(u).F(λ)=∫0∞​e−(1−λ)su/bdA(u).

The queue size met by an arrival is Q=max⁡(i−s,0)Q=\max(i-s,0)Q=max(i−s,0). The waiting time www is, given iii, the sum of k=max⁡(i−s+1,0)k=\max(i-s+1,0)k=max(i−s+1,0) independent exponential variables of mean b/sb/sb/s.

Formalization targets

Goal: Theorem IV (p. 350)

When ρ<1\rho<1ρ<1 the chain has a limiting distribution π\piπ, and with λ\lambdaλ the root of F(λ)=λF(\lambda)=\lambdaF(λ)=λ in (0,1)(0,1)(0,1) and c=b/(s(1−λ))c=b/(s(1-\lambda))c=b/(s(1−λ)),

Pr⁡(Q=n∣Q>0)=(1−λ)λn−1 (n≥1),Pr⁡(w>t∣w>0)=e−t/c (t≥0),\Pr(Q=n\mid Q>0)=(1-\lambda)\lambda^{n-1}\ (n\ge1),\qquad \Pr(w>t\mid w>0)=e^{-t/c}\ (t\ge0),Pr(Q=n∣Q>0)=(1−λ)λn−1 (n≥1),Pr(w>t∣w>0)=e−t/c (t≥0),

with both conditioning events of positive probability. The goal fixes no constant beyond those the theorem names: λ\lambdaλ and ccc are determined by AAA, bbb and sss.

Milestones

  • The matrix is stochastic (p. 349), and the chain is irreducible and aperiodic (p. 347).
  • The coefficients (n∣s)(n\mid s)(n∣s) are positive, sum to one and have mean 1/ρ1/\rho1/ρ; F(λ)=∑n(n∣s)λnF(\lambda)=\sum_n (n\mid s)\lambda^nF(λ)=∑n​(n∣s)λn; for ρ<1\rho<1ρ<1 the equation F(λ)=λF(\lambda)=\lambdaF(λ)=λ has a unique root in (0,1)(0,1)(0,1) (p. 348–349).
  • For the trial vector x=[μ0,…,μs−2,1,λ,λ2,… ]x=[\mu_0,\dots,\mu_{s-2},1,\lambda,\lambda^2,\dots]x=[μ0​,…,μs−2​,1,λ,λ2,…] (15): the invariance equations for j≥sj\ge sj≥s are equivalent to F(λ)=λF(\lambda)=\lambdaF(λ)=λ; those for 1≤j≤s−11\le j\le s-11≤j≤s−1 determine the μ\muμ's; the one for j=0j=0j=0 follows from the row sums (pp. 348–349).
  • A nonnull absolutely summable invariant vector makes the chain ergodic, and normalized it is the limiting distribution (p. 348).
  • Theorem I: for ρ<1\rho<1ρ<1 the chain is irreducible and ergodic, and πj=Cλj−(s−1)\pi_j=C\lambda^{j-(s-1)}πj​=Cλj−(s−1) for j≥s−1j\ge s-1j≥s−1.
  • Theorem II: Pr⁡(Q=0)=α=∑μ+1+λ∑μ+1/(1−λ)\Pr(Q=0)=\alpha=\dfrac{\sum\mu+1+\lambda}{\sum\mu+1/(1-\lambda)}Pr(Q=0)=α=∑μ+1/(1−λ)∑μ+1+λ​ and Pr⁡(w=0)=β=∑μ+1∑μ+1/(1−λ)\Pr(w=0)=\beta=\dfrac{\sum\mu+1}{\sum\mu+1/(1-\lambda)}Pr(w=0)=β=∑μ+1/(1−λ)∑μ+1​.
  • Theorem III: E(Q)=(1−α)/(1−λ)E(Q)=(1-\alpha)/(1-\lambda)E(Q)=(1−α)/(1−λ) and E(w)/b=(1−β)/(s(1−λ))E(w)/b=(1-\beta)/(s(1-\lambda))E(w)/b=(1−β)/(s(1−λ)).
  • Eq. (27): for M/M/s the root is λ=ρ\lambda=\rhoλ=ρ.

Significance

Theorem IV says that, whatever the input law and the number of servers, the part of the equilibrium waiting-time law away from zero is exponential and the part of the queue-size law away from zero is geometric, both governed by the single number λ\lambdaλ. All equilibrium quantities of GI/M/s (Theorems II–III and the delay distribution) then reduce to computing λ\lambdaλ from a one-dimensional equation and the finitely many μ\muμ's from a triangular linear system. This is the standard textbook treatment of G/M/c queues and the template for many later matrix-geometric results.

The results are proved in the paper, partly by appeal to Feller's theory of denumerable chains and to "tedious but elementary" verifications. None of them is machine-checked. The mission formalizes the paper's chain of argument: the explicit transition matrix, its stochasticity, the reduction of the invariance equations, the passage from a summable invariant vector to the limiting distribution, and the computation of the laws of QQQ and www from it. The single-server special cases are posed separately on the platform (QueueingFundamentals.GM1.arrival_point_geometric, GM1.waiting_time_cdf, GM1.arrival_point_means, GM1.mean_waiting_times, FosterQueues.GIM1.gim1_classification); they do not cover s≥2s\ge2s≥2.

Difficulty

The obvious route is to guess the geometric tail and check it against the balance equations. For j≥sj\ge sj≥s this works, but the rows i≥si\ge si≥s of the block B\mathbf BB involve the convolution integral (11), and the equations for j<sj<sj<s couple the geometric tail to the boundary terms μ0,…,μs−2\mu_0,\dots,\mu_{s-2}μ0​,…,μs−2​. Showing these are solvable, and that the row sums of the three-block matrix equal one, requires handling (11) explicitly. The second obstacle is the limit theorem itself: an invariant vector does not, by itself, give pijn→πjp^n_{ij}\to\pi_jpijn​→πj​. That step needs Feller's dichotomy for irreducible aperiodic denumerable chains, which Mathlib does not provide. Finally, the conditional waiting-time law requires summing an Erlang mixture with geometric weights in closed form.

Formalization scope

The queue process itself is not formalized. The chain is defined by its transition matrix (8)–(14), and www by the Erlang mixture of p. 349, as the paper derives both by a modelling argument. A chain is any TransitionMatrix P of the published Markov-chain vocabulary with P.p = gimsMatrix s A b; states are 000-based. "Ergodic" is Feller's: Aperiodic ∧ PositiveRecurrent. The limiting distribution is asserted as Tendsto (P.stepProb n i j) atTop (𝓝 (π j)) for all i,ji,ji,j, not as a stationary vector. The input law satisfies the published IsInterarrivalLaw A a⁻¹ (a probability measure carried by [0,∞)[0,\infty)[0,∞), integrable, mean aaa), and (n∣s)(n\mid s)(n∣s) is the published serviceProb A (s/b) n. Conditional laws are stated multiplied out, together with positivity of the conditioning probabilities. Every series identity is stated with HasSum.

Trivializing formalizations are ruled out: λ\lambdaλ is tied to F(λ)=λF(\lambda)=\lambdaF(λ)=λ on (0,1)(0,1)(0,1) rather than free; π\piπ is the limiting distribution of PPP, asserted to exist, not a probability vector handed to the statement; the conditioning events are asserted to have positive probability; the matrix is the GI/M/s matrix, not the GI/M/1 one; and the μ\muμ's of Theorems II–III are characterized by the invariance equations, never defined from π\piπ.

A complete development needs: Feller's limit theorem for irreducible aperiodic positive recurrent chains (reusable well beyond this mission), Foster's sufficiency criterion (referenced, open), Fubini for the stochastic-matrix identities, parametric interval integrals for the block B\mathbf BB, and Erlang distribution functions. Contributions to the general Markov-chain milestones are as welcome as those specific to GI/M/s.

Selected references

  • D. G. Kendall, Stochastic processes occurring in the theory of queues and their analysis by the method of the imbedded Markov chain, Ann. Math. Statist. 24(3), 338–354, 1953. https://doi.org/10.1214/aoms/1177728975
  • F. G. Foster, On the stochastic matrices associated with certain queuing processes, Ann. Math. Statist. 24(3), 355–360, 1953. https://doi.org/10.1214/aoms/1177728976
  • W. Feller, An Introduction to Probability Theory and Its Applications, Vol. 1, Wiley, 1950, ch. 15.
  • W. L. Smith, On the distribution of queueing times, Proc. Cambridge Philos. Soc. 49, 449–461, 1953 (cited by Kendall as "to be published", ref. [19]).
  • D. Gross, J. F. Shortle, J. M. Thompson, C. M. Harris, Fundamentals of Queueing Theory, 4th ed., Wiley, 2008, §5.3.
22 thms3 active usersReviewed
🏆Completed
Markov ChainProbabilityStochastic Systems·Captain: mikedeng1

Contact Interactions on a Lattice I: A Contact Process with (2d − 1)λₖ < kμ Dies Out from Every Finite Initial SetResearch Paper

Motivation

The contact process is the basic model of an infection spreading on a lattice: each infected site recovers at a constant rate, and each healthy site becomes infected at a rate that depends on how many of its neighbours are infected. It was introduced by T. E. Harris in Contact Interactions on a Lattice (Ann. Probab. 2, 1974), and it became one of the central examples of interacting particle systems, alongside the voter model and the stochastic Ising model (Liggett, Interacting Particle Systems, 1985, Ch. VI). Its main question is whether a finite infection dies out with probability one or survives forever with positive probability, and how that answer depends on the rates.

Harris's paper gives the first answers. It shows that, under natural conditions on the rates, the probability of survival is monotone, subadditive and submodular as a function of the initial set, and it uses these properties to prove a condition for certain extinction: Theorem 7.1. For the linear contact process (recovery rate 111, infection rate λ\lambdaλ per infected neighbour) the condition is (2d−1)λ<1(2d-1)\lambda<1(2d−1)λ<1. Holley obtained Theorem 7.1 by different methods at about the same time (footnote 4, p. 981); Holley and Liggett (Ann. Probab. 3, 1975) later developed the duality theory of such processes.

Setting

Let ZdZ_dZd​ be the ddd-dimensional integer lattice, d≥1d\ge1d≥1. Sites x,yx,yx,y are neighbours, x∼yx\sim yx∼y, if ∑i∣xi−yi∣=1\sum_i|x^i-y^i|=1∑i​∣xi−yi∣=1; NxN_xNx​ is the set of the 2d2d2d neighbours of xxx. A configuration is a finite set ξ⊂Zd\xi\subset Z_dξ⊂Zd​ of infected sites; Ξ0\Xi_0Ξ0​ is the set of all of them, ξ(Nx)=∣ξ∩Nx∣\xi(N_x)=|\xi\cap N_x|ξ(Nx​)=∣ξ∩Nx​∣, and x∼ξx\sim\xix∼ξ means x∉ξx\notin\xix∈/ξ and xxx has a neighbour in ξ\xiξ.

The parameters are a recovery rate μ≥0\mu\ge0μ≥0 and infection rates λ0=0,λ1,…,λ2d≥0\lambda_0=0,\lambda_1,\dots,\lambda_{2d}\ge0λ0​=0,λ1​,…,λ2d​≥0. The contact process {ξt}\{\xi_t\}{ξt​} started from a finite set is the continuous-time Markov chain on Ξ0\Xi_0Ξ0​ that leaves ξ\xiξ at rate

qξ=μ∣ξ∣+∑x∼ξλξ(Nx)(4.4)q_\xi=\mu|\xi|+\sum_{x\sim\xi}\lambda_{\xi(N_x)}\qquad(4.4)qξ​=μ∣ξ∣+x∼ξ∑​λξ(Nx​)​(4.4)

and jumps to ξ∖x\xi\setminus xξ∖x (x∈ξx\in\xix∈ξ) at rate μ\muμ and to ξ∪x\xi\cup xξ∪x (x∼ξx\sim\xix∼ξ) at rate λξ(Nx)\lambda_{\xi(N_x)}λξ(Nx​)​ (4.5). The empty set is absorbing. Write Pt(ξ,η)P_t(\xi,\eta)Pt​(ξ,η) for its transition function, r(ξ,η)=qξη/qξr(\xi,\eta)=q_{\xi\eta}/q_\xir(ξ,η)=qξη​/qξ​ for the transition matrix of its imbedded jump chain, and

pt(ξ)=Pξ{ξt≠∅},p∞(ξ)=lim⁡t→∞pt(ξ),mt(ξ)=Eξ∣ξt∣.p_t(\xi)=P_\xi\{\xi_t\neq\varnothing\},\qquad p_\infty(\xi)=\lim_{t\to\infty}p_t(\xi),\qquad m_t(\xi)=\mathscr E_\xi|\xi_t| .pt​(ξ)=Pξ​{ξt​=∅},p∞​(ξ)=t→∞lim​pt​(ξ),mt​(ξ)=Eξ​∣ξt​∣.

The process is increasing, subadditive or submodular if, for all ξ,η\xi,\etaξ,η and t≥0t\ge0t≥0, respectively pt(ξ)≤pt(ξ∪η)p_t(\xi)\le p_t(\xi\cup\eta)pt​(ξ)≤pt​(ξ∪η), pt(ξ∪η)≤pt(ξ)+pt(η)p_t(\xi\cup\eta)\le p_t(\xi)+p_t(\eta)pt​(ξ∪η)≤pt​(ξ)+pt​(η), or pt(ξ∪η)+pt(ξ∩η)≤pt(ξ)+pt(η)p_t(\xi\cup\eta)+p_t(\xi\cap\eta)\le p_t(\xi)+p_t(\eta)pt​(ξ∪η)+pt​(ξ∩η)≤pt​(ξ)+pt​(η) ((5.2)–(5.4)).

Formalization targets

Goal: Theorem 7.1 (p. 981)

If

(2d−1)λk<kμ,k=1,…,2d,(2d-1)\lambda_k<k\mu,\qquad k=1,\dots,2d,(2d−1)λk​<kμ,k=1,…,2d,

then

p∞(ξ)=0for every finite ξ⊂Zd.p_\infty(\xi)=0\qquad\text{for every finite }\xi\subset Z_d .p∞​(ξ)=0for every finite ξ⊂Zd​.

Milestones, in the order of the paper

  1. Theorem 4.3 (p. 975): from a finite set the process has finitely many jumps on every [0,t][0,t][0,t]; equivalently ∑ηPt(ξ,η)=1\sum_\eta P_t(\xi,\eta)=1∑η​Pt​(ξ,η)=1.
  2. (5.1) (p. 976): pt(ξ)p_t(\xi)pt​(ξ) is non-increasing in ttt, so p∞(ξ)p_\infty(\xi)p∞​(ξ) is a limit.
  3. Theorem 5.6(a) (p. 977): if λk↑\lambda_k\uparrowλk​↑, the process is increasing.
  4. Theorem 5.6(b) (p. 977): if moreover λk/k↓\lambda_k/k\downarrowλk​/k↓, it is subadditive.
  5. Lemma 5.8 (p. 978): if λk≤min⁡j≥kλj′\lambda_k\le\min_{j\ge k}\lambda'_jλk​≤minj≥k​λj′​, then pt≤pt′p_t\le p'_tpt​≤pt′​ and mt≤mt′m_t\le m'_tmt​≤mt′​.
  6. Theorem 6.2 (p. 979): if {λi}\{\lambda_i\}{λi​} is concave and non-decreasing with λ0=0\lambda_0=0λ0​=0, the process is submodular.
  7. Change of time scale (p. 981): multiplying all rates by c>0c>0c>0 replaces PtP_tPt​ by PctP_{ct}Pct​ and leaves p∞p_\inftyp∞​ unchanged.
  8. First-step display (p. 981): for a subadditive process, a singleton {x}\{x\}{x}, and n≥1n\ge1n≥1, p∞({x})=∑ηr(n)({x},η)p∞(η)≤p∞({x}) Ex∣ξ(n)∣p_\infty(\{x\})=\sum_\eta r^{(n)}(\{x\},\eta)p_\infty(\eta)\le p_\infty(\{x\})\,\mathscr E_x|\xi_{(n)}|p∞​({x})=∑η​r(n)({x},η)p∞​(η)≤p∞​({x})Ex​∣ξ(n)​∣.
  9. (7.2) (p. 981): for μ=1\mu=1μ=1, λk=kλ\lambda_k=k\lambdaλk​=kλ: π1=2dλ1+2dλπ2\pi_1=\frac{2d\lambda}{1+2d\lambda}\pi_2π1​=1+2dλ2dλ​π2​, where π1,π2\pi_1,\pi_2π1​,π2​ are p∞p_\inftyp∞​ of a site and of a pair of neighbours.
  10. (7.3)–(7.4) (p. 981): π2−π1=(1+(2d−1)λ)∑′r(ξ,ξ∪x)(p∞(ξ∪x)−π2)≤(π2−π1)(2d−1)λ\pi_2-\pi_1=(1+(2d-1)\lambda)\sum'r(\xi,\xi\cup x)(p_\infty(\xi\cup x)-\pi_2)\le(\pi_2-\pi_1)(2d-1)\lambdaπ2​−π1​=(1+(2d−1)λ)∑′r(ξ,ξ∪x)(p∞​(ξ∪x)−π2​)≤(π2​−π1​)(2d−1)λ.
  11. Conclusion of the proof (p. 981): for μ=1\mu=1μ=1, λk=kλ\lambda_k=k\lambdaλk​=kλ, π1>0\pi_1>0π1​>0 implies (2d−1)λ≥1(2d-1)\lambda\ge1(2d−1)λ≥1.

Significance

Theorem 7.1 gives a computable sufficient condition for extinction that holds in every dimension and for every non-linear infection law satisfying it. For the linear process it gives the lower bound λc≥1/(2d−1)\lambda_c\ge1/(2d-1)λc​≥1/(2d−1) on the critical infection rate; the paper's §9 shows conversely that the process survives for large λk/μ\lambda_k/\muλk​/μ, so the critical rate is non-trivial. The monotonicity, subadditivity and submodularity theorems of §§5–6 are the comparison tools on which much of the later theory of attractive spin systems was built, and Lemma 5.8 is the prototype of comparison between processes with ordered rates.

The results are proved in the paper, and the proof of Theorem 7.1 is half a page once §§5–6 are available. No machine-checked version of the contact process, of its comparison theorems, or of Theorem 7.1 is known to exist. A formalization produces a continuous-time Markov chain with unbounded rates and an absorbing state on a countable state space, its minimal transition function, a non-explosion criterion, first-step analysis for absorption probabilities, and coupling arguments for monotone comparison. The companion mission Contact Interactions on a Lattice II treats Theorem 7.6, the integrability of the expected size, on the same model.

Difficulty

The obvious argument is first-step analysis on singletons and pairs, (7.2) and (7.3). It fails as it stands because (7.3) involves p∞p_\inftyp∞​ of every three-point set ξ∪x\xi\cup xξ∪x, and no finite system of first-step equations closes; some inequality between survival probabilities of nested sets is needed, and the milestones record the one the paper uses. Submodularity, subadditivity and monotonicity are not consequences of the rates by direct computation: the paper proves each by building several contact processes on one probability space (Tables 1–4), which in a formal development means constructing couplings of chains with unbounded rates and checking that each marginal has the right law. The reduction from general λk\lambda_kλk​ to the linear case also needs the comparison Lemma 5.8, another coupling. Finally the rates grow linearly in ∣ξ∣|\xi|∣ξ∣, so uniformization does not apply and non-explosion (Theorem 4.3) must be proved before transition probabilities are known to sum to one.

Formalization scope

The process is the countable-state chain of §4, not the Feller process on all subsets of ZdZ_dZd​ of §2: sites are Fin d → ℤ, configurations are Finsets, and PtP_tPt​ is the minimal transition function of the rates (4.4)–(4.5), defined as the increasing limit of Feller's backward recursion. There is no measure-theoretic process object; PξP_\xiPξ​ and Eξ\mathscr E_\xiEξ​ enter only through PtP_tPt​. Consequently Theorem 4.1 (Ξ0\Xi_0Ξ0​ is stochastically closed) is built in, and every statement is made for finite initial sets, including those the page makes for arbitrary ξ∈Ξ\xi\in\Xiξ∈Ξ ((5.2)–(5.4), Lemma 5.8); for infinite ξ\xiξ the page itself notes pt(ξ)=1p_t(\xi)=1pt​(ξ)=1.

The committed conventions:

  • PtP_tPt​, ptp_tpt​, p∞p_\inftyp∞​ and mtm_tmt​ take values in [0,∞][0,\infty][0,∞]; pt(ξ)=1−Pt(ξ,∅)p_t(\xi)=1-P_t(\xi,\varnothing)pt​(ξ)=1−Pt​(ξ,∅) and p∞(ξ)=inf⁡t≥0pt(ξ)p_\infty(\xi)=\inf_{t\ge0}p_t(\xi)p∞​(ξ)=inft≥0​pt​(ξ), so p∞=0p_\infty=0p∞​=0 means absorption at ∅\varnothing∅ and cannot be produced by loss of mass to explosion.
  • The rates are real; every theorem assumes d≥1d\ge1d≥1, μ≥0\mu\ge0μ≥0, λ0=0\lambda_0=0λ0​=0 and λk≥0\lambda_k\ge0λk​≥0 for k≤2dk\le2dk≤2d. Conditions on {λk}\{\lambda_k\}{λk​} range over k=1,…,2dk=1,\dots,2dk=1,…,2d (or 0,…,2d0,\dots,2d0,…,2d), never over all natural numbers.
  • 2d−12d-12d−1 is the real number 2d−12d-12d−1.
  • In the linear case the scalar rate is written lll (λ\lambdaλ is reserved in Lean), μ=1\mu=1μ=1 and λk=kl\lambda_k=klλk​=kl.

Trivializing formalizations are ruled out: the survival probability is not taken from an arbitrary semigroup or a uniformization (the rates are unbounded); p∞p_\inftyp∞​ is not a real infimum or limUnder, whose junk value 000 would make the goal free; λ\lambdaλ is indexed by the number of infected, not vacant, neighbours, and λ0=0\lambda_0=0λ0​=0 forbids spontaneous infection; and (7.2) is stated for every site and every neighbour, not for one fixed pair.

A complete development needs: non-explosion for chains with linearly growing rates; the Chapman–Kolmogorov and strong Markov properties of the minimal chain at jump times; lattice symmetries (translations and coordinate reflections) acting on the chain; and couplings of several contact processes realised as one chain on a product type space. The chain infrastructure and the coupling lemmas are reusable beyond this mission, in particular by its companion. Contributions to any milestone are welcome, including proofs of the milestones under the paper's hypotheses by methods other than Harris's.

Selected references

  • T. E. Harris, Contact interactions on a lattice, The Annals of Probability 2(6), 969–988, 1974. https://doi.org/10.1214/aop/1176996493
  • R. Holley and T. M. Liggett, Ergodic theorems for weakly interacting infinite systems and the voter model, The Annals of Probability 3(4), 643–663, 1975. https://doi.org/10.1214/aop/1176996306
  • T. M. Liggett, Interacting Particle Systems, Grundlehren 276, Springer, 1985. https://doi.org/10.1007/978-1-4613-8542-4
  • W. Feller, On the integro-differential equations of purely discontinuous Markoff processes, Transactions of the AMS 48, 488–515, 1940. https://doi.org/10.1090/S0002-9947-1940-0002697-3
  • J. R. Norris, Markov Chains, Cambridge University Press, 1997, §2.8. https://doi.org/10.1017/CBO9780511810633
13 thms3 active usersReviewed
🏆Completed
ProbabilityStochastic Systems·Captain: mikedeng1

Heavy-Traffic Limits for Queues with Many Exponential Servers: The Scaled Stationary M/M/n Queue Length Converges to a Hybrid Exponential–Normal LawResearch Paper

Why many-server queues in heavy traffic

Telephone exchanges, call centers, hospital wards and cloud server pools are queues with a large number sss of parallel servers. For such systems two classical approximations pull in opposite directions. Holding sss fixed and letting the traffic intensity ρ→1\rho \to 1ρ→1 gives the conventional heavy-traffic limit, in which almost every customer waits. Letting sss grow with ρ\rhoρ fixed below one gives a limit in which almost nobody waits. Real systems sit in between: a positive fraction of customers wait, and waits are short. Halfin and Whitt (Operations Research 29 (1981) 567–588) identified the scaling that produces this middle regime and the limit laws it yields. The scaling is now called the Halfin–Whitt or quality-and-efficiency-driven (QED) regime, and it underlies square-root staffing: run n≈R+βRn \approx R + \beta\sqrt Rn≈R+βR​ servers for an offered load of RRR Erlangs. Borst, Mandelbaum and Reiman (Operations Research 52 (2004) 17–34) built staffing rules for large call centers on it.

Timeline. Erlang (1917) gave the delay probability of the M/M/s queue. Iglehart (1965) proved diffusion limits for M/M/s queues with the number of servers growing and the traffic intensity fixed. Halfin and Whitt (1981) proved that the delay probability has a limit strictly between 0 and 1 exactly when (1−ρn)n(1-\rho_n)\sqrt n(1−ρn​)n​ converges to a positive constant (their Proposition 1), derived the limit of the stationary queue length (Theorem 1), and extended the process-level limit to GI/M/s queues. Later work extended the regime to many-server queues with general service times and abandonment.

Setting

An M/M/s queue has Poisson arrivals at rate λ>0\lambda > 0λ>0, s≥1s \ge 1s≥1 servers, and exponential service times with rate μ>0\mu > 0μ>0. Its traffic intensity is ρ=λ/(sμ)\rho = \lambda/(s\mu)ρ=λ/(sμ). The number Q(t)Q(t)Q(t) of customers in the system (waiting or in service) is a birth–death process on {0,1,2,… }\{0,1,2,\dots\}{0,1,2,…} with birth rate λ\lambdaλ and death rate min⁡(k,s)μ\min(k,s)\mumin(k,s)μ in state kkk. When ρ<1\rho < 1ρ<1, Q(t)Q(t)Q(t) converges in distribution to Q(∞)Q(\infty)Q(∞), whose law pk=P(Q(∞)=k)p_k = P(Q(\infty) = k)pk​=P(Q(∞)=k) is the unique probability distribution solving the balance equations of this chain. The probability of delay α=P(Q(∞)≥s)\alpha = P(Q(\infty) \ge s)α=P(Q(∞)≥s) is the Erlang-C formula.

The mission studies a sequence of such queues: queue n≥1n \ge 1n≥1 has sn=ns_n = nsn​=n servers, the fixed service rate μ\muμ, and arrival rate λn\lambda_nλn​ with ρn=λn/(nμ)<1\rho_n = \lambda_n/(n\mu) < 1ρn​=λn​/(nμ)<1 and λn→∞\lambda_n \to \inftyλn​→∞. Its stationary queue length is Qn(∞)Q_n(\infty)Qn​(∞), and the scaled queue length is

Xn=Qn(∞)−nn.X_n = \frac{Q_n(\infty) - n}{\sqrt n}.Xn​=n​Qn​(∞)−n​.

Throughout, Φ\PhiΦ and φ\varphiφ denote the standard normal distribution function and density, and for β>0\beta > 0β>0

α(β)=[1+2π β Φ(β) eβ2/2]−1=φ(β)φ(β)+βΦ(β)∈(0,1).\alpha(\beta) = \big[1 + \sqrt{2\pi}\,\beta\,\Phi(\beta)\,e^{\beta^2/2}\big]^{-1} = \frac{\varphi(\beta)}{\varphi(\beta) + \beta\Phi(\beta)} \in (0,1).α(β)=[1+2π​βΦ(β)eβ2/2]−1=φ(β)+βΦ(β)φ(β)​∈(0,1).

The standing assumption of the paper's Section 2 is the heavy-traffic condition

lim⁡n→∞(1−ρn)n=β,β>0.(2.2)\lim_{n\to\infty} (1-\rho_n)\sqrt n = \beta, \qquad \beta > 0. \tag{2.2}n→∞lim​(1−ρn​)n​=β,β>0.(2.2)

Formalization targets

Goal: Theorem 1

Under (2.2), with α=α(β)\alpha = \alpha(\beta)α=α(β),

Xn⇒X,P(X≥0)=α,P(X>x∣X≥0)=e−xβ (x≥0),P(X≤x∣X≤0)=Φ(β+x)Φ(β) (x≤0).X_n \Rightarrow X, \qquad P(X \ge 0) = \alpha,\quad P(X > x \mid X \ge 0) = e^{-x\beta}\ (x \ge 0),\quad P(X \le x \mid X \le 0) = \frac{\Phi(\beta + x)}{\Phi(\beta)}\ (x \le 0).Xn​⇒X,P(X≥0)=α,P(X>x∣X≥0)=e−xβ (x≥0),P(X≤x∣X≤0)=Φ(β)Φ(β+x)​ (x≤0).

The limit is exponential with rate β\betaβ above zero and a normal law truncated at zero below it, with masses α\alphaα and 1−α1-\alpha1−α.

Milestones, in the order the paper proves them

  1. The stationary law (1.1)–(1.3) of one M/M/s queue, and the identification (1.2) of P(Q(∞)≥s)P(Q(\infty) \ge s)P(Q(∞)≥s) with the Erlang-C formula.
  2. Lemma 1: recursions expressing the partial moments ∑k<skmpk\sum_{k<s} k^m p_k∑k<s​kmpk​ and ∑k≥skmpk\sum_{k \ge s} k^m p_k∑k≥s​kmpk​ through lower ones and α\alphaα.
  3. Proposition 1: P(Qn(∞)≥n)→α∈(0,1)P(Q_n(\infty) \ge n) \to \alpha \in (0,1)P(Qn​(∞)≥n)→α∈(0,1) if and only if (2.2) holds, and then α=α(β)\alpha = \alpha(\beta)α=α(β).
  4. Proposition 2: for δ>0\delta > 0δ>0 and (n−δn)/n→δ(n - \delta_n)/\sqrt n \to \delta(n−δn​)/n​→δ with δn≤n\delta_n \le nδn​≤n,
P(Qn(∞)≤δn∣Qn(∞)≤n)→Φ(β−δ)Φ(β),n P(Qn(∞)=[δn]∣Qn(∞)≤n)→φ(β−δ)Φ(β),P(Q_n(\infty) \le \delta_n \mid Q_n(\infty) \le n) \to \frac{\Phi(\beta-\delta)}{\Phi(\beta)},\qquad \sqrt n\,P(Q_n(\infty) = [\delta_n] \mid Q_n(\infty) \le n) \to \frac{\varphi(\beta-\delta)}{\Phi(\beta)},P(Qn​(∞)≤δn​∣Qn​(∞)≤n)→Φ(β)Φ(β−δ)​,n​P(Qn​(∞)=[δn​]∣Qn​(∞)≤n)→Φ(β)φ(β−δ)​,

and for (δn−n)/n→δ(\delta_n - n)/\sqrt n \to \delta(δn​−n)/n​→δ with δn≥n\delta_n \ge nδn​≥n,

P(Qn(∞)≥δn∣Qn(∞)≥n)→e−δβ,n P(Qn(∞)=[δn]∣Qn(∞)≥n)→βe−δβ.P(Q_n(\infty) \ge \delta_n \mid Q_n(\infty) \ge n) \to e^{-\delta\beta},\qquad \sqrt n\,P(Q_n(\infty) = [\delta_n] \mid Q_n(\infty) \ge n) \to \beta e^{-\delta\beta}.P(Qn​(∞)≥δn​∣Qn​(∞)≥n)→e−δβ,n​P(Qn​(∞)=[δn​]∣Qn​(∞)≥n)→βe−δβ.
  1. Corollary 1: the first four moments and the variance of XnX_nXn​ converge to explicit functions of α\alphaα and β\betaβ, for example EXn→−β+α/βE X_n \to -\beta + \alpha/\betaEXn​→−β+α/β.

Significance

Theorem 1 is the stationary half of the Halfin–Whitt regime. It turns the Erlang-C formula, a ratio of sums with nnn terms that is opaque for large nnn, into a two-parameter description of congestion: α\alphaα is the fraction of customers who wait, β\betaβ is the scaled safety margin of servers, and the conditional laws above give the distribution of the number waiting and of the number of idle servers. Proposition 1 and Theorem 1 are what square-root staffing rules evaluate; Corollary 1 supplies the mean and variance used in the paper's numerical approximations.

All results of this mission are proved in the paper, by direct calculation from (1.1)–(1.3), Stirling's formula and the central limit theorem for Poisson variables. None has a machine-checked proof. Proposition 1 and the two Section 1 facts are posed on the platform as open theorems from the Gross et al. queueing textbook series; this mission adds the conditional and local limits, the weak-convergence theorem and the moment results on the same definitions, so that a closed development would give a fully checked derivation of the Halfin–Whitt limit from the balance equations.

Difficulty

The stationary law is explicit, so nothing here needs a stochastic process. The difficulty is analytic and uniform: each statement is a limit of ratios of sums of nnn or infinitely many terms, (nρn)k/k!(n\rho_n)^k/k!(nρn​)k/k! below nnn and a geometric tail above nnn, in which ρn→1\rho_n \to 1ρn​→1 and n→∞n \to \inftyn→∞ at linked rates. The lower half needs a central limit theorem for Poisson laws whose parameter nρnn\rho_nnρn​ moves with nnn and is evaluated at a moving point; the local limits (2.10) and (2.12) need Stirling's formula with explicit control of log⁡ρn\log \rho_nlogρn​ to second order. Weak convergence then needs tightness, or a direct argument from the conditional limits, and the moment limits need uniform integrability, which the fixed-sss moment recursions do not give by themselves. Holding ρ\rhoρ fixed, or taking limits in nnn and ρ\rhoρ one after the other, gives degenerate answers (α=0\alpha = 0α=0 or α=1\alpha = 1α=1); the two limits must be taken together.

Formalization scope

The Lean development lives in the namespace HalfinWhitt81.Stationary. The law of Qn(∞)Q_n(\infty)Qn​(∞) is a sequence p n : ℕ → ℝ satisfying IsSteadyState (fun _ => lam n) (mmcDeath μ n) (p n) of the referenced definition QueueingFundamentals.BirthDeath.Balance (nonnegative, summing to one, solving the balance equations of the M/M/n chain); the Erlang-C formula and α(β)\alpha(\beta)α(β) are erlangC and halfinWhittAlpha of QueueingFundamentals.BirthDeath.Erlang, and Φ\PhiΦ, φ\varphiφ are Mathlib's cdf (gaussianReal 0 1) and gaussianPDFReal 0 1. These, and the three open theorems for (1.1)–(1.3), (1.2) and Proposition 1, come from the Gross et al. (2008) series and are referenced, not restated. The related Borst–Mandelbaum–Reiman items (DimCallCenters.*.lemma_4_1, for the continuous extension of Erlang-C) state a different result and are not used.

Conventions committed to:

  • hypotheses on queue nnn (rates, steady state, δn≤n\delta_n \le nδn​≤n or δn≥n\delta_n \ge nδn​≥n) are imposed for n≥1n \ge 1n≥1, and only limits are asserted; λn→∞\lambda_n \to \inftyλn​→∞ is kept as a hypothesis although it follows from (2.2);
  • the standing assumption "(2.1) or, equivalently, (2.2)" is the hypothesis (2.2) with β>0\beta > 0β>0, and α\alphaα is written as α(β)\alpha(\beta)α(β), equal to the limit in (2.1) by Proposition 1;
  • probabilities of Qn(∞)Q_n(\infty)Qn​(∞) are sums of p n (probLE, probGE, probEqInt); a conditional probability P(A∣B)P(A \mid B)P(A∣B) with A⊆BA \subseteq BA⊆B is the ratio P(A)/P(B)P(A)/P(B)P(A)/P(B); [x][x][x] is Int.floor, with P(Q=m)=0P(Q = m) = 0P(Q=m)=0 for m<0m < 0m<0;
  • XnX_nXn​ uses n−1/2n^{-1/2}n−1/2: the page's (2.13) prints n1/2n^{1/2}n1/2, a misprint; (2.12) prints the limit βe−β\beta e^{-\beta}βe−β, a misprint for βe−δβ\beta e^{-\delta\beta}βe−δβ, which is what is formalized;
  • "Xn⇒XX_n \Rightarrow XXn​⇒X" is stated as: there is a Borel probability measure ν\nuν on R\mathbb RR with the three properties of Theorem 1 such that ∑kpn(k) g((k−n)/n)→∫g dν\sum_k p_n(k)\,g((k-n)/\sqrt n) \to \int g\,d\nu∑k​pn​(k)g((k−n)/n​)→∫gdν for every bounded continuous ggg; the exponential clause is for x≥0x \ge 0x≥0 and the normal clause for x≤0x \le 0x≤0;
  • infinite sums whose convergence is not implied by the hypotheses (the moment series of Lemma 1 and Corollary 1) have their convergence in the conclusion.

The goal cannot be met trivially: the law of Qn(∞)Q_n(\infty)Qn​(∞) is the M/M/n steady state, not a free sequence; the limit measure is asserted to exist together with its three properties and the convergence, so no vacuous "for every ν\nuν" reading is possible; and the statement P(Xn≥0)→αP(X_n \ge 0) \to \alphaP(Xn​≥0)→α alone is Proposition 1, already posed.

A complete development needs: the closed form of the M/M/n steady state, Poisson central limit and local limit theorems with a moving parameter, Stirling's formula with error terms, a criterion for weak convergence from convergence of distribution functions, and uniform integrability for the moments. The Poisson limit theorems and the weak-convergence criterion are reusable beyond this mission. Proofs of the referenced open theorems, of individual milestones, and alternative routes to Theorem 1 (moment convergence, or the process-level limit) are all welcome.

Selected references

  • S. Halfin and W. Whitt, Heavy-Traffic Limits for Queues with Many Exponential Servers, Operations Research 29(3) (1981) 567–588. https://doi.org/10.1287/opre.29.3.567
  • R. B. Cooper, Introduction to Queueing Theory, Macmillan, 1972 (the source cited for (1.1)–(1.3)).
  • D. L. Iglehart, Limiting Diffusion Approximations for the Many Server Queue and the Repairman Problem, Journal of Applied Probability 2(2) (1965) 429–441.
  • S. Borst, A. Mandelbaum and M. I. Reiman, Dimensioning Large Call Centers, Operations Research 52(1) (2004) 17–34. https://doi.org/10.1287/opre.1030.0081
  • D. Gross, J. F. Shortle, J. M. Thompson and C. M. Harris, Fundamentals of Queueing Theory, 4th ed., Wiley, 2008 (§2.4: the Erlang-C formula and the Halfin–Whitt limit).
13 thms3 active usersReviewed
🏆Completed
Dynamical SystemsProbabilityStochastic Systems·Captain: mikedeng1

Subadditive Ergodic Theory 1: Kingman's Theorem — x₀ₜ/t Converges with Probability One and in Mean to a Finite ξ with E(ξ) = γResearch Paper

Motivation

Many stochastic systems have an accumulated cost or passage time that grows with the length of an observation window. Splitting a window at an intermediate time gives an upper bound on the total, even when it does not give an equality. First-passage percolation and products of random matrices are examples discussed by Kingman (1973). A central question is whether the cost per unit time settles to a long-run rate on almost every sample path.

Hammersley and Welsh introduced subadditive stochastic processes in 1965. Kingman's 1968 theorem established the almost-sure limit for the stationary process considered here. His 1973 paper restated the result, identified the limit's expectation, and set out the process model and related formulations used in later applications. The 1973 article explicitly attributes the proof of Theorem 1, its maximal inequality, and its decomposition to the 1968 work; this mission formalizes the statements as presented in the 1973 paper.

Setting

Fix a probability space (Ω,F,P)(\Omega,\mathcal F,P)(Ω,F,P). For integers 0≤s<t0\le s<t0≤s<t, let xst:Ω→Rx_{st}:\Omega\to\mathbb Rxst​:Ω→R be a measurable random variable. Think of xstx_{st}xst​ as the accumulated quantity over the interval from sss to ttt. Condition S₁ is subadditivity: xsu≤xst+xtux_{su}\le x_{st}+x_{tu}xsu​≤xst​+xtu​ whenever s<t<us<t<us<t<u. The stronger equality defines an additive process.

Condition S₂ says that shifting every interval one time unit forward leaves the joint distribution of the whole family unchanged. It concerns the law of (xs+1,t+1)s<t(x_{s+1,t+1})_{s<t}(xs+1,t+1​)s<t​ as a single countable path. The one-dimensional statement that each xstx_{st}xst​ has a distribution depending only on t−st-st−s is called S₂′ in the paper; it does not replace S₂. Condition S₃ says that every positive-time variable x0tx_{0t}x0t​ is integrable and that, for some real AAA, its mean gt=EP(x0t)g_t=E_P(x_{0t})gt​=EP​(x0t​) satisfies gt≥−Atg_t\ge-Atgt​≥−At for all t≥1t\ge1t≥1. A subadditive process satisfies S₁, S₂, and S₃.

The associated mean growth rate is γ(x)=inf⁡t≥1gt/t\gamma(x)=\inf_{t\ge1}g_t/tγ(x)=inft≥1​gt​/t. The time index starts at one in this infimum because division by zero would introduce an unrelated value. S₃ gives a finite lower bound; the subadditive mean relation makes this infimum the limit of gt/tg_t/tgt​/t. Kingman also considers the invariant σ-field I\mathcal II: events determined by the entire path and unchanged by the shift (xst)↦(xs+1,t+1)(x_{st})\mapsto(x_{s+1,t+1})(xst​)↦(xs+1,t+1​). It records the part of the process that can remain random in the limiting rate. Source: §§1.1–1.2, pp. 883–885.

Formalization targets

Theorem 1: finite long-run rate

For every subadditive process there is an integrable real random variable ξ\xiξ such that

x0t(ω)t⟶ξ(ω)for P-almost every ω,∫Ω∣x0tt−ξ∣ dP⟶0,EP(ξ)=γ(x).\frac{x_{0t}(\omega)}{t}\longrightarrow\xi(\omega) \quad\text{for }P\text{-almost every }\omega, \qquad \int_\Omega\left|\frac{x_{0t}}{t}-\xi\right|\,dP\longrightarrow0, \qquad E_P(\xi)=\gamma(x).tx0t​(ω)​⟶ξ(ω)for P-almost every ω,∫Ω​​tx0t​​−ξ​dP⟶0,EP​(ξ)=γ(x).

These are three distinct claims: almost-sure convergence, convergence in mean, and an identity for the limit's expectation. The limit need not be a constant. The milestone list also covers the convergence of the means, the maximal inequality (1.2.5), the decomposition (1.2.6), the measure-preserving formulation (1.3.4)–(1.3.5), and the representation through I\mathcal II in (1.2.4). Each statement comes from the 1973 paper, §§1.1–1.3.

Measure-preserving formulation

For a measure-preserving map θ:Ω→Ω\theta:\Omega\to\Omegaθ:Ω→Ω, condition Sᴱ concerns integrable functions fnf_nfn​ with fm+n(ω)≤fm(ω)+fn(θmω)f_{m+n}(\omega)\le f_m(\omega)+f_n(\theta^m\omega)fm+n​(ω)≤fm​(ω)+fn​(θmω) for m,n≥1m,n\ge1m,n≥1 and a linear lower bound on their expectations. It yields an integrable ξ\xiξ with fn/n→ξf_n/n\to\xifn​/n→ξ almost surely and in mean. Neither invertibility nor ergodicity of θ\thetaθ is assumed. Source: §1.3, p. 886.

Significance

The theorem assigns a finite sample-path growth rate to an entire class of stationary subadditive systems. It also ties the average of that rate to the infimum of the normalized expected values. The equality is useful when a system's finite-window means are easier to estimate than its individual long-run paths. The invariant σ-field statement explains why a stationary system can have different rates on different paths without contradicting the mean identity. Kingman's examples show how the same framework reaches percolation and matrix products.

The result is mathematically proved, as the 1973 article states. The remaining work here is a machine-checked development of its process model and the displayed results. A published Prove2Me item, PalmQueueing.Ergodic.kingman_subadditive, is open and concerns an ergodic bijective flow with a constant possibly infinite limit; it does not supply this nonergodic finite-limit theorem or convergence in mean. The draft statements in this mission compile with proof placeholders. No machine-checked proof of these new statements is claimed.

Difficulty

Subadditivity gives bounds when intervals are joined, but it does not express x0tx_{0t}x0t​ as a sum of identically distributed increments. The ordinary additive ergodic theorem therefore does not immediately give convergence for x0t/tx_{0t}/tx0t​/t. Nor does convergence of the expectations gt/tg_t/tgt​/t alone force convergence on individual paths or in mean. The process may also have a nonconstant limit: stationarity is a joint-law condition, not an ergodicity assumption that erases invariant information. These are the gaps the formalization must close without strengthening the hypotheses. Source: §§1.1–1.3.

Formalization scope

Lean represents xxx as a function of two natural-number indices and a sample point, but every condition and conclusion uses only s<ts<ts<t. S₁ and the Sᴱ cocycle inequality follow the paper's pointwise displays; random-variable equality in the decomposition is stated almost surely at each valid index pair. Measurability of each valid coordinate is explicit. S₂ compares two probability measures on the full countable path space, so equality of individual marginals cannot satisfy it. The probability measure is normalized, and S₃ requires Bochner integrability to keep every mean finite. The constant γ\gammaγ is a real infimum over positive times, used only under S₃. The goal's limit is real and integrable; Kingman's separate Theorem 2 treats a possible value of −∞-\infty−∞ and belongs to another mission.

The invariant σ-field is the pullback of the path-space shift-invariant σ-field. Its measurability claim is made through an almost-everywhere equal version, since almost-sure limits are insensitive to changes on null sets. Conditional expectation uses this explicit sub-σ-field. All limits in this mission take positive integer time to infinity. The Sᴱ definition requires measure preservation but no inverse and no ergodicity. Thus neither a marginal-law substitution for S₂ nor an ergodic constant-limit specialization can trivialize the target.

A complete proof can reuse Mathlib's measure theory, conditional expectation, product measurable spaces, measure-preserving maps, and subadditive-sequence results. The two process definitions, the invariant σ-field interface, and auxiliary statements are useful to later formalizations of stationary growth models. Contributions that prove the stated results or develop general-purpose lemmas for these objects fit the mission.

Selected references

  • J. F. C. Kingman, Subadditive ergodic theory, The Annals of Probability 1(6), 883–899, 1973. DOI: 10.1214/aop/1176996798.
8 thms3 active usersReviewed
🏆Completed
CombinatoricsGraph TheoryOptimization·Captain: mikedeng1

Sequencing a One State-Variable Machine: A Solvable Case of the Traveling Salesman Problem 1: The Spanning-Tree Interchange Tour ψ* Is a Minimal Cost TourResearch Paper

Motivation

The traveling salesman problem is NP-hard in general, so special cost structures under which it can be solved exactly in polynomial time are of lasting interest in combinatorial optimization and scheduling. One of the earliest and most cited such cases comes from sequencing on a machine whose condition is described by a single real number: a furnace temperature, a knife setting, a fill level. Each job must start at a prescribed state and leaves the machine in another, and changing the state between consecutive jobs costs money or time. Finding the cheapest cyclic order of the jobs is a traveling salesman problem with asymmetric costs.

P. C. Gilmore and R. E. Gomory solved this problem exactly in 1964 (Oper. Res. 12(5), 655–679) with an algorithm of O(N2)O(N^2)O(N2) simple steps. Their construction became the standard example of a solvable TSP case: it is the starting point of the survey literature on polynomially solvable TSPs (Gilmore, Lawler and Shmoys 1985; Burkard, Deineko, van Dal, van der Veen and Woeginger 1998), and it appears in the no-wait flow shop literature, where two-machine no-wait scheduling reduces to exactly this cost structure.

Setting

There are NNN jobs J1,…,JNJ_1,\dots,J_NJ1​,…,JN​. Job iii must be started when the state of the machine is AiA_iAi​ and leaves the machine in state BiB_iBi​; the jobs are numbered so that j>ij>ij>i implies Bj≥BiB_j\ge B_iBj​≥Bi​. Two cost densities f,g:R→Rf,g:\mathbb R\to\mathbb Rf,g:R→R satisfy f(x)+g(x)≥0f(x)+g(x)\ge0f(x)+g(x)≥0: raising the state through xxx costs f(x)f(x)f(x) per unit, lowering it costs g(x)g(x)g(x) per unit. The changeover cost of having job jjj follow job iii is

cij={∫BiAjf(x) dxif Aj≥Bi,∫AjBig(x) dxif Bi>Aj.c_{ij}=\begin{cases}\int_{B_i}^{A_j}f(x)\,dx & \text{if } A_j\ge B_i,\\ \int_{A_j}^{B_i}g(x)\,dx & \text{if } B_i>A_j.\end{cases}cij​={∫Bi​Aj​​f(x)dx∫Aj​Bi​​g(x)dx​if Aj​≥Bi​,if Bi​>Aj​.​

A permutation ψ\psiψ of the jobs assigns to each job iii its successor ψ(i)\psi(i)ψ(i) and has cost c(ψ)=∑iciψ(i)c(\psi)=\sum_i c_{i\psi(i)}c(ψ)=∑i​ciψ(i)​. It is a tour if ψ(s)≠s\psi(s)\ne sψ(s)=s for every nonempty proper subset sss of the jobs, i.e. if it is a single cycle through all jobs.

A permutation φ\varphiφ ranks the AAA if j>ij>ij>i implies Aφ(j)≥Aφ(i)A_{\varphi(j)}\ge A_{\varphi(i)}Aφ(j)​≥Aφ(i)​. The interchange αij\alpha_{ij}αij​ swaps iii and jjj; applying it to ψ\psiψ gives ψαij\psi\alpha_{ij}ψαij​ (first αij\alpha_{ij}αij​, then ψ\psiψ), which exchanges the successors of iii and jjj, at cost cψ(αij)=c(ψαij)−c(ψ)c_\psi(\alpha_{ij})=c(\psi\alpha_{ij})-c(\psi)cψ​(αij​)=c(ψαij​)−c(ψ). The graph GφG_\varphiGφ​ links iii and φ(i)\varphi(i)φ(i) for every iii; a spanning tree of GφG_\varphiGφ​ is a minimal set of additional arcs RijR_{ij}Rij​ that makes it connected, with cost ∑cφ(αij)\sum c_\varphi(\alpha_{ij})∑cφ​(αij​). Node qqq is of type 1 if Bq≤Aφ(q)B_q\le A_{\varphi(q)}Bq​≤Aφ(q)​ and of type 2 otherwise.

Given a minimal cost spanning tree τ\tauτ of GφG_\varphiGφ​ made of arcs Rq,q+1R_{q,q+1}Rq,q+1​, the tour ψ∗\psi^*ψ∗ is obtained from φ\varphiφ by executing the interchanges αq,q+1\alpha_{q,q+1}αq,q+1​, Rq,q+1∈τR_{q,q+1}\in\tauRq,q+1​∈τ, first those of type 1 in decreasing order of qqq, then those of type 2 in increasing order of qqq.

Formalization targets

Goal: Theorem 5

ψ∗ is a tour, andc(ψ∗)≤c(ψ)  for every tour ψ.\psi^*\ \text{is a tour, and}\quad c(\psi^*)\le c(\psi)\ \text{ for every tour }\psi.ψ∗ is a tour, andc(ψ∗)≤c(ψ)  for every tour ψ.

This is the paper's main theorem. It fixes no constant and no special form of f,gf,gf,g; it asserts that the specific tour produced by the algorithm is optimal among all tours.

Milestones

In the order the proof uses them:

  1. Theorem 1: c(φ)=min⁡ψc(ψ)c(\varphi)=\min_\psi c(\psi)c(φ)=minψ​c(ψ) over all permutations.
  2. Eq. (11): under Bj≥BiB_j\ge B_iBj​≥Bi​, Aψ(j)≥Aψ(i)A_{\psi(j)}\ge A_{\psi(i)}Aψ(j)​≥Aψ(i)​, the cost of αij\alpha_{ij}αij​ is ∫[Bi,Bj]∩[Aψ(i),Aψ(j)](f+g)\int_{[B_i,B_j]\cap[A_{\psi(i)},A_{\psi(j)}]}(f+g)∫[Bi​,Bj​]∩[Aψ(i)​,Aψ(j)​]​(f+g).
  3. Lemma 1: an interchange between two different cycles merges them.
  4. Theorem 2: the interchanges of a spanning tree, in any order, turn ψ\psiψ into a tour.
  5. Lemma 2: some minimal cost spanning tree of GφG_\varphiGφ​ uses only arcs Ri,i+1R_{i,i+1}Ri,i+1​.
  6. Lemma 5: adjacent interchanges executed on φ\varphiφ in the stated order have additive cost.
  7. Theorem 3: ψ∗\psi^*ψ∗ is a tour of cost c(φ)+cφ(τ)c(\varphi)+c_\varphi(\tau)c(φ)+cφ​(τ).
  8. Theorem 4: c(ψ)≥c(φ)+c∗(ψ)c(\psi)\ge c(\varphi)+c^*(\psi)c(ψ)≥c(φ)+c∗(ψ) for every permutation, with the underestimate c∗c^*c∗ of (17).
  9. Lemma 7: for a tour ψ\psiψ the graph Gψ∗G_\psi^*Gψ∗​ is connected.
  10. Lemma 8: conditions (22a) and (22b) hold for equally many indices.
  11. Eq. (28): c∗(ψ)≥cφ(τ)c^*(\psi)\ge c_\varphi(\tau)c∗(ψ)≥cφ​(τ) for every tour ψ\psiψ.

Off the goal's path: Theorem 7, a minimal tour for (f,g)(f,g)(f,g) is minimal for (f+g,0)(f+g,0)(f+g,0).

Significance

The theorem shows that a traveling salesman problem whose costs come from a one-dimensional state is solved by three polynomial steps: sorting (an optimal assignment), a minimum spanning tree over N−1N-1N−1 candidate arcs, and a prescribed sequence of interchanges. It is the base case for a family of later results on solvable TSPs and for the two-machine no-wait flow shop, where it gives an exact polynomial algorithm.

The result has been proved since 1964. No machine-checked proof of it is known to exist. The proof in the paper argues largely from figures ("evident geometrically"), and its statement of Theorem 3 lists the interchanges in an order that contradicts its own proof: executed in the printed order, the paper's numerical example yields a tour of cost 39 instead of the optimum 34. A formal proof settles which order is correct and fills in the geometric steps. Partial contributions are useful: the permutation facts (Lemmas 1, 8 and Theorem 2) are independent of the cost model and reusable.

Difficulty

The obvious argument fails at two points. First, interchanges do not commute in cost: once one interchange is executed, the cost of the next one depends on the new successors, so the cost of ψ∗\psi^*ψ∗ is not simply c(φ)c(\varphi)c(φ) plus the tree cost for an arbitrary execution order. Showing that the specific order of Lemma 5 avoids all interference requires tracking how type-1 and type-2 nodes behave as interchanges are applied. Second, optimality is not a local statement: an arbitrary tour is not reachable from φ\varphiφ by tree interchanges, so the lower bound needs the separate underestimate c∗c^*c∗ and a counting argument relating every tour to a spanning tree of GφG_\varphiGφ​. Neither step follows from general minimum spanning tree theory.

Formalization scope

Jobs are Fin (n + 1) (N=n+1≥1N=n+1\ge1N=n+1≥1), so the paper's job iii is index i−1i-1i−1; the adjacent arc Rq,q+1R_{q,q+1}Rq,q+1​ is indexed by q : Fin n and joins q.castSucc and q.succ. Permutations are Equiv.Perm (Fin (n + 1)), and ψαij\psi\alpha_{ij}ψαij​ is ψ * Equiv.swap i j (Mathlib's composition, "first αij\alpha_{ij}αij​, then ψ\psiψ"). Costs are real; (1) uses oriented interval integrals and (17) set integrals.

Explicit readings of the paper's loose phrases:

  • "any integrable functions f,gf,gf,g" is read as local integrability on R\mathbb RR, with f+g≥0f+g\ge0f+g≥0 the only sign condition;
  • "proper subsets sss" in (4) are nonempty proper subsets;
  • "a minimal set of additional arcs that connect" is minimal under inclusion; "minimal cost spanning tree" is minimal in cost among spanning trees made of adjacent arcs (by Lemma 2 the same minimum as over all trees);
  • "minimal cost tour" means cost at most that of every tour, i.e. every permutation that is a single cycle;
  • "obtained by executing the α\alphaα's in a particular order" (Lemma 5) is the explicit order of its proof;
  • ties among the AAA leave φ\varphiφ non-unique; every statement holds for every ranking φ\varphiφ.

The order of ψ∗\psi^*ψ∗ is that of the proof of Lemma 5 and of steps T2–T4 (p. 673), not the order printed in Theorem 3.

Trivializing formalizations are ruled out: the goal quantifies over all tours, not over permutations (that is Theorem 1) nor over tours reachable from φ\varphiφ; ψ∗\psi^*ψ∗ is constructed from φ\varphiφ and τ\tauτ, not taken as an arbitrary tour of the right cost; τ\tauτ is both inclusion-minimal and cost-minimal; and the costs keep both branches of (1) with general densities, not cij=∣Aj−Bi∣c_{ij}=|A_j-B_i|cij​=∣Aj​−Bi​∣. The TSP items already on the platform concern symmetric or metric distances with tours as visiting orders, a different model, and are not reused.

Needed infrastructure: cycle structure of permutations under transpositions (Mathlib's Equiv.Perm.SameCycle), connectivity of finite simple graphs, interval integrals of locally integrable functions. Contributions to any milestone are welcome; the purely combinatorial ones (Lemmas 1, 8, Theorem 2, Lemma 7) are independent of the integrals.

Selected references

  • P. C. Gilmore and R. E. Gomory, Sequencing a one state-variable machine: a solvable case of the traveling salesman problem, Operations Research 12(5), 1964, 655–679. https://doi.org/10.1287/opre.12.5.655
  • P. C. Gilmore, E. L. Lawler and D. B. Shmoys, Well-solved special cases, in The Traveling Salesman Problem (Lawler, Lenstra, Rinnooy Kan, Shmoys, eds.), Wiley, 1985, 87–143. ISBN 978-0-471-90413-7
  • R. E. Burkard, V. G. Deineko, R. van Dal, J. A. A. van der Veen and G. J. Woeginger, Well-solvable special cases of the traveling salesman problem: a survey, SIAM Review 40(3), 1998, 496–546. https://doi.org/10.1137/S0036144596297514
  • J. B. Kruskal, On the shortest spanning subtree of a graph and the traveling salesman problem, Proc. AMS 7(1), 1956, 48–50. https://doi.org/10.1090/S0002-9939-1956-0078686-7
15 thms3 active usersReviewed
🏆Completed
CombinatoricsGraph Theory·Captain: mikedeng1

On Representatives of Subsets: Two Partitions into m Classes Have a Common System of Representatives When Any k Classes of One Meet at Least k Classes of the OtherResearch Paper

Motivation

Many assignment questions reduce to one combinatorial question: given finitely many sets, can one choose a different element from each? Workers are matched to jobs they are qualified for, rows of a matrix to columns with nonzero entries. The criterion for when this is possible is Hall's marriage theorem, first stated and proved by P. Hall in a five-page note in 1935 (DOI 10.1112/jlms/s1-10.37.26). It underlies bipartite matching, the integrality of the assignment polytope, the Birkhoff–von Neumann theorem on doubly stochastic matrices, and transversal theory in matroids.

Hall's note was written with a second question in view. In 1916 D. König proved, in the language of bipartite graphs, that if a set of mnmnmn things is divided into mmm classes of nnn things in two ways, then one can choose mmm things that represent every class of both divisions at once ("Über Graphen und ihre Anwendungen", Math. Annalen 77 (1916), 453). Van der Waerden (1927) and Sperner (1927) gave the set-theoretic form and a short proof. Hall's contribution was a criterion for a common system of representatives of two divisions in which the classes need not have equal sizes, obtained from the marriage theorem in two short steps.

Setting

Let SSS be any set, finite or infinite, and let

T1,T2,…,Tm(1)T_1, T_2, \dots, T_m \tag{1}T1​,T2​,…,Tm​(1)

be a finite system of subsets of SSS. The sets TiT_iTi​ may be infinite and need not be distinct; when one speaks of kkk of the sets, kkk indices are meant, so a repeated set is counted with multiplicity. A complete set of distinct representatives, or C.D.R., of (1) is a choice of pairwise distinct elements a1,…,ama_1, \dots, a_ma1​,…,am​ of SSS with

ai∈Ti(i=1,…,m).a_i \in T_i \qquad (i = 1, \dots, m).ai​∈Ti​(i=1,…,m).

The system satisfies Hall's condition when any kkk of the sets contain between them at least kkk elements of SSS, for k=1,…,mk = 1, \dots, mk=1,…,m. The meet of all C.D.R.s, written RRR, is the set of elements of SSS that occur as a representative in every C.D.R. of (1).

A division of SSS into classes is a family of pairwise disjoint sets S1,S2,…S_1, S_2, \dotsS1​,S2​,… whose union is SSS. The paper writes A∧BA \wedge BA∧B and A∨BA \vee BA∨B for intersection and union; this mission writes A∩BA \cap BA∩B and A∪BA \cup BA∪B.

In Lean the system is T : ι → Set α over a finite index type, a C.D.R. is an injective a : ι → α with a i ∈ T i (IsCDR), Hall's condition is HallCondition, and the meet of all C.D.R.s is cdrMeet, all in the namespace HallReps.CDR.

Formalization targets

Goal: Theorem 3 (pp. 29–30)

Let SSS be divided into mmm classes in two ways, S=S1∪⋯∪Sm=S1′∪⋯∪Sm′S = S_1 \cup \dots \cup S_m = S_1' \cup \dots \cup S_m'S=S1​∪⋯∪Sm​=S1′​∪⋯∪Sm′​, each a division into pairwise disjoint classes. If, for each kkk, any kkk of the classes Sj′S_j'Sj′​ contain between them elements from at least kkk of the classes SiS_iSi​, then for some permutation σ\sigmaσ of {1,…,m}\{1, \dots, m\}{1,…,m} there are elements

ai∈Si∩Sσ(i)′(i=1,…,m).a_i \in S_i \cap S'_{\sigma(i)} \qquad (i = 1, \dots, m).ai​∈Si​∩Sσ(i)′​(i=1,…,m).

The set SSS and the classes may be infinite, and no class is assumed non-empty.

Milestones

  1. Lemma (p. 27). If aaa is a C.D.R. of (1) and RRR is the meet of all C.D.R.s, the sets TiT_iTi​ whose representative aia_iai​ lies in RRR contain between them exactly the elements of RRR, and there are ∣R∣|R|∣R∣ of them.
  2. Induction step, p. 28. With (4) the system T1,…,Tm−1T_1, \dots, T_{m-1}T1​,…,Tm−1​ and R∗R^*R∗ the meet of its C.D.R.s: if Tm⊈R∗T_m \not\subseteq R^*Tm​⊆R∗, then (1) has a C.D.R.
  3. Induction step, p. 29. If (4) has a C.D.R. and Tm⊆R∗T_m \subseteq R^*Tm​⊆R∗, then some ρ+1\rho + 1ρ+1 of the sets, including TmT_mTm​, have union exactly R∗R^*R∗, where ρ=∣R∗∣\rho = |R^*|ρ=∣R∗∣.
  4. Theorem 1 (p. 27). Hall's condition is sufficient for a C.D.R. of (1).
  5. Theorem 2 (p. 29). If SSS is divided into any number of classes and any kkk of the sets TiT_iTi​ contain between them elements from at least kkk classes, there are ai∈Tia_i \in T_iai​∈Ti​ lying in pairwise different classes.

A companion item states König's theorem (§1, p. 26), which the paper deduces from Theorem 3 on p. 30.

Significance

Theorem 3 gives a necessary and sufficient criterion for two partitions of a set into mmm classes to admit a common system of representatives. Necessity is immediate, and the paper proves sufficiency. It contains König's theorem, and through it the statement that a regular bipartite multigraph has a perfect matching, as the case of equal class sizes. Hall remarks that R. Rado's generalization of König's theorem (1933) also follows. Theorem 2, the passage from "distinct elements" to "elements of distinct classes", is the form used for transversals of partitions and is the first instance of what later became the theory of common transversals and matroid intersection.

On the formal side, Hall's theorem for finite sets is in Mathlib as Finset.all_card_le_biUnion_card_iff_existsInjective' (in Mathlib/Combinatorics/Hall/Finite.lean), and the platform already has a proved equivalence for arbitrary sets with a finite index type (YogeshwaranDM.sdr_iff, included in this mission as a reference item) as well as finite bipartite-graph forms. For that reason Theorem 1 is a milestone and not the goal. What this mission adds is Hall's own proof structure, namely the meet of all C.D.R.s and the Lemma about it, which has not been formalized; Theorems 2 and 3 for divisions of a possibly infinite set; and König's theorem in its set-partition form. To our knowledge none of these statements has a machine-checked proof on the platform.

Difficulty

Theorem 3 does not follow from Theorem 1 applied to the classes Sj′S_j'Sj′​ directly. Theorem 1 produces distinct elements, but the conclusion needs elements in distinct classes SiS_iSi​, and two distinct elements of Sj′S_j'Sj′​ may lie in the same SiS_iSi​. The paper's route goes through Theorem 2, which allows any number of classes. That route needs Theorem 1 for systems whose sets can be infinite, because a single TiT_iTi​ may meet infinitely many classes, so the finite-set version of Hall's theorem in Mathlib is not enough on its own. In Hall's own proof of Theorem 1, the work lies in the Lemma. It is an exchange statement about all C.D.R.s at once, whose object RRR is defined by a universal quantifier over C.D.R.s, and it must be established over an arbitrary finite index type with possibly infinite sets.

Formalization scope

  • The ground set is a type α, with no finiteness or decidability assumed. The system (1) is T : ι → Set α with [Finite ι] (or Fin (m + 1) in the two induction steps, where the paper's mmm is the Lean m + 1, its last set is T (Fin.last m), and (4) is fun i : Fin m => T i.castSucc).
  • Cardinalities of unions of the TiT_iTi​ are Set.encard in ℕ∞, so an infinite union counts as infinite. Set.ncard is used only for subsets of Fin m, for the finite set R∗R^*R∗ (with its finiteness stated), and in König's theorem.
  • "kkk of the sets" is a Finset ι of indices, so repeated sets count with multiplicity.
  • Divisions into classes are class maps: cls : α → κ in Theorem 2, with κ arbitrary, and p q : α → Fin m in Theorem 3 and König's theorem. A class map makes the classes cover SSS and be pairwise disjoint by construction. Empty classes are allowed.
  • In Theorem 3 the permutation is existential and chosen together with the representatives. ai∈Si∩Sσ(i)′a_i \in S_i \cap S'_{\sigma(i)}ai​∈Si​∩Sσ(i)′​ is p (a i) = i ∧ q (a i) = σ i.
  • Added or dropped hypotheses: the Lemma assumes a C.D.R. exists, as the page does (without one, cdrMeet is all of α). The first induction step omits the page's C.D.R. of (4), because its hypothesis already implies one. König's theorem adds 0<n0 < n0<n, which the page presumes and without which the statement is false.
  • The trivializing formalizations are ruled out. Typing the TiT_iTi​ as Finset α would reduce Theorem 1 to Mathlib and lose the page's "It is not necessary that the sets TiT_iTi​ shall be finite". Measuring unions by ncard would make Hall's condition fail exactly when a union is infinite. An infinite index type would make Theorem 1 and the Lemma false. None of these is used.
  • Useful contributions include proofs of the Lemma and of the induction steps, a proof of Theorem 1 either from them or from Mathlib's Hall theorem via a reduction to finite sets, and the reductions Theorem 1 → Theorem 2 → Theorem 3 → König.

Selected references

  • P. Hall, On representatives of subsets, J. London Math. Soc. 10 (1935), 26–30. https://doi.org/10.1112/jlms/s1-10.37.26
  • D. König, Über Graphen und ihre Anwendungen auf Determinantentheorie und Mengenlehre, Math. Annalen 77 (1916), 453–465. https://doi.org/10.1007/BF01456961
  • B. L. van der Waerden, Ein Satz über Klasseneinteilungen von endlichen Mengen, Abh. Math. Sem. Hamburg 5 (1927), 185–188. https://doi.org/10.1007/BF02952519
  • R. Rado, Bemerkungen zur Kombinatorik im Anschluss an Untersuchungen von Herrn D. König, Sitzungsber. Berliner Math. Ges. 32 (1933), 60–75.
  • Mathlib, Mathlib/Combinatorics/Hall/Finite.lean and Mathlib/Combinatorics/Hall/Basic.lean. https://github.com/leanprover-community/mathlib4
8 thms3 active usersReviewed
🏆Completed
Linear OptimizationOptimization·Captain: mikedeng1

On the Relation Between Integer and Noninteger Solutions to Linear Programs: Deep in the Optimal-Basis Cone, z₂(b) = z₁(b) + φ(b) and the Group Problem Gives an Integer OptimumResearch Paper

Motivation

An integer program is a linear program whose variables must take integer values. Its linear relaxation can be solved efficiently, while the integer program itself is NP-hard in general, so a recurring question in integer programming is how much the optimal solution of the relaxation says about the integer optimum. Simple rounding of the fractional optimum does not answer it: examples show that the integer optimum need not lie within distance one of the LP optimum, even when the right-hand side is large.

R. E. Gomory's 1965 note in the Proceedings of the National Academy of Sciences (doi:10.1073/pnas.53.2.260) showed that, for right-hand sides lying deep inside the cone of an optimal LP basis, the integer program is solved exactly by the LP solution plus a correction computed in a finite abelian group. The resulting group relaxation (the "corner polyhedron" of Gomory's later work, Gomory 1969) underlies a large body of work on cutting planes, the master group problem, Gomory–Johnson functions and asymptotic integer programming.

Timeline. Gomory's fractional cutting-plane algorithm (Gomory 1958) introduced the "fractional rows" of the simplex tableau; the 1965 note identifies the group they generate with M(I)/M(B)M(I)/M(B)M(I)/M(B) and proves the asymptotic theorem formalized here. Gomory 1969 develops the corner polyhedron; Gomory and Johnson (1972) study the continuous valid functions of the corner polyhedron.

Setting

Let AAA be an integer m×(m+n)m\times(m+n)m×(m+n) matrix of the form (A′,I)(A',I)(A′,I), let b∈Zmb\in\mathbb Z^mb∈Zm and c∈Rm+nc\in\mathbb R^{m+n}c∈Rm+n. Problem P1 is

max⁡ z1=cxs.t.Ax=b, x≥0,\max\ z_1=cx\quad\text{s.t.}\quad Ax=b,\ x\ge0,max z1​=cxs.t.Ax=b, x≥0,

and P2 is P1 with xxx integer. A basis is a nonsingular m×mm\times mm×m submatrix BBB of AAA; after rearranging, A=(B,N)A=(B,N)A=(B,N) with B=(α1,…,αm)B=(\alpha_1,\dots,\alpha_m)B=(α1​,…,αm​) and N=(αm+1,…,αm+n)N=(\alpha_{m+1},\dots,\alpha_{m+n})N=(αm+1​,…,αm+n​), and c=(cB,cN)c=(c_B,c_N)c=(cB​,cN​). The relative cost of a nonbasic column is ci∗=ci−cBB−1αic^*_i=c_i-c_BB^{-1}\alpha_ici∗​=ci​−cB​B−1αi​, and BBB is an optimal basis when all ci∗≤0c^*_i\le0ci∗​≤0. The cone of the basis is KB={β∈Rm:B−1β≥0}K^B=\{\beta\in\mathbb R^m: B^{-1}\beta\ge0\}KB={β∈Rm:B−1β≥0}; removing from it all points within Euclidean distance ddd of its boundary gives the reduced cone KB(d)K^B(d)KB(d).

Let M(I)=ZmM(I)=\mathbb Z^mM(I)=Zm and M(B)=LBM(B)=\mathfrak L_BM(B)=LB​ the lattice of integer combinations of α1,…,αm\alpha_1,\dots,\alpha_mα1​,…,αm​. The factor module M(I)/M(B)M(I)/M(B)M(I)/M(B) is a finite abelian group with D=∣det⁡B∣D=|\det B|D=∣detB∣ elements; write αˉi\bar\alpha_iαˉi​, bˉ\bar bbˉ for the classes of αi\alpha_iαi​, bbb. The group problem (4) is

max⁡ ∑i=1nci+m∗yis.t.∑i=1nαˉi+myi=bˉ,yi≥0 integer,\max\ \sum_{i=1}^n c^*_{i+m}y_i\quad\text{s.t.}\quad\sum_{i=1}^n\bar\alpha_{i+m}y_i=\bar b,\quad y_i\ge0\text{ integer},max i=1∑n​ci+m∗​yi​s.t.i=1∑n​αˉi+m​yi​=bˉ,yi​≥0 integer,

with optimal value φB(b)\varphi^B(b)φB(b). Finally l=max⁡i>m∥αi∥l=\max_{i>m}\|\alpha_i\|l=maxi>m​∥αi​∥.

Formalization targets

Goal: THEOREM 1 (p. 261)

If b∈KB(l(D−1))b\in K^B(l(D-1))b∈KB(l(D−1)), then P1, P2 and (4) attain their optima, the value z2(b)z_2(b)z2​(b) of P2 is

z2(b)=z1(b)+φB(b),z_2(b)=z_1(b)+\varphi^B(b),z2​(b)=z1​(b)+φB(b),

an optimal solution of P2 is

x(b)=(B−1(b−NyB(b)), yB(b))x(b)=\big(B^{-1}(b-Ny^B(b)),\ y^B(b)\big)x(b)=(B−1(b−NyB(b)), yB(b))

for an optimal solution yB(b)y^B(b)yB(b) of (4) with ∑iyiB(b)≤D−1\sum_iy^B_i(b)\le D-1∑i​yiB​(b)≤D−1, and φB\varphi^BφB, yBy^ByB are mmm-periodic: φB(b+αi)=φB(b)\varphi^B(b+\alpha_i)=\varphi^B(b)φB(b+αi​)=φB(b).

Milestones

In the order of the paper's proof: ∣M(I)/M(B)∣=D|M(I)/M(B)|=D∣M(I)/M(B)∣=D (p. 262); periodicity of (4) (p. 263); the cost identity (5)–(6); "cBB−1bc_BB^{-1}bcB​B−1b is z1(b)z_1(b)z1​(b)", the simplex optimality criterion (a published, proved theorem); the projection of a solution of P2 to a solution of (4); the bound (7), z2(b)≤z1(b)+φ(b)z_2(b)\le z_1(b)+\varphi(b)z2​(b)≤z1​(b)+φ(b); the extension of a solution of (4) to an integer solution; the LEMMA (an optimal solution of (4) with ∑yi≤D−1\sum y_i\le D-1∑yi​≤D−1); and the bound ∥Ny∥≤(D−1)l\|Ny\|\le(D-1)l∥Ny∥≤(D−1)l that places b−Nyb-Nyb−Ny in KBK^BKB.

Companions

THEOREM 2: the optimal x(b)x(b)x(b) satisfies ∑i>mxi=∑iyi≤D−1\sum_{i>m}x_i=\sum_iy_i\le D-1∑i>m​xi​=∑i​yi​≤D−1. THEOREM 4 (with the bound corrected, see below): if an optimal yyy of (4) has ∏i(yi+1)>D\prod_i(y_i+1)>D∏i​(yi​+1)>D, the optimum of (4) is not unique.

Significance

THEOREM 1 reduces integer programming, for right-hand sides far from the boundary of an optimal cone, to a shortest-path-type problem over a group of order DDD: the integer optimum is determined by the LP optimum and a periodic correction, and it can be computed in time polynomial in nnn and DDD (THEOREM 3, not formalized here). It explains why rounding fails while a structured correction succeeds, and it is the starting point of the corner-polyhedron and cutting-plane theory built on the group relaxation. THEOREM 2 bounds how far the integer optimum lies from a lattice point of LB\mathfrak L_BLB​, an early proximity result.

The results are classical and proved in the paper; none of them has a machine-checked proof that this mission is aware of. The mission produces a Lean statement and proof of the asymptotic theorem, together with reusable statements about the group Zm/BZm\mathbb Z^m/B\mathbb Z^mZm/BZm and the zero-sum shortening argument of the LEMMA.

Difficulty

The decomposition z2≤z1+φz_2\le z_1+\varphiz2​≤z1​+φ is a direct computation. The difficulty is the converse: an optimal solution yyy of the group problem extends to an integer point xB=B−1(b−Ny)x_B=B^{-1}(b-Ny)xB​=B−1(b−Ny), but nothing in (4) forces xB≥0x_B\ge0xB​≥0. Optimality of yyy alone does not bound yyy: an optimal solution may carry zero-cost cycles of arbitrary length, and then b−Nyb-Nyb−Ny can leave the cone KBK^BKB. The theorem therefore depends on choosing the right optimal solution of (4), one whose total size is bounded by the group order, and on relating that combinatorial bound to the Euclidean geometry of the cone.

Formalization scope

  • The basis is fixed: BBB is an integer m×mm\times mm×m matrix and NNN an integer m×nm\times nm×n matrix; column jjj of NNN (000-based) is the paper's αm+1+j\alpha_{m+1+j}αm+1+j​. The costs cBc_BcB​, cNc_NcN​ are real.
  • The standing assumptions of pp. 260–262 are hypotheses of the goal: det⁡B≠0\det B\neq0detB=0; every unit vector of Zm\mathbb Z^mZm is a column of BBB or of NNN (the paper's A=(A′,I)A=(A',I)A=(A′,I), without which P2 can be infeasible); all relative costs ci∗≤0c^*_i\le0ci∗​≤0 (BBB is optimal, without which (4) is unbounded).
  • P2's variables are natural numbers (integer and nonnegative). The group problem is written as "b−Ny∈BZmb-Ny\in B\mathbb Z^mb−Ny∈BZm", which is equivalent to ∑αˉi+myi=bˉ\sum\bar\alpha_{i+m}y_i=\bar b∑αˉi+m​yi​=bˉ.
  • Optimal values are greatest elements of the sets of objective values, never suprema; the goal asserts that they are attained.
  • The norm in lll and in KB(d)K^B(d)KB(d) is Euclidean. KB(d)K^B(d)KB(d) is the set of points whose closed ball of radius ddd lies in KBK^BKB. l=0l=0l=0 when n=0n=0n=0.
  • In part (3) of the goal, yB(b)y^B(b)yB(b) ranges over optimal solutions of (4) with ∑iyi≤D−1\sum_iy_i\le D-1∑i​yi​≤D−1, the solutions the paper's LEMMA and dynamic program produce.
  • THEOREM 4 is stated with the hypothesis ∏(yi+1)>D\prod(y_i+1)>D∏(yi​+1)>D: the printed >D−1>D-1>D−1 is false (m=n=1m=n=1m=n=1, B=(2)B=(2)B=(2), N=(1)N=(1)N=(1), c=(2,0)c=(2,0)c=(2,0), b=1b=1b=1 has the unique optimum y=1y=1y=1 with ∏(yi+1)=2\prod(y_i+1)=2∏(yi​+1)=2).
  • A trivializing formalization is ruled out: the goal assumes none of the LEMMA, the inequality (7), integrality of B−1(b−Ny)B^{-1}(b-Ny)B−1(b−Ny) or the norm bound, and it states the existence of the optima instead of assuming them.
  • Not in scope: the operation counts of THEOREM 3 and the recursion (8), which need a machine model the paper does not define.

Needed infrastructure: the cardinality of Zm/BZm\mathbb Z^m/B\mathbb Z^mZm/BZm (available in Mathlib through determinants of basis changes), a zero-sum/pigeonhole argument in a finite abelian group, the simplex optimality criterion (published), and elementary Euclidean estimates. The group-theoretic lemmas are reusable for other group-relaxation and proximity missions. Proofs of the milestones, alternative arguments and the extension to the open-ball reading of KB(d)K^B(d)KB(d) are welcome.

Selected references

  • R. E. Gomory, On the relation between integer and noninteger solutions to linear programs, Proc. Natl. Acad. Sci. USA 53(2):260–265, 1965. https://doi.org/10.1073/pnas.53.2.260
  • R. E. Gomory, Outline of an algorithm for integer solutions to linear programs, Bull. Amer. Math. Soc. 64:275–278, 1958. https://doi.org/10.1090/S0002-9904-1958-10224-4
  • R. E. Gomory, Some polyhedra related to combinatorial problems, Linear Algebra Appl. 2:451–558, 1969. https://doi.org/10.1016/0024-3795(69)90017-2
  • R. E. Gomory and E. L. Johnson, Some continuous functions related to corner polyhedra, Math. Programming 3:23–85, 1972.
  • J. Matoušek and B. Gärtner, Understanding and Using Linear Programming, Springer, 2007 (simplex optimality criterion). https://doi.org/10.1007/978-3-540-30717-4
11 thms3 active usersReviewed
🏆Completed
Graph TheoryLinear Optimization·Captain: mikedeng1

A Suggested Computation for Maximal Multi-Commodity Network Flows: With Nonnegative Simplex Multipliers, Shortest-Chain Labels Prove the Arc-Chain Basis Optimal or Find an Entering ChainResearch Paper

Motivation

The maximal multi-commodity flow problem asks how much total flow several commodities, each travelling from its own sources to its own sinks, can send through a network whose arcs have shared capacities. It arises in communication and transportation planning: Kalaba and Juncosa's 1956 study of communication networks (Management Science 3(1)) leads to linear programs of this form. For a single commodity the problem has a clean combinatorial theory: the max-flow min-cut theorem of Ford and Fulkerson (1956, doi:10.4153/CJM-1956-045-5) and the labeling algorithm. With several commodities both fail: the min-cut equality is false, and simplex bases are no longer triangular.

In a short note received in October 1957 and published in Management Science in 1958, L. R. Ford Jr. and D. R. Fulkerson proposed a way to solve the multi-commodity problem with the simplex method anyway (doi:10.1287/mnsc.1040.0269, reprinted 2004). They use the arc-chain formulation, which has one variable per chain from a source to a sink of a commodity. That formulation has far too many variables to write down. The note's point is that the simplex method never needs them explicitly. The "pricing" step (finding a variable to enter the basis, or recognizing that none exists) can be carried out by one shortest-chain computation per commodity, with the simplex multipliers as arc lengths.

Timeline. Ford (1956, RAND P-923) gave the label-correcting shortest-chain procedure the note uses. Ford and Fulkerson (1958) applied it to price the columns of the arc-chain program. Dantzig and Wolfe (1960) generalized the idea into the decomposition principle. Gilmore and Gomory (1961) applied the same pattern to the cutting-stock problem, and it is now called column generation.

Setting

A network has finitely many nodes P1,…,PNP_1,\dots,P_NP1​,…,PN​ and arcs A1,…,AmA_1,\dots,A_mA1​,…,Am​. Each arc ArA_rAr​ joins two nodes, has a capacity brb_rbr​, and is either directed (traversable one way only) or undirected (traversable both ways). There are finitely many commodities; commodity kkk has a set of sources SkS_kSk​ and a set of sinks TkT_kTk​.

A chain from uuu to www is the arc set of a path u=v0,v1,…,vp=wu = v_0, v_1, \dots, v_p = wu=v0​,v1​,…,vp​=w with distinct nodes, each arc traversable from vi−1v_{i-1}vi−1​ to viv_ivi​. A commodity chain of kkk is a chain from a node of SkS_kSk​ to a node of TkT_kTk​. List the commodity chains, for all commodities, as C1,…,CnC_1,\dots,C_nC1​,…,Cn​, and let A=(ars)A = (a_{rs})A=(ars​) be the incidence matrix: ars=1a_{rs} = 1ars​=1 if CsC_sCs​ contains ArA_rAr​ and 000 otherwise. With xsx_sxs​ the flow along CsC_sCs​ and xn+rx_{n+r}xn+r​ the slack of arc ArA_rAr​, the problem is the linear program

maximize ∑s=1nxssubject to∑s=1narsxs+xn+r=br,x1,…,xn+m≥0.(2–3)\text{maximize } \sum_{s=1}^{n} x_s \quad\text{subject to}\quad \sum_{s=1}^{n} a_{rs}x_s + x_{n+r} = b_r,\qquad x_1,\dots,x_{n+m} \ge 0. \tag{2–3}maximize s=1∑n​xs​subject tos=1∑n​ars​xs​+xn+r​=br​,x1​,…,xn+m​≥0.(2–3)

A basis is a set of mmm columns of [A∣I][A \mid I][A∣I] forming an invertible matrix B=(brj)B = (b_{rj})B=(brj​). Its simplex multipliers α1,…,αm\alpha_1,\dots,\alpha_mα1​,…,αm​ satisfy, for every basic column jjj,

∑r=1mαrbrj={1j≤n,0j>n.(4)\sum_{r=1}^{m} \alpha_r b_{rj} = \begin{cases} 1 & j \le n,\\ 0 & j > n.\end{cases} \tag{4}r=1∑m​αr​brj​={10​j≤n,j>n.​(4)

Read as arc lengths, the αr\alpha_rαr​ give each chain CsC_sCs​ the length ∑rαrars\sum_r \alpha_r a_{rs}∑r​αr​ars​. The labeling process for a source set SSS starts with labels πi=0\pi_i = 0πi​=0 on SSS and πi=∞\pi_i = \inftyπi​=∞ elsewhere. It repeatedly finds an arc traversable from PiP_iPi​ to PjP_jPj​ with πi+lij<πj\pi_i + l_{ij} < \pi_jπi​+lij​<πj​ and replaces πj\pi_jπj​ by πi+lij\pi_i + l_{ij}πi​+lij​. In Lean the labels are lab : V → WithTop ℝ, the multipliers are α : E → ℝ, and all objects live in the namespace FordFulkerson58.ArcChain.

Formalization targets

Goal: the shortest-chain pricing test (§3, pp. 1779–1780)

Let BBB be a basis with basic feasible solution zzz and multipliers α≥0\alpha \ge 0α≥0. Then:

(a) for every commodity, every run of the labeling process with lengths α is finite;(b) if all final sink labels are ≥1, then ∑sxs≤∑szs for every feasible x;(c) if a final sink label πt<1, some non-basic chain column to t has length πt and 1−∑rαrars>0.\begin{aligned} &\text{(a) for every commodity, every run of the labeling process with lengths } \alpha \text{ is finite;}\\ &\text{(b) if all final sink labels are } \ge 1, \text{ then } \textstyle\sum_s x_s \le \sum_s z_s \text{ for every feasible } x;\\ &\text{(c) if a final sink label } \pi_t < 1, \text{ some non-basic chain column to } t \text{ has length } \pi_t \text{ and } 1 - \textstyle\sum_r \alpha_r a_{rs} > 0. \end{aligned}​(a) for every commodity, every run of the labeling process with lengths α is finite;(b) if all final sink labels are ≥1, then ∑s​xs​≤∑s​zs​ for every feasible x;(c) if a final sink label πt​<1, some non-basic chain column to t has length πt​ and 1−∑r​αr​ars​>0.​

Milestones (§3, the labeling process and the test)

  1. Termination of the labeling process for non-negative lengths (p. 1780).
  2. Final labels are shortest-chain lengths from SSS; the smallest label on TTT is the SSS-to-TTT distance (p. 1780).
  3. The trace-back: a chain of tight arcs from SSS to every labeled node, of length its label (p. 1780).
  4. If α≥0\alpha \ge 0α≥0 and every commodity chain has length ≥1\ge 1≥1, the basis is optimal (p. 1779).

Further items state the remarks of §3–§4: a negative multiplier lets a slack enter; the slack basis is a feasible start; dominated chains can be ignored; limited supplies reduce to the same problem by adding new directed source arcs; Figure 2 is the incidence matrix of Figure 1; with negative lengths the labeling process may not terminate.

Significance

The result. The test turns a linear program with exponentially many columns into one whose pricing step costs one shortest-path computation per commodity. Only the m×mm \times mm×m basis is ever stored. This is the first instance of column generation, which now underlies solvers for multi-commodity flow, cutting stock, vehicle routing, crew scheduling and many other set-partitioning models, typically inside branch-and-price. Part (a) together with milestones 2–3 also gives the correctness of Ford's label-correcting algorithm with non-negative lengths, started from a source set and with any order of arc scans.

Formalizing it. The results are classical and proved in the paper's informal style. None of them is formalized: the platform has no arc-chain LP, no column pricing, and no formal statement of Ford's label-correcting process. The general LP facts are on the platform (the simplex optimality criterion and weak duality, both proved) and are included as references. This mission adds the network-specific layer: chains as arc sets of simple paths, the labeling process as a relation on labelings, and the link from final labels to reduced costs. One sentence of the paper is corrected. The trace-back "eventually" reaches SSS only along some backward path, because zero-length cycles can trap a naive backward search, and milestone 3 states the true version.

Difficulty

The obvious argument for termination says each step lowers a label and there are finitely many chains. It fails: labels are lengths of walks, not chains, and with zero-length arcs (multipliers are often 000) there are infinitely many walks. Termination needs the finiteness of the set of walk lengths below a bound, not positivity. The correctness of the final labels needs both properties of the labeling: it is produced by the process (so every label is the length of a walk from SSS), and it is terminal. A terminal labeling alone, such as all labels 000, is not a distance labeling. Finally, the optimality claim is an LP statement about the full, never-enumerated column set. It must be derived from (4), α≥0\alpha \ge 0α≥0 and the shortest-chain lengths, with the chain columns indexed abstractly.

Formalization scope

Nodes, arcs and commodities are finite types V, E, ι. Each arc has tail, head, a per-arc directed flag and a capacity b : E → ℝ; commodities have src snk : ι → Finset V. Parallel arcs and mixed directed/undirected networks are allowed. No sign of the capacities and no disjointness of sources and sinks is assumed, except 0 ≤ b in the zero-flow item, where it is disclosed. Chains are arc sets of simple paths. The null chain at a source is a chain, so sources have distance 000. Columns are pairs (commodity, chain), so one arc set used by two commodities gives two columns. The columns of [A∣I][A \mid I][A∣I] are indexed by Col N ⊕ E. A basis is β : E → Col N ⊕ E with IsUnit (basisMatrix N β).det; its basic feasible solution and multipliers (4) are hypotheses about this β. Labels are in WithTop ℝ with ⊤ for ∞\infty∞. Shortest-chain lengths are finite infima (Finset.inf), equal to ⊤ when there is no chain. The process scans arcs, not node pairs, which handles parallel arcs and the undirected case lij=ljil_{ij} = l_{ji}lij​=lji​.

The standing assumption of §3 ("a stage has been reached in the computation where all αr\alpha_rαr​ are non-negative", p. 1779) is a hypothesis of the goal and of milestones 1–4. Milestones 1–3 are stated for any non-negative length function. The paper has no numbered theorems; every milestone is an unnumbered sentence of §3, cited by page and position.

A trivializing formalization is ruled out: the goal does not assume shortest-chain lengths, the trace-back, or any reduced-cost fact beyond (4). Statements about final labels require labelings that are both reachable from the initial labels and terminal, and part (a) shows such labelings exist.

Reusable beyond this mission: the chain and labeling layer (a label-correcting shortest-path algorithm from a source set over mixed networks) and the arc-chain LP. Contributions to the LP layer, which can import the referenced Matoušek–Gärtner results after reindexing, are particularly welcome.

Selected references

  • L. R. Ford Jr., D. R. Fulkerson, A suggested computation for maximal multi-commodity network flows, Management Science 5(1):97–101, 1958; reprinted Management Science 50(12S):1778–1780, 2004. https://doi.org/10.1287/mnsc.1040.0269
  • L. R. Ford Jr., D. R. Fulkerson, Maximal flow through a network, Canadian Journal of Mathematics 8:399–404, 1956. https://doi.org/10.4153/CJM-1956-045-5
  • L. R. Ford Jr., Network Flow Theory, RAND Corporation Paper P-923, 1956. https://www.rand.org/pubs/papers/P923.html
  • G. B. Dantzig, P. Wolfe, Decomposition principle for linear programs, Operations Research 8(1):101–111, 1960. https://doi.org/10.1287/opre.8.1.101
  • P. C. Gilmore, R. E. Gomory, A linear programming approach to the cutting-stock problem, Operations Research 9(6):849–859, 1961. https://doi.org/10.1287/opre.9.6.849
  • J. Matoušek, B. Gärtner, Understanding and Using Linear Programming, Springer, 2007. https://doi.org/10.1007/978-3-540-30717-4
12 thms3 active usersReviewed
🏆Completed
CombinatoricsGraph Theory·Captain: mikedeng1

Matching, Euler Tours and the Chinese Postman IV: Every Connected, Even, Symmetric Mixed Graph Has an Euler TourResearch Paper

Motivation

A postman, a snowplough or a street sweeper must traverse every street of a district and return to the depot. When some streets are one-way, the street network is a mixed graph: some edges are directed and must be traversed in a prescribed direction, the others are undirected and may be traversed either way. The first question about such a route is whether a closed route exists that traverses every street exactly once, an Euler tour of the mixed graph. When one exists, it is an optimal postman route; when none exists, the postman problem asks which streets to repeat.

J. Edmonds and E.L. Johnson treat this question in §6 of Matching, Euler tours and the Chinese postman (Mathematical Programming 5, 1973), the paper that solved the undirected Chinese postman problem by matching. Section 6 gives an algorithm that finds an Euler tour in any mixed graph that is connected, of even degree and symmetric, and §7 uses it for the mixed postman problem.

Timeline.

  • 1736: Euler's condition for undirected graphs (even degrees, connectivity).
  • 1951: T. van Aardenne-Ehrenfest and N.G. de Bruijn enumerate the Euler tours of a symmetric directed graph through spanning arborescences ("circuits and trees in oriented linear graphs"). Edmonds and Johnson cite this as the source of their arborescence rule.
  • 1962: L.R. Ford and D.R. Fulkerson (Flows in Networks, §II.7) characterize, by a flow argument, when a mixed graph has an Euler tour without assuming symmetry.
  • 1973: Edmonds and Johnson give the combined orientation and Rule algorithm of §6 for connected, even, symmetric mixed graphs, and the existence criterion of §7 for mixed postman tours.
  • 1976: C.H. Papadimitriou shows the mixed postman problem NP-hard, so the polynomial-time picture of §6 does not extend to its optimization version.

Setting

A mixed graph GGG has a finite set NNN of nodes and a finite set EEE of edges. Each edge eee meets two distinct nodes; several edges may meet the same pair of nodes. Some edges are directed: an edge directed away from node iii toward node jjj must be traversed from iii to jjj. In Lean an edge has a tail, a head (distinct) and a Boolean directed; for an undirected edge the order of the two ends carries no meaning.

  • The degree of a node is the total number of edges, regardless of direction, meeting it. GGG is even if every degree is even.
  • out⁡(n)\operatorname{out}(n)out(n) and in⁡(n)\operatorname{in}(n)in(n) count the directed edges directed away from and toward nnn. GGG is symmetric if out⁡(n)=in⁡(n)\operatorname{out}(n)=\operatorname{in}(n)out(n)=in(n) for every node nnn.
  • GGG is connected if it is connected when the directions on the edges are ignored.
  • A mixed walk is a sequence (n1,e1,n2,…,el,nl+1)(n_1,e_1,n_2,\dots,e_l,n_{l+1})(n1​,e1​,n2​,…,el​,nl+1​) in which each directed eie_iei​ goes from its tail nin_ini​ to its head ni+1n_{i+1}ni+1​ and each undirected eie_iei​ meets nin_ini​ and ni+1n_{i+1}ni+1​. It is a tour if nl+1=n1n_{l+1}=n_1nl+1​=n1​, an Euler tour if it contains every edge exactly once, and a postman tour if it contains every edge at least once.
  • An arborescence with root rrr is a tree TTT of directed edges in which every node n≠rn\neq rn=r of TTT has precisely one edge of TTT directed away from nnn. Following those edges from any node of TTT leads to rrr. It is spanning if it contains every node.

Formalization targets

Goal: the mixed Euler tour theorem (§6, pp. 115–118)

If GGG is connected, even and symmetric, then for every node rrr

∃ (r=n1,e1,…,el,nl+1=r) a mixed Euler tour of G.\exists\ (r=n_1,e_1,\dots,e_l,n_{l+1}=r)\ \text{a mixed Euler tour of } G .∃ (r=n1​,e1​,…,el​,nl+1​=r) a mixed Euler tour of G.

Milestones

  1. Cut balance (p. 116). If GGG is symmetric, every node set SSS has as many directed edges leaving it as entering it.
  2. Maximal arborescences span (pp. 115–116). Suppose the directed edges form a symmetric, connected spanning subgraph. Then an arborescence of directed edges to which no directed edge entering it from outside can be added contains every node.
  3. The Rule (pp. 116–117). Suppose the directed edges form a symmetric connected spanning subgraph and the undirected edges have even degree. Fix a spanning arborescence with root rrr and order the directed edges leaving each node n≠rn\neq rn=r so that the arborescence edge comes last. Then the following traversal from rrr is an Euler tour: leave by the next unused undirected edge if there is one, otherwise by the next unused directed edge.
  4. The assignment outcome (p. 118). If GGG is connected, even and symmetric, directions can be assigned to some undirected edges so that the result is symmetric, its directed edges form a connected spanning subgraph, and the unassigned edges have even degree.
  5. Mixed postman criterion (§7, p. 120). A connected mixed graph has a postman tour if and only if no nonempty proper node set SSS has every boundary edge directed away from SSS.

Significance

The goal contains two classical theorems as special cases. With every edge undirected it is Euler's theorem for connected even multigraphs. With every edge directed it is the theorem that a connected balanced digraph is Eulerian. The milestones connect the two cases: an orientation reduces the mixed case to one the Rule can handle. The Rule itself is the van Aardenne-Ehrenfest–de Bruijn construction, which underlies the BEST theorem counting Euler tours. Milestone 5 decides whether the mixed postman problem has any feasible solution. The mixed postman problem is the standard model for routing on one-way street networks.

All results here are proved in the paper, so none is open. No Lean proof of any of them in this form is known. Mathlib's Eulerian walks are for simple graphs; it has no multigraph or mixed-graph Euler theorem, no directed Euler theorem and no arborescence-based traversal. The mission produces these, together with a reusable vocabulary of mixed multigraphs, walks that respect directions, and arborescences given by parent edges.

Difficulty

The obvious approach to the goal is to forget the directions and apply Euler's theorem. This fails because the tour it produces may traverse a directed edge backwards. Orienting all undirected edges at once also fails: an arbitrary orientation of the undirected edges need not keep every node balanced.

The difficult part of the Rule is showing that the greedy traversal does not get stuck before using every edge. It cannot stop at a node other than rrr because of the degree conditions. The hard step is showing that no edge is left unused when it stops at rrr. The answer depends on the ordering condition: without the arborescence edge last at every node, the Rule can return to rrr with edges still unused. The assignment step needs an invariant: the orientation must keep every node symmetric while it extends a spanning structure of directed edges.

Formalization scope

  • Graphs. Nodes and edges are finite types (Fintype V, Fintype E). Parallel edges are allowed, including a directed and an undirected edge on the same pair. Loops are excluded (tail e ≠ head e), following the paper's standing setting of §2 (p. 91: edges meet two different nodes). Edges are a type, not a relation on nodes, so parallel edges stay distinct in every walk.
  • Hypotheses as on p. 115. "Even" counts all edges, directed or undirected. "Symmetric" counts only directed edges. "Connected" ignores directions. Strong connectivity is not assumed. "Symmetric" does not mean that every node has even in-degree, and an Euler tour of the underlying undirected multigraph does not satisfy the goal: the tour must traverse each directed edge from its tail to its head.
  • Walks are a node list and an edge list of length one less. The one-node walk is allowed, so the graph with one node and no edges satisfies the goal.
  • Arborescences are given by an optional edge ana_nan​ at each node, with an edge required for each non-root node of WWW; following those edges leads to rrr. A maximal arborescence is one where no directed edge enters WWW from outside. The optional choice represents the root-only arborescence when the graph has no edges.
  • The Rule is computed by a fuel-bounded traversal (at most ∣E∣|E|∣E∣ steps) that keeps a global list of used edges. Its conclusion is that the computed sequences form a mixed Euler tour from rrr.
  • The assignment is an existential statement over a second mixed graph G′G'G′ on the same edges, with the same unordered ends and every directed edge kept. The paper's algorithm (Steps 0–3) is not formalized.
  • Postman criterion. "Proper subset" means nonempty and proper. Connectivity is assumed, as throughout §7, and the node set is nonempty (with no nodes there is no tour, while the criterion holds vacuously).
  • Not formalized. The §7 evenness argument (p. 122) and the min-cost flow formulations are outside the scope.

Contributions are welcome at every level: proofs of the milestones, a direct proof of the goal, and general lemmas about mixed multigraph walks.

Selected references

  • J. Edmonds and E.L. Johnson, Matching, Euler tours and the Chinese postman, Mathematical Programming 5 (1973) 88–124. https://doi.org/10.1007/BF01580113
  • T. van Aardenne-Ehrenfest and N.G. de Bruijn, Circuits and trees in oriented linear graphs, Simon Stevin 28 (1951) 203–217.
  • L.R. Ford and D.R. Fulkerson, Flows in Networks, Princeton University Press, 1962.
  • C.H. Papadimitriou, On the complexity of edge traversing, Journal of the ACM 23 (1976) 544–554. https://doi.org/10.1145/321958.321974
7 thms3 active usersReviewed
🏆Completed
CombinatoricsGraph Theory·Captain: mikedeng1

Paths, Trees, and Flowers I: Matching-Duality Theorem — the Maximum Cardinality of a Matching Equals the Minimum Capacity-Sum of an Odd-Set CoverResearch Paper

Motivation

A matching in a graph is a set of edges no two of which share a vertex. Finding a matching of maximum cardinality is one of the basic problems of combinatorial optimization: it models pairing tasks (workers to shifts, kidney donors to recipients, players to rounds), it is a subroutine of algorithms for the travelling salesman and Chinese postman problems, and it was the first problem shown to need more than linear programming over the obvious constraints to be solved exactly.

For bipartite graphs, König's theorem (1931) gives a min–max formula: the maximum size of a matching equals the minimum size of a set of vertices meeting every edge. In general graphs this fails already for a triangle, where a single edge is a maximum matching but two vertices are needed to meet all three edges. Jack Edmonds' paper Paths, trees, and flowers (1965) gave both a polynomial-time algorithm for maximum matching in general graphs, the blossom algorithm, and, as a by-product of its analysis, the correct min–max theorem for general graphs.

Timeline.

  • 1891: Petersen uses alternating paths to prove the existence of factors in certain graphs.
  • 1947: Tutte characterizes graphs with a perfect matching.
  • 1957: Berge proves that a matching is maximum if and only if there is no augmenting path, and derives the deficiency formula now called the Tutte–Berge formula (Berge 1957).
  • 1965: Edmonds shrinks odd circuits ("blossoms") to search for augmenting paths in polynomial time and proves the matching-duality theorem in terms of odd-set covers (Edmonds 1965); the companion paper on the matching polyhedron extends this to weighted matching.

Setting

A graph GGG is a finite set of vertices and a finite set of edges, each edge meeting exactly two distinct vertices, its end-points. Several edges may join the same two vertices; this is needed because shrinking creates parallel edges. A matching MMM is a set of edges no two of which meet the same vertex; a vertex is exposed if it meets no edge of MMM. "Maximum" refers to cardinality.

An odd set is a set UUU of vertices with an odd number of elements. Its capacity is

cap⁡(U)={1∣U∣=1,k∣U∣=2k+1, k≥1.\operatorname{cap}(U) = \begin{cases} 1 & |U| = 1,\\ k & |U| = 2k+1,\ k \ge 1.\end{cases}cap(U)={1k​∣U∣=1,∣U∣=2k+1, k≥1.​

A one-vertex set covers the edges meeting its vertex; a set of 2k+1≥32k+1 \ge 32k+1≥3 vertices covers the edges with both end-points in it. An odd-set cover is a family S\mathcal SS of odd sets such that every edge is covered by some member, and its capacity-sum is cap⁡(S)=∑U∈Scap⁡(U)\operatorname{cap}(\mathcal S) = \sum_{U \in \mathcal S} \operatorname{cap}(U)cap(S)=∑U∈S​cap(U).

The proof uses the following objects of §3–§4 of the paper. An alternating path is a simple path whose edges alternate between MMM and the non-matching edges Mˉ\bar MMˉ. An alternating tree is a tree whose vertices are split into inner and outer vertices, every edge joining an inner to an outer vertex and every inner vertex meeting exactly two tree edges; it is planted if MMM restricted to the tree is a maximum matching of the tree whose one exposed vertex (the root) is exposed in GGG, and Hungarian if its outer vertices are adjacent only to its inner vertices. A blossom is an odd circuit on which MMM is a maximum matching, leaving one vertex bbb exposed; with a stem (an alternating path from an exposed vertex ending in a matching edge at bbb) it forms a flower. Shrinking a vertex set UUU replaces it by a single vertex U/UU/UU/U, deletes the edges inside UUU and keeps all other edges; G/BG/BG/B and M/B=M∩(G/B)M/B = M \cap (G/B)M/B=M∩(G/B) denote the result for a blossom BBB.

Formalization targets

Goal: the matching-duality theorem (5.6, p. 462)

max⁡{∣M∣:M a matching of G}  =  min⁡{cap⁡(S):S an odd-set cover of G}.\max\{|M| : M \text{ a matching of } G\} \;=\; \min\{\operatorname{cap}(\mathcal S) : \mathcal S \text{ an odd-set cover of } G\}.max{∣M∣:M a matching of G}=min{cap(S):S an odd-set cover of G}.

It is stated as: there are a maximum matching MMM and a minimum odd-set cover S\mathcal SS with ∣M∣=cap⁡(S)|M| = \operatorname{cap}(\mathcal S)∣M∣=cap(S).

Milestones (attack order)

  1. Weak duality: ∣M∣≤cap⁡(S)|M| \le \operatorname{cap}(\mathcal S)∣M∣≤cap(S) for every matching and odd-set cover.
  2. 3.7 (Berge): MMM is not maximum iff an alternating path joins two exposed vertices.
  3. 4.1–4.2: maximum matchings of an alternating tree.
  4. 4.14 and 4.15: the two directions of 4.12, in stronger form.
  5. 4.12: for the blossom BBB of a flower, MMM is maximum in GGG iff M/BM/BM/B is maximum in G/BG/BG/B.
  6. 4.17: removing a Hungarian tree preserves maximality.
  7. 5.7: the theorem for graphs with at most one exposed vertex.
  8. 5.8: the configuration produced by the algorithm on a maximum matching, and the odd sets SJ\mathcal S_JSJ​ it yields, which reduce the theorem to a graph with one exposed vertex fewer.

Significance

The matching-duality theorem gives a certificate of optimality: a matching and an odd-set cover of equal size prove each other optimal, and the blossom algorithm produces both. It is equivalent to the Tutte–Berge formula ν(G)=min⁡X12(∣V∣+∣X∣−odd⁡(G−X))\nu(G) = \min_{X} \tfrac12\bigl(|V| + |X| - \operatorname{odd}(G - X)\bigr)ν(G)=minX​21​(∣V∣+∣X∣−odd(G−X)), it contains König's theorem as the case where all members of the cover are singletons, and it is the cardinality case of Edmonds' description of the matching polytope by odd-set constraints, which underlies weighted matching, bbb-matching and the polyhedral approach to combinatorial optimization.

The theorem has been proved since 1965, with several independent proofs (via Tutte's theorem, via the Gallai–Edmonds decomposition, via linear programming). Mathlib contains Tutte's perfect-matching theorem for simple graphs, but neither the Tutte–Berge formula nor odd-set covers, alternating trees, blossom shrinking or Berge's augmenting-path theorem in a multigraph setting. This mission produces a machine-checked version of Edmonds' statement together with the lemmas of his algorithmic proof (4.12, 4.14, 4.15, 4.17), which are the correctness core of the blossom algorithm.

Difficulty

Weak duality and Berge's theorem are elementary. The difficulty is the strong direction. The obvious argument, a search for augmenting paths from an exposed vertex, fails because an alternating search tree in a non-bipartite graph can close an odd circuit, after which a vertex is reachable both by an even and by an odd alternating path; a naive search either misses augmenting paths or must back-track exponentially. The proof therefore has to work in shrunken graphs, whose vertices are nested sets of original vertices, and transfer maximality and covers back through every shrinking (4.12–4.15). Keeping track of nested blossoms, of the identity of edges under shrinking and of the parity bookkeeping of 5.8 is the main formal burden.

Formalization scope

  • Graphs are the published EdmondsMatching65.Polyhedron.Graph V E (a map from edges to unordered pairs of distinct vertices) with finite V, E; parallel edges are allowed and loops are not. Matchings are Finset E. Maximum and minimum are by cardinality, stated with explicit comparisons rather than sSup/sInf.
  • A family of odd sets is a Finset (Finset V); repeating a member only adds capacity, so this does not change the minimum. The capacity of a singleton is 111, not (1−1)/2(1-1)/2(1−1)/2.
  • Paths and circuits are lists of vertices and edges; subgraphs are vertex and edge sets; a matching of a subgraph is a matching of GGG using only its edges.
  • Shrinking is contraction along a partition of the vertices: the vertex type of G/PG/\mathcal PG/P is the set of parts, the edge type is the set of edges not inside a part. Nested blossom shrinking is encoded by an inductive predicate of blossom sets (the complete expansions of pseudovertices), not by a tower of quotient types. Statements that shrink a set other than a circuit assume its induced subgraph connected, the standing assumption of 4.9.
  • 5.7 is stated as the existence of a cover: the page's explicit families fail for the two-vertex graph with one edge and for the one-vertex graph, where the claim still holds.
  • 5.8 is stated through the configuration the algorithm outputs (blossom sets, a planted Hungarian tree in G′G'G′, pseudovertices outer), not through the algorithm as a procedure.
  • A trivializing formalization is excluded: the goal asserts the equality of the maximum and the minimum, not weak duality and not the separate existence of an optimal matching and an optimal cover.

Reusable beyond this mission: the multigraph shrinking construction, blossom sets, alternating and Hungarian trees, and Berge's theorem in the multigraph setting; these are shared with the companion mission on the invariance of the dual (Gallai–Edmonds). Proofs of any milestone, and alternative proofs of the goal (e.g. through Mathlib's Tutte theorem), are welcome.

Selected references

  • J. Edmonds, Paths, trees, and flowers, Canadian Journal of Mathematics 17 (1965), 449–467. https://doi.org/10.4153/CJM-1965-045-4
  • C. Berge, Two theorems in graph theory, Proceedings of the National Academy of Sciences USA 43 (1957), 842–844. https://doi.org/10.1073/pnas.43.9.842
  • W. T. Tutte, The factorization of linear graphs, Journal of the London Mathematical Society 22 (1947), 107–111. https://doi.org/10.1112/jlms/s1-22.2.107
  • J. Edmonds, Maximum matching and a polyhedron with 0,1-vertices, Journal of Research of the National Bureau of Standards 69B (1965), 125–130. https://doi.org/10.6028/jres.069B.013
  • L. Lovász and M. D. Plummer, Matching Theory, North-Holland, 1986. https://doi.org/10.1090/chel/367
16 thms3 active usersReviewed
🏆Completed
Algorithmic Game TheoryOptimization·Captain: mikedeng1

The Bargaining Problem: The Nash Product Maximizer Is the Unique Solution Satisfying Invariance, Symmetry, IIA and Pareto EfficiencyResearch Paper

Motivation

Two parties who can cooperate for mutual benefit must still agree on how to share the benefit. In The Bargaining Problem (Econometrica, 1950) John Nash asked which agreement two rational bargainers of equal skill should reach. His answer is not a model of haggling: it is a list of conditions any reasonable rule should satisfy, together with a proof that exactly one point of the set of feasible agreements is compatible with them. That point maximizes the product of the two parties' utility gains. Known as the Nash bargaining solution, it is the reference point of cooperative bargaining theory. Economics, operations research and networking all use it: in supply contracts, in wage bargaining, and in fair bandwidth allocation, where maximizing a product of gains becomes maximizing a sum of logarithms (proportional fairness).

Timeline:

  • 1944. von Neumann and Morgenstern axiomatize expected utility. A utility is determined up to a positive affine transformation au+bau+bau+b. Nash quotes this on p. 157.
  • 1950. Nash introduces the two-person bargaining problem and the axioms of Pareto efficiency, independence of irrelevant alternatives and symmetry, the solution being invariant under the choice of utility scales. He proves that they force the maximizer of the product u1u2u_1u_2u1​u2​ (doi:10.2307/1907266).
  • 1953. Nash's Two-Person Cooperative Games adds the threat game that fixes the disagreement point.
  • 1975. Kalai and Smorodinsky replace independence of irrelevant alternatives by monotonicity and obtain a different solution.
  • 1986. Binmore, Rubinstein and Wolinsky show that the Nash solution is the limit of equilibria of alternating-offers bargaining as the time between offers vanishes.

Setting

A bargaining problem is a pair ⟨S,d⟩\langle S,d\rangle⟨S,d⟩. Here S⊆R2S\subseteq\mathbb R^2S⊆R2 is the set of utility pairs u=(u1,u2)u=(u_1,u_2)u=(u1​,u2​) the two players can reach by agreement, including lotteries over agreements. d∈Sd\in Sd∈S is the disagreement point, the utilities of no cooperation. As in the platform goal, SSS is compact and convex, and some s∈Ss\in Ss∈S has s1>d1s_1>d_1s1​>d1​ and s2>d2s_2>d_2s2​>d2​ (both individuals could gain). Write B\mathcal BB for the set of such pairs.

A bargaining solution is a map ggg from B\mathcal BB to R2\mathbb R^2R2. Nash requires:

  • Selection. g(S,d)∈Sg(S,d)\in Sg(S,d)∈S.
  • PAR (Nash's assumption 6). If s,t∈Ss,t\in Ss,t∈S and ttt is strictly better than sss for both players, then g(S,d)≠sg(S,d)\neq sg(S,d)=s.
  • IIA (assumption 7). If S⊆TS\subseteq TS⊆T and g(T,d)∈Sg(T,d)\in Sg(T,d)∈S, then g(S,d)=g(T,d)g(S,d)=g(T,d)g(S,d)=g(T,d).
  • SYM (assumption 8). If d1=d2d_1=d_2d1​=d2​ and SSS is symmetric in the line u1=u2u_1=u_2u1​=u2​, then g(S,d)g(S,d)g(S,d) lies on that line.
  • INV. For L(s)=(α1s1+β1, α2s2+β2)L(s)=(\alpha_1s_1+\beta_1,\ \alpha_2s_2+\beta_2)L(s)=(α1​s1​+β1​, α2​s2​+β2​) with α1,α2>0\alpha_1,\alpha_2>0α1​,α2​>0, g(L(S),L(d))=L(g(S,d))g(L(S),L(d))=L(g(S,d))g(L(S),L(d))=L(g(S,d)).

The paper has no separate INV axiom. It normalizes the disagreement utility to 000 and notes that each utility is then determined only up to a positive multiple (p. 158), so the solution must not depend on that choice.

Formalization targets

Goal

The goal is the platform theorem NashBargaining.nash_bargaining_solution_unique, posed by Nickrobbins95 and currently Open. This mission references it and does not restate it. It asserts that there is a solution fff such that a solution ggg satisfies selection, INV, SYM, IIA and PAR if and only if g=fg=fg=f, and that for every ⟨S,d⟩∈B\langle S,d\rangle\in\mathcal B⟨S,d⟩∈B

f(S,d)≥d,(s1−d1)(s2−d2)<(f1−d1)(f2−d2)  for all s∈S, s≥d, s≠f(S,d).f(S,d)\ge d,\qquad (s_1-d_1)(s_2-d_2)<(f_1-d_1)(f_2-d_2)\ \text{ for all } s\in S,\ s\ge d,\ s\neq f(S,d).f(S,d)≥d,(s1​−d1​)(s2​−d2​)<(f1​−d1​)(f2​−d2​)  for all s∈S, s≥d, s=f(S,d).

Nash's paper proves the necessity half: a solution satisfying the conditions must select the maximizer of the Nash product. The sufficiency half, that the maximizer map satisfies the five conditions, is not argued in the paper. It must be supplied by whoever closes the goal.

Milestones

  1. On a compact convex S∋(0,0)S\ni(0,0)S∋(0,0) that contains a point where both players gain, u1u2u_1u_2u1​u2​ has exactly one strict maximizer ppp in the closed first quadrant, and p1,p2>0p_1,p_2>0p1​,p2​>0.
  2. Multiplying the utilities by positive constants maps the maximizer to the maximizer, so ppp may be moved to (1,1)(1,1)(1,1).
  3. If SSS is convex and (1,1)(1,1)(1,1) maximizes u1u2u_1u_2u1​u2​, then u1+u2≤2u_1+u_2\le2u1​+u2​≤2 on all of SSS.
  4. A compact SSS under that line lies in a square Qh={2−2h≤u1+u2≤2, ∣u1−u2∣≤h}Q_h=\{2-2h\le u_1+u_2\le2,\ |u_1-u_2|\le h\}Qh​={2−2h≤u1​+u2​≤2, ∣u1​−u2​∣≤h}.
  5. (1,1)(1,1)(1,1) is the only point of QhQ_hQh​ on the diagonal that no point of QhQ_hQh​ strictly dominates.
  6. Necessity. Under the five conditions, g(S,d)g(S,d)g(S,d) is the strict maximizer of (s1−d1)(s2−d2)(s_1-d_1)(s_2-d_2)(s1​−d1​)(s2​−d2​) over S∩{s≥d}S\cap\{s\ge d\}S∩{s≥d}.

Two further items formalize the paper's examples: the Bill–Jack barter, whose solution is the vertex (12,5)(12,5)(12,5) reached by exactly one exchange, and trade with money, where the solution gives equal money profits.

Significance

The Nash product characterization is used, mostly without proof, wherever a "fair" split of a cooperative surplus is needed. Examples are generalized Nash bargaining in supply-chain contracting and labour economics, the proportional-fairness criterion in network rate control, and the Nash-in-Nash models of bilateral negotiations. Many papers that build on it apply it to a specific feasible set. They therefore rely on the necessity direction, which is the step that makes the maximizer the unique answer rather than one answer among several.

The result has been proved since 1950, while the referenced Prove2Me goal remains Open. This mission supplies the milestones of Nash's own argument in the encoding of that goal, so that the necessity direction can be assembled from them. Sufficiency remains as separate work. The two examples are small, concrete checks of the solution concept.

Difficulty

Each step is elementary. The difficulty is in keeping the bookkeeping honest across the normalizations. The axioms are stated on the class B\mathcal BB, and a solution is a function on a subtype. Every application of INV, SYM or IIA therefore needs a membership proof for a transformed set: the image of SSS under an affine map, or the enclosing square. It also needs the disagreement point to be carried along. The tempting short cut is to argue "without loss of generality d=0d=0d=0 and p=(1,1)p=(1,1)p=(1,1)". That is exactly what INV licenses, but only after compactness, convexity, the point where both gain, and the location of ddd inside the square have been re-established for each transformed problem. Uniqueness of the maximizer also needs care at the boundary of the quadrant, where the product vanishes.

Formalization scope

Utility pairs are ℝ × ℝ, with u.1 player 1's utility and u.2 player 2's. Milestones 1–5 work at d=(0,0)d=(0,0)d=(0,0), the paper's normalization. Milestone 6 has a general ddd and the goal's encoding. Milestones 1–5 make the following readings explicit:

  • "First quadrant" is the closed quadrant u1≥0, u2≥0u_1\ge0,\ u_2\ge0u1​≥0, u2​≥0.
  • "The point where u1u2u_1u_2u1​u2​ is maximized" is the strict maximizer over SSS in that quadrant, in the goal's form. Milestone 1 also states p1,p2>0p_1,p_2>0p1​,p2​>0, which follows from the point where both gain (p. 158).
  • Milestone 3's hypothesis is the weak maximum s1s2≤1s_1s_2\le1s1​s2​≤1. Its conclusion covers every point of SSS, not only first-quadrant points.
  • The square is the explicit set QhQ_hQh​. Its compactness, convexity and literal symmetry (a,b)∈Qh  ⟺  (b,a)∈Qh(a,b)\in Q_h\iff(b,a)\in Q_h(a,b)∈Qh​⟺(b,a)∈Qh​ are part of milestone 4's conclusion.
  • "Satisfying assumptions (6) and (8)" in the square means lying on u1=u2u_1=u_2u1​=u2​ and being strictly dominated by no point of the square.

Milestone 6's five hypotheses are copied verbatim from the goal, and its conclusion is the goal's last conjunct for the given ggg. It does not restate the goal: it has no existence claim and no "if and only if".

Trivializing formalizations are ruled out. The point where both gain is a hypothesis wherever uniqueness is claimed; without it a segment on an axis has many maximizers of u1u2=0u_1u_2=0u1​u2​=0. The square is a concrete set, not "some symmetric compact convex set", and the solution's properties are quantified over the goal's class B\mathcal BB, which is nonempty.

The examples need finite sums, convex hulls of finite sets, and extreme points, all in Mathlib. Contributions are welcome on each milestone and on the sufficiency half of the goal.

Related platform work treats other bargaining models. These are Rubinstein's alternating-offers game (RubinsteinBargaining.PEP) and the Chatterjee–Samuelson sealed-offer double auction (ChatterjeeSamuelson). Neither is used here. The von Neumann–Morgenstern utility theorem behind the normalization is formalized as TheoryOfGames.Utility.utility_existence_uniqueness.

Selected references

  • J. F. Nash, Jr., The Bargaining Problem, Econometrica 18(2), 155–162, 1950. doi:10.2307/1907266
  • J. von Neumann, O. Morgenstern, Theory of Games and Economic Behavior, Princeton University Press, 1944.
  • J. F. Nash, Jr., Two-Person Cooperative Games, Econometrica 21(1), 128–140, 1953. doi:10.2307/1906951
  • E. Kalai, M. Smorodinsky, Other Solutions to Nash's Bargaining Problem, Econometrica 43(3), 513–518, 1975. doi:10.2307/1914280
  • K. Binmore, A. Rubinstein, A. Wolinsky, The Nash Bargaining Solution in Economic Modelling, RAND Journal of Economics 17(2), 176–188, 1986. doi:10.2307/2555382
  • M. J. Osborne, A. Rubinstein, Bargaining and Markets, Academic Press, 1990, Theorem 2.3.
10 thms3 active usersReviewed
🏆Completed
OptimizationProbability·Captain: mikedeng1

Supply Chain Coordination with Contracts VI: With a Forecast Update, Buy-Back Terms with w₁ − w₂ + λc₂ = λc₁ Give the Retailer λΩ₁(q₁) and a Lower Period-2 Margin w₂ − c₂ < w₁ − c₁Textbook

Motivation

A newsvendor retailer who may order twice faces a tradeoff. Ordering late lets the retailer use a better demand forecast. Ordering early lets the supplier produce more cheaply, with longer procurement lead times and no overtime labor. Fisher and Raman (1996) document such forecast improvements between ordering epochs in fashion apparel. A decentralized supply chain must balance cheap early production against well-informed late production, and it is not obvious that a simple contract can induce both firms to strike the balance an integrated firm would choose.

This mission formalizes §6.6 of G. P. Cachon's survey chapter Supply Chain Coordination with Contracts (Handbooks in OR & MS, Vol. 11, 2003), read in the author's January 2003 draft. The section builds on Donohue (2000), who studied the same two-mode production problem under forced compliance. The chapter's model lets the supplier operate under voluntary compliance: she may deliver less than the retailer orders, and she may produce more in period 1 than was ordered. The question is whether a buy back contract with one wholesale price per ordering epoch still coordinates the supply chain.

Setting

A demand signal ξ≥0\xi \ge 0ξ≥0 with density ggg and distribution function GGG is observed once before the selling season. Given ξ\xiξ, demand DDD has distribution function F(⋅ ∣ ξ)F(\cdot\,|\,\xi)F(⋅∣ξ), continuous and strictly increasing on [0,∞)[0,\infty)[0,∞). Demand is stochastically increasing in the signal: F(x ∣ ξh)<F(x ∣ ξl)F(x\,|\,\xi_h) < F(x\,|\,\xi_l)F(x∣ξh​)<F(x∣ξl​) for ξh>ξl\xi_h > \xi_lξh​>ξl​. Expected sales are S(q ∣ ξ)=E[min⁡(q,D) ∣ ξ]S(q\,|\,\xi) = E[\min(q,D)\,|\,\xi]S(q∣ξ)=E[min(q,D)∣ξ]. Period 1 is before the signal and period 2 is after it. The retailer's total order is q1q_1q1​ after period 1 and q2≥q1q_2 \ge q_1q2​≥q1​ after period 2. The supplier's unit production cost is cic_ici​ in period iii, with c1<c2<pc_1 < c_2 < pc1​<c2​<p, where ppp is the retail price. Salvage values and goodwill costs are zero.

The supply chain's period-2 objective is

Ω2(q2 ∣ q1,ξ)=pS(q2 ∣ ξ)−c2q2+c2q1,\Omega_2(q_2\,|\,q_1,\xi) = pS(q_2\,|\,\xi) - c_2 q_2 + c_2 q_1 ,Ω2​(q2​∣q1​,ξ)=pS(q2​∣ξ)−c2​q2​+c2​q1​,

and q2(q1,ξ)q_2(q_1,\xi)q2​(q1​,ξ) maximizes it over q2≥q1q_2 \ge q_1q2​≥q1​. The supply chain's expected profit is Ω1(q1)=−c1q1+E[Ω2(q2(q1,ξ) ∣ q1,ξ)]\Omega_1(q_1) = -c_1 q_1 + E[\Omega_2(q_2(q_1,\xi)\,|\,q_1,\xi)]Ω1​(q1​)=−c1​q1​+E[Ω2​(q2​(q1​,ξ)∣q1​,ξ)].

Under the buy back contract {w1,w2,b}\{w_1, w_2, b\}{w1​,w2​,b} the retailer pays wiw_iwi​ per unit ordered in period iii, and the supplier refunds bbb per unsold unit. The retailer's period-2 profit is π2(q2 ∣ q1,ξ)=(p−b)S(q2 ∣ ξ)−(w2−b)q2+w2q1\pi_2(q_2\,|\,q_1,\xi) = (p-b)S(q_2\,|\,\xi) - (w_2-b)q_2 + w_2 q_1π2​(q2​∣q1​,ξ)=(p−b)S(q2​∣ξ)−(w2​−b)q2​+w2​q1​, and his period-1 profit is π1(q1)=−w1q1+E[π2(q2(q1,ξ) ∣ q1,ξ)]\pi_1(q_1) = -w_1 q_1 + E[\pi_2(q_2(q_1,\xi)\,|\,q_1,\xi)]π1​(q1​)=−w1​q1​+E[π2​(q2​(q1​,ξ)∣q1​,ξ)]. The supplier's period-2 profit Π2\Pi_2Π2​ and her period-1 profit Π1(x ∣ q1)\Pi_1(x\,|\,q_1)Π1​(x∣q1​), as functions of the stock xxx she holds, are given in the mission's Profits definition.

Formalization targets

Goal: the buy back contract coordinates

For λ∈[0,1]\lambda \in [0,1]λ∈[0,1] with

p−b=λp,w2−b=λc2,w1−w2+λc2=λc1,p - b = \lambda p,\qquad w_2 - b = \lambda c_2,\qquad w_1 - w_2 + \lambda c_2 = \lambda c_1,p−b=λp,w2​−b=λc2​,w1​−w2​+λc2​=λc1​,

the identities

π2(q2 ∣ q1,ξ)=λ(Ω2(q2 ∣ q1,ξ)−c2q1)+w2q1,π1(q1)=λ Ω1(q1)\pi_2(q_2\,|\,q_1,\xi) = \lambda\big(\Omega_2(q_2\,|\,q_1,\xi) - c_2 q_1\big) + w_2 q_1,\qquad \pi_1(q_1) = \lambda\,\Omega_1(q_1)π2​(q2​∣q1​,ξ)=λ(Ω2​(q2​∣q1​,ξ)−c2​q1​)+w2​q1​,π1​(q1​)=λΩ1​(q1​)

hold, so the supply chain's optima in both periods are the retailer's optima (with equivalence for λ>0\lambda > 0λ>0). In addition,

w2−c2=w1−(λc1+(1−λ)c2)<w1−c1(λ<1).w_2 - c_2 = w_1 - \big(\lambda c_1 + (1-\lambda)c_2\big) < w_1 - c_1 \quad (\lambda < 1).w2​−c2​=w1​−(λc1​+(1−λ)c2​)<w1​−c1​(λ<1).

Milestones

  1. The structure of the period-2 problem, Eqs. (25)–(26): q2(ξ)q_2(\xi)q2​(ξ) solves F(q2(ξ) ∣ ξ)=(p−c2)/pF(q_2(\xi)\,|\,\xi) = (p-c_2)/pF(q2​(ξ)∣ξ)=(p−c2​)/p and increases in ξ\xiξ, and the threshold ξ(q1)\xi(q_1)ξ(q1​) splits the signals into those that trigger a period-2 order and those that do not.
  2. The retailer's period-2 identity (p. 65).
  3. The supplier fills any period-2 order up to q2(q1,ξ)q_2(q_1,\xi)q2​(q1​,ξ), and for λ<1\lambda < 1λ<1 she does not fill a larger one (p. 65).
  4. The retailer's period-1 identity (p. 66).
  5. The first-order condition (27) for q1oq_1^oq1o​.
  6. The supplier's period-2 profit increases in her stock below q1q_1q1​, so she produces at least the period-1 order (p. 66).
  7. The supplier produces exactly the period-1 order (p. 67).
  8. The margin comparison (p. 67).

Significance

The result shows that the buy back contract, which coordinates the single-period newsvendor, extends to a setting with a forecast update and two production modes, even when the supplier is free to under-deliver or to stockpile. Profit can be divided arbitrarily through λ\lambdaλ. Coordination also forces the supplier's margin on expensive late production below her margin on cheap early production, which contradicts the intuition that the better-informed late order should command a premium. Milestone 7 rules out stranded inventory: under the coordinating terms the supplier never stocks more than the retailer ordered in period 1.

These results are established on paper in Cachon's chapter. No machine-checked version is known. The identities are algebraic. The supplier's production result needs differentiation of an expectation over the signal across the moving threshold ξ(x)\xi(x)ξ(x).

Difficulty

The retailer's identities reduce to algebra once the contract terms are substituted, and the margin comparison is one line. The substantive steps are the derivative formulas (27) and ∂Π1(x ∣ q1)/∂x=−c1+c2(1−G(ξ(x)))\partial \Pi_1(x\,|\,q_1)/\partial x = -c_1 + c_2(1 - G(\xi(x)))∂Π1​(x∣q1​)/∂x=−c1​+c2​(1−G(ξ(x))). The obvious move, differentiating inside the expectation term by term, fails because the period-2 optimum max⁡(q1,q2(ξ))\max(q_1, q_2(\xi))max(q1​,q2​(ξ)) has a kink at ξ=ξ(q1)\xi = \xi(q_1)ξ=ξ(q1​). The integrand switches between two regimes, and the switch point moves with q1q_1q1​. The supplier's period-1 profit is not differentiable at x=q1x = q_1x=q1​; only its right derivative is negative at q1oq_1^oq1o​. Turning the page's derivative statements into the global claim that x=q1ox = q_1^ox=q1o​ is her unique optimum needs a monotonicity argument on both sides of q1oq_1^oq1o​.

Formalization scope

The conditional law is a measurable family ξ↦Dξ\xi \mapsto D_\xiξ↦Dξ​ of probability measures on R\mathbb RR supported on [0,∞)[0,\infty)[0,∞), each with a finite mean, a continuous distribution function, and a distribution function strictly increasing on [0,∞)[0,\infty)[0,∞). The signal has a measurable density g≥0g \ge 0g≥0 with ∫0∞g=1\int_0^\infty g = 1∫0∞​g=1, and demand has a finite unconditional mean. These standing assumptions follow the chapter's p. 7 newsvendor model, together with the measurability needed for expectations over the signal. 0<c2<p0 < c_2 < p0<c2​<p makes the critical ratio lie in (0,1)(0,1)(0,1). Expected sales reuse the platform definition SupplyChainTheory.expSales (from SupplyChainTheory_contracts).

The optimum q2(q1,ξ)q_2(q_1,\xi)q2​(q1​,ξ) is a hypothesis-carried selection maximizing Ω2\Omega_2Ω2​ over q2≥q1q_2 \ge q_1q2​≥q1​. It is never an arbitrary function: a formalization that let q2(q1,ξ)q_2(q_1,\xi)q2​(q1​,ξ) be unconstrained would make π1=λΩ1\pi_1 = \lambda\Omega_1π1​=λΩ1​ a statement about meaningless orders. The thresholds ξ(q1)\xi(q_1)ξ(q1​) enter as solutions of (26) whose existence is assumed where the page assumes it. Optimal order quantities are taken over q1≥0q_1 \ge 0q1​≥0 and q2≥q1q_2 \ge q_1q2​≥q1​. Derivatives are stated with HasDerivAt (or HasDerivWithinAt for the right derivative at a kink).

Three corrections of the print are disclosed in the item notes:

  • the strict margin inequality fails at λ=1\lambda = 1λ=1;
  • the p. 66 identity for Π2(x,q1,q2,ξ)\Pi_2(x, q_1, q_2, \xi)Π2​(x,q1​,q2​,ξ) is off by the constant (1−λ)c2q1(1-\lambda)c_2q_1(1−λ)c2​q1​;
  • "retailer optimal equals chain optimal" needs λ>0\lambda > 0λ>0 in the converse direction.

Contributions are welcome on all milestones. A lemma that differentiates q↦E[max⁡q2≥qΩ2]q \mapsto E[\max_{q_2 \ge q} \Omega_2]q↦E[maxq2​≥q​Ω2​] with a density-driven threshold would be reusable beyond this mission.

Selected references

  • G. P. Cachon, Supply Chain Coordination with Contracts, in S. Graves and T. de Kok (eds.), Handbooks in Operations Research and Management Science, Vol. 11: Supply Chain Management, North-Holland, 2003, Ch. 6. https://doi.org/10.1016/S0927-0507(03)11006-7
  • K. L. Donohue, Efficient Supply Contracts for Fashion Goods with Forecast Updating and Two Production Modes, Management Science 46(11), 1397–1411, 2000. https://doi.org/10.1287/mnsc.46.11.1397.12088
  • M. Fisher and A. Raman, Reducing the Cost of Demand Uncertainty Through Accurate Response to Early Sales, Operations Research 44(1), 87–99, 1996. https://doi.org/10.1287/opre.44.1.87
12 thms3 active usersReviewed
🏆Completed
OptimizationProbability·Captain: mikedeng1

Supply Chain Coordination with Contracts VII: In the Single-Location Base-Stock Model the Transfers t_I = (1 − λ)h_r, t_B = β_r − λβ Make the Retailer's Cost λc(s_r)Textbook

Motivation

A retailer can keep too little inventory even when its own stocking decision is optimal. In the single-location model of Cachon, Supply Chain Coordination with Contracts (2003), the supplier suffers a cost when the retailer has backorders, but the retailer does not bear that part of the cost. The supplier and retailer therefore prefer different base-stock levels. Section 6.7 asks whether payments tied to expected inventory and backorders can make the retailer choose the level that minimizes their combined cost. The result also describes how the contract divides that cost between the firms.

The model concerns a continuing operation with repeated replenishment opportunities and backordered demand. A base-stock policy keeps the retailer's inventory position at a chosen level by replacing units as demand occurs. Cachon reduces the cost calculation for such a policy to the distribution of demand over one replenishment lead time. That reduction allows the coordination question to be stated with one real stock-level decision rather than a full inventory trajectory. The chapter presents this model as a building block for its two-location system in §6.8 Cachon (2003).

Setting

Let DrD_rDr​ denote lead-time demand, the amount demanded while the retailer waits for replenishment. It is nonnegative and has a finite mean μr=E[Dr]\mu_r=\mathbb E[D_r]μr​=E[Dr​], distribution function FrF_rFr​, and density frf_rfr​. At inventory level s∈Rs\in\mathbb Rs∈R, expected inventory is Ir(s)=E[(s−Dr)+]I_r(s)=\mathbb E[(s-D_r)^+]Ir​(s)=E[(s−Dr​)+] and expected backorders are Br(s)=E[(Dr−s)+]B_r(s)=\mathbb E[(D_r-s)^+]Br​(s)=E[(Dr​−s)+], where x+=max⁡(x,0)x^+=\max(x,0)x+=max(x,0). The section assumes Fr(0)=0F_r(0)=0Fr​(0)=0 and a strictly increasing differentiable FrF_rFr​ on nonnegative levels. These assumptions place the optimum above zero.

The retailer pays holding cost hrIr(s)h_r I_r(s)hr​Ir​(s) and its own backorder cost βrBr(s)\beta_r B_r(s)βr​Br​(s). The supplier pays a further backorder cost βsBr(s)\beta_s B_r(s)βs​Br​(s). All three cost rates are positive. Thus cr(s)=hrIr(s)+βrBr(s)c_r(s)=h_r I_r(s)+\beta_r B_r(s)cr​(s)=hr​Ir​(s)+βr​Br​(s) and cs(s)=βsBr(s)c_s(s)=\beta_s B_r(s)cs​(s)=βs​Br​(s) are the firms' costs, while c(s)=cr(s)+cs(s)c(s)=c_r(s)+c_s(s)c(s)=cr​(s)+cs​(s) is the channel cost. Write β=βr+βs\beta=\beta_r+\beta_sβ=βr​+βs​. Because demand is backordered rather than lost, the section treats the sales rate as constant across the stock decisions and compares costs alone Cachon (2003), §6.7.1.

The proposed contract pays the retailer tIIr(s)+tBBr(s)t_I I_r(s)+t_B B_r(s)tI​Ir​(s)+tB​Br​(s) from the supplier, where tIt_ItI​ and tBt_BtB​ are transfer rates. A positive rate is a subsidy; a negative rate charges the retailer. For a parameter λ∈(0,1]\lambda\in(0,1]λ∈(0,1], the contract sets tI=(1−λ)hrt_I=(1-\lambda)h_rtI​=(1−λ)hr​ and tB=βr−λβt_B=\beta_r-\lambda\betatB​=βr​−λβ. The retailer's contracted cost is its original cost minus this transfer; the supplier's contracted cost is its original cost plus it. The parameter λ\lambdaλ describes a family of printed contract rates and is not itself a payment term Cachon (2003), p. 74.

Formalization targets

The milestones establish the two expectation identities, the channel's cost formula and strict convexity, the channel's critical ratio, the retailer's lower uncontracted stock level, and the retailer's cost after the printed transfer. In the notation above, the channel optimum sr∘s_r^\circsr∘​ is unique and satisfies

Fr(sr∘)=βhr+β;F_r(s_r^\circ)=\frac{\beta}{h_r+\beta};Fr​(sr∘​)=hr​+ββ​;

the uncontracted retailer has its own unique optimum sr∗s_r^*sr∗​ with sr∗<sr∘s_r^*<s_r^\circsr∗​<sr∘​. Three further statements of §6.7.1 complete the section: the signs of the transfer rates over the family (tI≥0t_I\ge0tI​≥0, with tI>0t_I>0tI​>0 exactly for λ<1\lambda<1λ<1, and {tB:0<λ≤1}=[−βs,βr)\{t_B:0<\lambda\le1\}=[-\beta_s,\beta_r){tB​:0<λ≤1}=[−βs​,βr​)); the decomposition

tIIr(y)+tBBr(y)=(tI+tB)Ir(y)+tB(μr−y);t_I I_r(y)+t_B B_r(y)=(t_I+t_B)I_r(y)+t_B(\mu_r-y);tI​Ir​(y)+tB​Br​(y)=(tI​+tB​)Ir​(y)+tB​(μr​−y);

and the equivalence with the newsvendor model: with lead-time demand as newsvendor demand, retail price p=hr+βrp=h_r+\beta_rp=hr​+βr​ and wholesale price w=hrw=h_rw=hr​, the newsvendor retailer's profit pS(q)−wqpS(q)-wqpS(q)−wq, with expected sales S(q)=E[min⁡(q,Dr)]S(q)=\mathbb E[\min(q,D_r)]S(q)=E[min(q,Dr​)], equals −cr(q)+βrμr-c_r(q)+\beta_r\mu_r−cr​(q)+βr​μr​. The mission goal is the coordinating identity of Eq. (33), together with the unique optimality it implies:

crλ(s)=λc(s),csλ(s)=(1−λ)c(s)for all s∈R and 0<λ≤1.c_r^\lambda(s)=\lambda c(s),\qquad c_s^\lambda(s)=(1-\lambda)c(s) \quad\text{for all }s\in\mathbb R\text{ and }0<\lambda\le1.crλ​(s)=λc(s),csλ​(s)=(1−λ)c(s)for all s∈R and 0<λ≤1.

Consequently, the retailer's contracted cost has the same unique minimizer sr∘s_r^\circsr∘​ as the channel cost. At each stock level the retailer's contracted cost is strictly increasing in λ\lambdaλ, which is the page's statement that the retailer's share of the cost increases with λ\lambdaλ. The result does not prescribe one fixed allocation of cost: each λ\lambdaλ in the stated interval gives a contract with the same coordinated stock level and a different retailer share Cachon (2003), Eq. (33), p. 74.

Significance

The theorem identifies an explicit transfer that corrects an incentive gap created by the supplier's backorder cost. Without it, the retailer sets stock according to βr\beta_rβr​, while the channel's stock decision uses βr+βs\beta_r+\beta_sβr​+βs​. Under the contract, the retailer bears the fraction λ\lambdaλ of total cost at every stock level, so its decision agrees with the integrated channel's decision. This conclusion connects a decentralized cost objective to the base-stock target used in the next section's two-location analysis Cachon (2003), §§6.7–6.8.

The chapter proves these claims informally; this mission asks for machine-checked Lean proofs of the expectation identities, convexity and optimality claims, and the contract identity. Its reusable output is the precise treatment of expected positive-part inventory and backorders under a demand law with finite mean. The local definitions may also support later formalizations of inventory contracts. Expected sales in the newsvendor comparison is the published SupplyChainTheory.expSales (definition SupplyChainTheory_contracts), referenced rather than redefined. The existing proved SupplyChainTheory.chain_optimal_fractile concerns a single-period newsvendor profit objective; its critical ratio is related mathematically but belongs to a different model and is not substituted for Eq. (31).

Difficulty

The algebra of the transfer rates is short, but the unique-optimum claim depends on more than algebra. It requires expected inventory and backorders to match the distribution formulas, the cost to have the required curvature at nonnegative levels, and the optimum to occur at a positive level. A formal statement that defines the retailer's contracted cost directly as λc\lambda cλc would erase the coordinating claim. The negative-stock region also matters: since demand is nonnegative, expected inventory vanishes there and cost is affine rather than strictly convex. The formulation must keep strict convexity on the range where it holds while still identifying the unique optimum among all real stock levels.

Formalization scope

Lean represents DrD_rDr​ by a probability measure on R\mathbb RR supported on [0,∞)[0,\infty)[0,∞), with an explicit integrable first moment. The density is a measurable nonnegative function whose induced measure is the demand law; the cdf is continuous, strictly increasing on [0,∞)[0,\infty)[0,∞), equals zero at zero, and has that density as its derivative at positive levels. These are the section's distribution assumptions. The positive rates hr,βr,βsh_r,\beta_r,\beta_shr​,βr​,βs​ are fields of one model, and Ir,BrI_r,B_rIr​,Br​ are defined by expectations. This rules out accidental zero values from nonintegrable real integrals. The cost functions are constructed from the expected inventory and backorders; the transfer is constructed from the two printed rates. The identities in Eqs. (28)–(33) are theorem targets, not definitions.

Stock levels are real, including negative levels, because the section does not explicitly restrict the decision set. The formal result states strict convexity on nonnegative levels and uniqueness of the cost minimizers over all real levels. The page's sentence that tI>0t_I>0tI​>0 for all λ∈(0,1]\lambda\in(0,1]λ∈(0,1] fails at λ=1\lambda=1λ=1, where tI=0t_I=0tI​=0; the formal statement asserts tI≥0t_I\ge0tI​≥0 with strict positivity exactly for λ<1\lambda<1λ<1. The contract range is exactly 0<λ≤10<\lambda\le10<λ≤1; λ=0\lambda=0λ=0 would make every retailer stock level cost-equivalent. The transfer sign is positive from supplier to retailer, as on p. 73. Risk neutrality and full information are the chapter's standing conventions. The continuous-review state process, supplier capacity, and proof that a base-stock policy attains the displayed long-run average are not modeled; the mission formalizes the section's explicit lead-time-demand cost reduction. Contributions that establish integrability, distribution identities, strict convexity, and critical-ratio optimality are all needed for closure.

Selected references

  • Gérard P. Cachon, Supply Chain Coordination with Contracts, in Handbooks in Operations Research and Management Science, vol. 11, North-Holland, 2003; source used here: author's third draft, January 2003, §6.7. DOI.
12 thms3 active usersReviewed
🏆Completed
OptimizationProbability·Captain: mikedeng1

Supply Chain Coordination with Contracts II: With Price-Dependent Demand the Price-Contingent Buy-Back Gives the Retailer λΠ(q, p), as Revenue Sharing Does, and Coordinates Price and QuantityTextbook

Motivation

A retailer who controls both inventory and price can respond to a supply contract in two ways. A contract that induces the right order quantity at a fixed price may change the retailer's incentive to raise or lower that price. For a one-season supply chain, Cachon's chapter compares familiar contracts under price-dependent demand and identifies a price-contingent buy-back, also called a price-discount contract, that aligns both decisions. The mission concerns §6.3 of the author's January 2003 third draft, on printed pages 33–38. Those page and equation numbers belong to the draft and may differ from the typeset chapter.

Setting

One risk-neutral supplier and one risk-neutral retailer have full information before a single selling season. The retailer chooses a nonnegative stocking quantity qqq and a retail price ppp from an admissible price set PPP; the price stays fixed during the season. Demand has a probability law DpD_pDp​ that depends on ppp. Write F(y∣p)F(y\mid p)F(y∣p) for its distribution function, S(q,p)=Ep[min⁡(q,D)]S(q,p)=\mathbb E_p[\min(q,D)]S(q,p)=Ep​[min(q,D)] for expected sales, and μ(p)=Ep[D]\mu(p)=\mathbb E_p[D]μ(p)=Ep​[D] for mean demand. Demand is nonnegative, has a finite mean and, in the chapter's regular setting, its distribution function increases with demand level and has a positive price derivative at positive demand levels. Higher prices thus lower demand in the stochastic order used by the chapter. The price set is nonempty and open so an admissible price optimum has an interior first-order condition.

The supplier's unit cost is csc_scs​, the retailer's unit procurement cost is crc_rcr​, and c=cs+crc=c_s+c_rc=cs​+cr​ is total unit cost. Their goodwill penalties for unmet demand are gsg_sgs​ and grg_rgr​, with g=gs+grg=g_s+g_rg=gs​+gr​. An unsold unit has salvage value vvv at the retailer. The integrated channel's expected profit is

Π(q,p)=(p−v+g)S(q,p)−(c−v)q−gμ(p).\Pi(q,p)=(p-v+g)S(q,p)-(c-v)q-g\mu(p).Π(q,p)=(p−v+g)S(q,p)−(c−v)q−gμ(p).

A buy-back contract charges a wholesale price wbw_bwb​ for each ordered unit and pays the retailer bbb for each unsold unit. A revenue-sharing contract charges a wholesale price wrw_rwr​ and gives the retailer a fraction ϕ\phiϕ of sales and salvage revenue. In this section the supplier offers the terms and the retailer chooses (q,p)(q,p)(q,p). The profit formulas use the chapter's convention that a positive transfer goes from retailer to supplier.

Formalization targets

The goal is the price-contingent buy-back on p. 35, with λ∈[0,1]\lambda\in[0,1]λ∈[0,1]:

b(p)=(1−λ)(p−v+g)−gs,wb(p)=λcs+(1−λ)(p+g−cr)−gs.b(p)=(1-\lambda)(p-v+g)-g_s,\qquad w_b(p)=\lambda c_s+(1-\lambda)(p+g-c_r)-g_s.b(p)=(1−λ)(p−v+g)−gs​,wb​(p)=λcs​+(1−λ)(p+g−cr​)−gs​.

In the chapter's zero-goodwill case, gr=gs=0g_r=g_s=0gr​=gs​=0, every feasible (q,p)(q,p)(q,p) then gives the retailer λΠ(q,p)\lambda\Pi(q,p)λΠ(q,p) and the supplier (1−λ)Π(q,p)(1-\lambda)\Pi(q,p)(1−λ)Π(q,p). The same retailer profit is obtained from revenue sharing with ϕ=λ\phi=\lambdaϕ=λ and wr=λ(c−v)−cr+λvw_r=\lambda(c-v)-c_r+\lambda vwr​=λ(c−v)−cr​+λv. Thus every existing maximizer (q∘,p∘)(q^\circ,p^\circ)(q∘,p∘) of the integrated profit maximizes each firm's profit under the contingent buy-back. At λ=0\lambda=0λ=0 the retailer is indifferent; at λ=1\lambda=1λ=1 the supplier is indifferent.

The milestones follow the chapter's printed claims in attack order:

  1. the integrated price condition (14), p. 34;
  2. the quantity-flexibility condition (15), p. 34: price coordination forces wq=v−crw_q=v-c_rwq​=v−cr​ or δ=0\delta=0δ=0;
  3. the fixed buy-back condition (16), p. 35: price coordination forces b=−gsb=-g_sb=−gs​ and then wb=cs−gsw_b=c_s-g_swb​=cs​−gs​;
  4. the linear price-contingent terms derived from (5)–(6), p. 35;
  5. the p. 36 profit split πr=λ(Π+gμ)−grμ\pi_r=\lambda(\Pi+g\mu)-g_r\muπr​=λ(Π+gμ)−gr​μ, πs=(1−λ)Π−(λg−gr)μ\pi_s=(1-\lambda)\Pi-(\lambda g-g_r)\muπs​=(1−λ)Π−(λg−gr​)μ, valid for all goodwill penalties as an identity;
  6. the zero-goodwill revenue-sharing price claim following (17), p. 36 (the milestone quotes its restatement in §6.3.2, p. 38);
  7. the price-contingent revenue-sharing parameters, p. 37;
  8. the quantity discount wd(q)w_d(q)wd​(q), pp. 37–38: with gs=0g_s=0gs​=0 it does not distort the price, and given p∘p^\circp∘ it makes q∘q^\circq∘ optimal for both firms.

Significance

The result identifies a contract schedule under which the same quantity-price pair is best for the integrated channel and for the two firms' reported profit functions. It also explains the relation between a buy-back whose terms vary with the chosen price and a revenue-sharing arrangement. In the zero-goodwill setting, both allocate every realized choice's expected channel profit in fixed shares. The general-goodwill identity shows the additional mean-demand terms that matter when the retailer controls price.

The source presents these results analytically; this mission asks for Lean proofs of the stated price and profit relationships. A published Prove2Me definition already supplies expected sales and mean demand for a single demand law, and the model here applies those functions to each price's law. The earlier open theorem RevShareCoord.Single.price_quantity_coordination (from Cachon and Lariviere's revenue-sharing paper) treats deterministic revenue and a simpler cost convention. It is an overlap in theme, but its statement does not include price-indexed demand, salvage value, retailer cost or the contingent buy-back terms, so it is not posed again here. The new model can support further price-dependent contract comparisons in the chapter.

Difficulty

The obstacle is that matching the retailer's quantity incentive at a fixed price can change the retailer's price incentive. The buy-back rate required by the fixed-price coordination equations depends on ppp; a fixed buy-back contract therefore does not generally align both choices. Revenue sharing with goodwill penalties has a similar price dependence. The integrated profit need not be concave or unimodal in (q,p)(q,p)(q,p), so a price first-order condition by itself does not establish coordination. The chapter assumes a finite integrated optimum exists and treats the price condition as necessary, not sufficient.

Formalization scope

Lean represents price-dependent demand as a family of probability measures on R\mathbb RR, one for each price in PPP. Each admissible law is supported on nonnegative demand, has no atom at zero and has an integrable identity function, so μ(p)\mu(p)μ(p) is a genuine finite expectation. Sales are defined by Ep[min⁡(q,D)]\mathbb E_p[\min(q,D)]Ep​[min(q,D)], using the published SupplyChainTheory_contracts definition; they are not defined by the equivalent CDF integral. The admissible decisions are exactly q≥0q\ge0q≥0 and p∈Pp\in Pp∈P. Unit costs and goodwill penalties are nonnegative, each admissible price exceeds c=cs+crc=c_s+c_rc=cs​+cr​, and v<cv<cv<c, as in the model of §6.2. The chapter's standing risk-neutrality and full-information conventions appear in the use of expected profit with the same demand laws available to both firms.

There is a material qualification. With price-dependent demand, μ(p)\mu(p)μ(p) may change with ppp. The printed first-order condition (14) and the p. 36 inference from πr=λ(Π+gμ)−grμ\pi_r=\lambda(\Pi+g\mu)-g_r\muπr​=λ(Π+gμ)−gr​μ to a joint optimum omit that effect when goodwill penalties are positive. Price first-order and optimality statements here therefore use gr=gs=0g_r=g_s=0gr​=gs​=0, a case explicitly discussed in the chapter; general-goodwill claims are limited to algebraic identities. The printed p. 36 equality of price derivatives under revenue sharing also misses its factor ϕ\phiϕ, which the formal statement restores. The contingent buy-back terms are defined by the chapter's linear formulas, not by a property that hard-codes coordination. The algebraic statement permits parameter values that may violate economic buy-back bounds such as 0≤b≤wb0\le b\le w_b0≤b≤wb​; those bounds need separate checks when selecting a contract.

Two first-order statements, (15) and (16), compare price derivatives; they take the derivative of expected sales in price as a hypothesis, and (15) also takes differentiation under the integral sign of ∫(1−δ)qqF(y∣p) dy\int_{(1-\delta)q}^{q}F(y\mid p)\,dy∫(1−δ)qq​F(y∣p)dy as a disclosed regularity hypothesis. For the quantity discount, the statement claims what the page shows, undistorted prices for each qqq and optimality of q∘q^\circq∘ given p∘p^\circp∘, not joint optimality of (q∘,p∘)(q^\circ,p^\circ)(q∘,p∘) for the retailer. The page's claim that revenue sharing with goodwill coordinates only with ϕ=gr/g\phi=g_r/gϕ=gr​/g is not stated, for the mean-demand reason above.

A trivializing formalization is ruled out: no contract term is defined by the profit identity it should satisfy, the demand family cannot be replaced by a single law, and the optimal pair is a hypothesis about the integrated profit, not a chosen witness.

Reusable contributions include the price-indexed demand family, the expected-profit model with five contract types, and the price-maximizer statements. Proofs of the first-order milestones need Fermat's interior-extremum theorem on the open price set and, for (15), positivity of an interval integral; the identities need the expectation algebra of SSS and μ\muμ, including S(0,p)=0S(0,p)=0S(0,p)=0.

Selected references

  • Gérard P. Cachon, “Supply Chain Coordination with Contracts,” in Handbooks in Operations Research and Management Science, vol. 11, Supply Chain Management, North-Holland, 2003. DOI 10.1016/S0927-0507(03)11006-7. Formalization source: author's third draft, January 2003, §6.3, pp. 33–38.
  • Fernando Bernstein and Awi Federgruen, “Decentralized supply chains with competing retailers under demand uncertainty,” Management Science 51(1), 2005 (the price-discount sharing contract; cited in the draft as a 2000 working paper). DOI 10.1287/mnsc.1040.0230
  • Nicholas C. Petruzzi and Maqbool Dada, “Pricing and the newsvendor problem: a review with extensions,” Operations Research 47(2), 1999, 183–194. DOI 10.1287/opre.47.2.183
12 thms3 active usersReviewed
🏆Completed
Graph TheoryLinear OptimizationOptimization·Captain: mikedeng1

Finding Minimum-Cost Circulations by Successive Approximation II: For Real Costs, the Strongly Polynomial Loop Reaches a Minimum-Cost Circulation After at Most m⌈log₂(2n)⌉ RefinementsResearch Paper

Why minimum-cost circulation needs a real-cost iteration bound

A minimum-cost circulation is a way to send flow around a directed network while respecting capacities and paying a cost per unit on each arc. It is a basic form of network optimization: a minimum-cost flow with prescribed supplies and demands can be reduced to a circulation problem, and the circulation formulation exposes the residual arcs on which a flow can be improved. Goldberg and Tarjan's successive-approximation method relaxes exact optimality by an error parameter and repeatedly reduces that error. Its ordinary stopping rule for integer costs depends on the largest cost. For arbitrary real costs, including irrational costs, a decreasing positive error need never cross a fixed numerical cutoff. The strongly polynomial loop in their 1987 technical report, later published in Mathematics of Operations Research instead tests the smallest error parameter appropriate to the current circulation and stops when it is zero.

This mission formalizes the number of refinement calls made by that loop. It builds on the related Goldberg–Tarjan 1988 max-flow and 1989 minimum-mean cycle-canceling series: those develop different algorithms for network flow, while the published 1989 circulation and approximate-optimality definitions provide this mission's common network model. The result here concerns successive approximation and its fixed-arc progress measure.

Network and approximate optimality

The vertex set VVV is finite, with n=∣V∣n=|V|n=∣V∣, and EEE is a symmetric set of directed arcs, with m=∣E∣m=|E|m=∣E∣. Symmetry means that (v,w)∈E(v,w)\in E(v,w)∈E brings (w,v)∈E(w,v)\in E(w,v)∈E too. Each arc has a real capacity u(v,w)u(v,w)u(v,w) and a real cost c(v,w)c(v,w)c(v,w); costs obey c(v,w)=−c(w,v)c(v,w)=-c(w,v)c(v,w)=−c(w,v). A circulation fff obeys f(v,w)≤u(v,w)f(v,w)\le u(v,w)f(v,w)≤u(v,w), f(v,w)=−f(w,v)f(v,w)=-f(w,v)f(v,w)=−f(w,v), and conservation of flow at every vertex. Its total cost is half the sum of c(v,w)f(v,w)c(v,w)f(v,w)c(v,w)f(v,w) over directed arcs, since each unordered edge appears twice. A minimum-cost circulation costs no more than any other circulation of the network.

The residual capacity is uf(v,w)=u(v,w)−f(v,w)u_f(v,w)=u(v,w)-f(v,w)uf​(v,w)=u(v,w)−f(v,w). For a price function p:V→Rp:V\to\mathbb Rp:V→R, the report writes the reduced cost as cp(v,w)=c(v,w)−p(v)+p(w)c_p(v,w)=c(v,w)-p(v)+p(w)cp​(v,w)=c(v,w)−p(v)+p(w). A circulation is ε\varepsilonε-optimal with respect to ppp when every residual arc has reduced cost at least −ε-\varepsilon−ε. It is ε\varepsilonε-optimal if some price function works, where ε≥0\varepsilon\ge0ε≥0. The tight error ε(f)\varepsilon(f)ε(f) is the least such error. A circulation is ε\varepsilonε-tight when it is ε\varepsilonε-optimal but fails to be ε′\varepsilon'ε′-optimal at every ε′<ε\varepsilon'<\varepsilonε′<ε. This includes attainment at ε\varepsilonε.

An arc is ε\varepsilonε-fixed if all ε\varepsilonε-optimal circulations carry the same flow through it. Write FεF_\varepsilonFε​ for the set of these arcs. Theorem 4.2 supplies an arc-fixing criterion from a large absolute reduced cost. Lemma 4.4 says that when a positive tight error falls by a factor of 2n2n2n, FεF_\varepsilonFε​ becomes strictly larger. Both are numbered results on printed pages 16–17 of the source report's journal counterpart.

Formalization targets

The goal is the circulation-level form of Theorem 4.5. Begin with a circulation f0f_0f0​ and a sequence f0,f1,…f_0,f_1,\ldotsf0​,f1​,… whose positive-error steps satisfy the contract of Figure 3: if ε(fk)>0\varepsilon(f_k)>0ε(fk​)>0, the next circulation is ε(fk)/2\varepsilon(f_k)/2ε(fk​)/2-optimal. With the report's standing n≥2n\ge2n≥2 and m≥n−1m\ge n-1m≥n−1, the target is

∃k≤m⌈log⁡2(2n)⌉:ε(fk)=0andfk is minimum-cost.\exists k\le m\left\lceil\log_2(2n)\right\rceil:\quad \varepsilon(f_k)=0\quad\text{and}\quad f_k\text{ is minimum-cost}.∃k≤m⌈log2​(2n)⌉:ε(fk​)=0andfk​ is minimum-cost.

The milestone list contains the already proved complementary-slackness characterization of minimum cost (Theorem 2.2), the cross-parameter arc-fixing result (Theorem 4.2), and strict growth of fixed arcs (Lemma 4.4). The report states Theorem 4.5 as O(mlog⁡n)O(m\log n)O(mlogn) iterations when each refinement decreases error by a constant factor. The target makes explicit the factor two used by the paper's refinements and the resulting finite count.

What the result establishes

The theorem gives a bound on the number of refinement calls that depends on the number of vertices and arcs, not on the magnitude, precision, or integrality of the costs. It gives an exact minimum-cost circulation rather than an arbitrary small-error approximation. This distinguishes the real-cost loop from an integer-cost stopping rule based on 1/n1/n1/n. The bound counts refinement calls only; the report analyzes the work within particular implementations separately.

The published 1989 definitions and the complementary-slackness theorem already have machine-checked status on the platform. Theorem 4.2, Lemma 4.4, and this iteration theorem are the open formalization targets. A complete development will connect the tight error to residual-cycle structure, establish that its infimum is attained for circulations, and prove that zero tight error implies minimum cost. The mission thereby makes the fixed-arc argument reusable for other circulation algorithms that lower an approximate-optimality parameter.

Why the bound needs more than repeated halving

Repeatedly dividing a positive real error by two gives errors approaching zero, but it does not by itself produce a finite step with zero error. The missing finite progress is structural: an arc must become fixed after enough reductions, and only finitely many arcs exist. Proving that fixedness is strict is delicate because it compares all circulations at two different error levels, not just two consecutive flows. Theorem 4.2 is the quantitative bridge between a price certificate for one flow and agreement of an arc across every sufficiently accurate flow. At the boundary ε=0\varepsilon=0ε=0, the printed wording of Lemma 4.4 would require F0F_0F0​ to be a proper subset of itself, so its positive-error regime must be made explicit.

Formalization scope

The Lean network uses CycleCanceling.MinMean.CircNetwork with a finite vertex type, a finite symmetric arc set, and real-valued capacities, costs, and flows. Off-arc values of these functions are irrelevant. The report assumes m≥n−1≥1m\ge n-1\ge1m≥n−1≥1 on printed page 5; the theorem binders express it as n≥2n\ge2n≥2 and m≥n−1m\ge n-1m≥n−1. The arc count is for ordered arcs, exactly as the report defines mmm. No integrality, rounding, or bounded-cost hypothesis is imposed. A feasible initial circulation is required because Figure 3 starts from one; infeasibility detection is outside this target.

The reused 1989 definitions write reduced cost as c(v,w)+p(v)−p(w)c(v,w)+p(v)-p(w)c(v,w)+p(v)−p(w). Substituting −p-p−p for ppp gives the report's c(v,w)−p(v)+p(w)c(v,w)-p(v)+p(w)c(v,w)−p(v)+p(w), so existential price certificates, ε\varepsilonε-optimality, and absolute reduced-cost conditions agree. The tight error is represented by a real infimum; proving that it is attained is part of the work. The set FεF_\varepsilonFε​ is filtered from EEE and includes only arcs whose flow is shared by all ε\varepsilonε-optimal circulations. The halving run computes its error from the current circulation; it does not take an unrelated error sequence. Once that error is zero, the loop has returned and later sequence entries are unconstrained. These choices exclude a vacuous or artificially fixed error parameter and a preselected optimal flow.

The explicit reading of the report's asymptotic count is t=⌈log⁡2(2n)⌉t=\lceil\log_2(2n)\rceilt=⌈log2​(2n)⌉ halvings per factor-2n2n2n reduction and at most mmm such blocks, giving mtm tmt refinements. This is a statement about refinement count, not a RAM-operation bound. Contributions on Theorem 4.2, the residual-cycle characterization of positive tight error, the fixed-arc strictness lemma, and the final finite counting argument all support the goal. The circulation, price, and fixed-arc infrastructure can be reused beyond this particular implementation.

Selected references

  • A. V. Goldberg and R. E. Tarjan, Finding Minimum-Cost Circulations by Successive Approximation, MIT/LCS/TM-333, July 1987; journal version in Mathematics of Operations Research 15(3), 1990, pp. 430–466. DOI: 10.1287/moor.15.3.430. The mission's page and theorem indices refer to the 1987 report.
9 thms3 active usersReviewed
🏆Completed
CombinatoricsProbabilityTheoretical Computer Science·Captain: mikedeng1

Online Stochastic Matching: Beating 1-1/e 3: No Online Algorithm Beats Expected Approximation Factor 26/27 on a 6-Cycle, and None Reaches 1 − o(1) on Disjoint 6-CyclesResearch Paper

Motivation

Online bipartite matching asks an algorithm to assign arriving requests to resources it cannot reassign later. In display advertising, the requests are page views (impressions) and the resources are advertisers who have bought a fixed number of impressions in advance; each impression must be served immediately or lost. In the adversarial model, Karp, Vazirani and Vazirani (STOC 1990) showed that the RANKING algorithm achieves a 1−1/e1 - 1/e1−1/e fraction of the optimum in expectation, and that no online algorithm does better. Advertising systems, however, have historical traffic data, which motivates the i.i.d. model: the impression types are drawn independently from a distribution that is known in advance.

Feldman, Mehta, Mirrokni and Muthukrishnan (arXiv:0905.4100, FOCS 2009) were the first to beat 1−1/e1 - 1/e1−1/e in this model, with an algorithm that achieves ≈0.67\approx 0.67≈0.67 with high probability. Their Section 3 asks the complementary question: how close to 111 can any online algorithm get when the distribution is known? Their Theorem 3 answers that the expected approximation factor of every online algorithm is bounded strictly away from 111, already on a graph with six vertices. Later work in the same model (Manshadi, Oveis Gharan and Saberi, SODA 2011, arXiv:1007.1673) sharpened both the algorithmic and the hardness side.

Setting

An instance consists of a bipartite graph G=(A,I,E)G = (A, I, E)G=(A,I,E) between a finite set AAA of advertisers and a finite set III of impression types, a distribution DDD on III, and a number nnn of arrivals. In this mission DDD is the uniform distribution on III. Online, nnn impressions arrive one at a time; their types ω(0),…,ω(n−1)\omega(0), \dots, \omega(n-1)ω(0),…,ω(n−1) are independent draws from DDD. When impression ttt arrives, the algorithm must immediately either assign it to an advertiser aaa with (a,ω(t))∈E(a, \omega(t)) \in E(a,ω(t))∈E that has not yet been used, or leave it unassigned. Each advertiser can be used at most once, and decisions are final.

A deterministic online algorithm decides what to do with arrival ttt from the types ω(0),…,ω(t)\omega(0), \dots, \omega(t)ω(0),…,ω(t) seen so far; it knows GGG, DDD and nnn, but not the future. A randomized online algorithm is a probability distribution over deterministic ones. ALG(ω)\mathrm{ALG}(\omega)ALG(ω) is the number of impressions the algorithm assigns on the arrival sequence ω\omegaω. OPT(ω)\mathrm{OPT}(\omega)OPT(ω) is the size of a maximum matching of the realization graph, which has one node per arrival ttt, joined to every advertiser adjacent to ω(t)\omega(t)ω(t): the most impressions that could have been assigned with hindsight. The expected approximation factor of an algorithm is

E ⁣[ALG(ω)OPT(ω)],\mathbb E\!\left[\frac{\mathrm{ALG}(\omega)}{\mathrm{OPT}(\omega)}\right],E[OPT(ω)ALG(ω)​],

the expectation taken over the algorithm's randomness and the arrivals.

The 6-cycle instance has A={a,b,c}A = \{a, b, c\}A={a,b,c}, I={x,y,z}I = \{x, y, z\}I={x,y,z} and E={(x,a),(y,a),(y,b),(z,b),(z,c),(x,c)}E = \{(x,a),(y,a),(y,b),(z,b),(z,c),(x,c)\}E={(x,a),(y,a),(y,b),(z,b),(z,c),(x,c)}, with the uniform distribution and n=3n = 3n=3. The family Γk\Gamma_kΓk​ consists of kkk disjoint copies of the 6-cycle, with the uniform distribution on its 3k3k3k impression types and n=3kn = 3kn=3k arrivals.

Formalization targets

Goal: Theorem 3

On the 6-cycle, every randomized online algorithm satisfies

E ⁣[ALGOPT]≤2627,\mathbb E\!\left[\frac{\mathrm{ALG}}{\mathrm{OPT}}\right] \le \frac{26}{27},E[OPTALG​]≤2726​,

and there are a constant c<1c < 1c<1 and a threshold K0K_0K0​ such that for every k≥K0k \ge K_0k≥K0​ and every randomized online algorithm on Γk\Gamma_kΓk​,

E ⁣[ALGOPT]≤c.\mathbb E\!\left[\frac{\mathrm{ALG}}{\mathrm{OPT}}\right] \le c .E[OPTALG​]≤c.

The second part is the paper's "there exists a family of instances with n→∞n \to \inftyn→∞ for which no algorithm can achieve an expected approximation of 1−o(1)1 - o(1)1−o(1)", stated on the paper's own family. It leaves ccc unspecified: Appendix B estimates c≈0.9898c \approx 0.9898c≈0.9898 through approximate counts, and a sharper constant would not invalidate the goal.

Milestones

  1. The (x,y,y)(x, y, y)(x,y,y) scenario (§3, p. 4). For every deterministic online algorithm on the 6-cycle and every type uuu of the first arrival there is a type vvv with ALG(u,v,v)≤2\mathrm{ALG}(u, v, v) \le 2ALG(u,v,v)≤2 and OPT(u,v,v)=3\mathrm{OPT}(u, v, v) = 3OPT(u,v,v)=3.
  2. Theorem 3, first sentence (p. 4). The bound 26/2726/2726/27 on the 6-cycle, for every randomized online algorithm.

Significance

Theorem 3 sets the ceiling against which algorithms in the i.i.d. model are measured. It rules out an online algorithm with expected factor arbitrarily close to 111, even though the distribution is known and the instance is tiny, so a constant-factor gap between online and offline matching is intrinsic to the model and not an artefact of adversarial arrivals. The paper's positive results (1−1/e1 - 1/e1−1/e for the Suggested Matching algorithm, ≈0.67\approx 0.67≈0.67 for Two Suggested Matchings) sit between 1−1/e1 - 1/e1−1/e and this ceiling.

The single-instance bound has a short counting proof. The family statement is argued in the paper only in outline: Appendix B approximates the fractions of copies receiving 111, 222, 333 or more impressions, assumes the most favourable outcome on each, and reports the resulting ratio as approximately 0.98980.98980.9898. A machine-checked proof of the family statement would turn that sketch into a theorem with an explicit constant. To our knowledge neither part has been formalized before.

Difficulty

The single-cycle bound reduces to a finite check, but the paper's "without loss of generality (from the symmetry of the 6-cycle)" hides the cases the algorithm can choose: assigning the first impression to either neighbour, or not assigning it at all. Each case needs its own bad continuation. The passage from deterministic to randomized algorithms is an averaging step.

The family bound is harder. On Γk\Gamma_kΓk​ the algorithm sees all arrivals in all copies and may coordinate its decisions across copies, so the per-copy loss of the single cycle does not transfer by independence. Moreover the target is the expectation of a ratio, E[ALG/OPT]\mathbb E[\mathrm{ALG}/\mathrm{OPT}]E[ALG/OPT], not a ratio of expectations: a bound on the expected loss must be combined with concentration of the number of copies that receive exactly three impressions, and with a lower bound on OPT\mathrm{OPT}OPT that holds with high probability. The approximations "≃3/e3\simeq 3/e^3≃3/e3, 9/(2e3)9/(2e^3)9/(2e3), 27/(6e3)27/(6e^3)27/(6e3)" of Appendix B have unquantified errors and cannot be used as they stand.

Formalization scope

The model is formalized for general finite AAA and III with uniform arrivals. Arrival sequences are functions Fin n → I. A deterministic online algorithm is a function that receives the time ttt, the prefix of the first ttt types (Fin t → I) and the current type, and returns an advertiser or none; it cannot read later arrivals. A proposal of a non-adjacent or already used advertiser leaves the impression unassigned, so the encoding covers all online algorithms, including ones that skip an impression while a neighbour is free. A randomized online algorithm is a probability distribution (PMF) on the finite type of deterministic algorithms; by Kuhn's theorem this is equivalent to fresh random choices at each step. OPT\mathrm{OPT}OPT is the maximum size of an injective, edge-respecting partial assignment of arrivals to advertisers. The expected approximation factor is a finite average over all ∣I∣n|I|^n∣I∣n arrival sequences, weighted by the algorithm distribution.

The explicit instantiations of the paper's asymptotic wording are as follows:

  • "no algorithm can achieve an expected approximation of 1−o(1)1 - o(1)1−o(1)" becomes ∃ c<1, ∃K0, ∀k≥K0, ∀P: E[ALG/OPT]≤c\exists\, c < 1,\ \exists K_0,\ \forall k \ge K_0,\ \forall P:\ \mathbb E[\mathrm{ALG}/\mathrm{OPT}] \le c∃c<1, ∃K0​, ∀k≥K0​, ∀P: E[ALG/OPT]≤c on Γk\Gamma_kΓk​, with n=3kn = 3kn=3k tied to kkk, and with ccc and K0K_0K0​ chosen before kkk and before the algorithm.
  • The paper's constant 0.98980.98980.9898 is not part of the statement.

Lean's division sets x/0=0x/0 = 0x/0=0. A formalization of the form "there is an instance on which every algorithm has expected factor at most 26/2726/2726/27" would be satisfied trivially by a graph without edges, where OPT=0\mathrm{OPT} = 0OPT=0; the statements here are on the paper's explicit instances, where every impression type has an adjacent advertiser and OPT≥1\mathrm{OPT} \ge 1OPT≥1 on every arrival sequence.

A complete development needs finite case analysis on runs of online algorithms, averaging over mixed strategies, and, for the family, concentration inequalities for occupancy counts (Azuma or McDiarmid, both available on the platform) together with bounds on maximum matchings of disjoint unions. The online-algorithm model and the averaging lemmas are reusable for other lower bounds in the i.i.d. model. Proofs of either milestone, and independent proofs of the family statement with any explicit c<1c < 1c<1, are welcome.

Selected references

  • J. Feldman, A. Mehta, V. Mirrokni, S. Muthukrishnan, Online Stochastic Matching: Beating 1-1/e, FOCS 2009; arXiv:0905.4100v1. https://arxiv.org/abs/0905.4100
  • R. M. Karp, U. V. Vazirani, V. V. Vazirani, An optimal algorithm for on-line bipartite matching, STOC 1990. https://doi.org/10.1145/100216.100262
  • V. H. Manshadi, S. Oveis Gharan, A. Saberi, Online Stochastic Matching: Online Actions Based on Offline Statistics, SODA 2011; arXiv:1007.1673. https://arxiv.org/abs/1007.1673
5 thms3 active usersReviewed
🏆Completed
Dynamic ProgrammingOptimization·Captain: mikedeng1

Contraction Mappings in the Theory Underlying Dynamic Programming 2: Under N-Stage Contraction and Monotonicity the Optimal Return Is the Unique Fixed Point of the Maximization OperatorResearch Paper

Motivation

Infinite-horizon dynamic programs, including discounted Markov decision processes, stochastic games and semi-Markov models, are usually analysed through a single equation: the optimal return fff solves the optimality equation v=Avv = Avv=Av, where AAA maximizes the one-step return over decisions. Denardo's 1967 paper (SIAM Review 9(2), 165–177) separated the argument from the particular model. It isolated two properties of an abstract return hhh, contraction and monotonicity, and showed that the standard conclusions follow from them alone. The examples of §8 of the paper cover Howard's discounted model, Shapley's stochastic games and Blackwell's, Jewell's and Fox's models.

The plain contraction assumption (each one-step operator shrinks distances by a factor c<1c<1c<1) fails in models where the process stops only from a subset of states, or where discounting acts only after several transitions. §5 of the paper handles these with the N-stage contraction assumption: only NNN steps of a policy need to contract, while one step only needs to be nonexpansive. This mission formalizes that section. Its companion mission (part 1 of the series) formalizes the plain contraction case.

Timeline:

  • 1953: Shapley proves that the value of a discounted stochastic game is the fixed point of a contraction.
  • 1960: Howard introduces policy iteration for finite discounted Markov decision processes.
  • 1962–1965: Blackwell studies discrete and discounted dynamic programming, including the existence of optimal stationary policies.
  • 1967: Denardo, in this paper, states the contraction and monotonicity assumptions for an abstract return and proves Theorems 1–4.
  • 1977: Bertsekas, "Monotone mappings with application in dynamic programming", drops contraction and keeps only monotonicity.

Setting

Let Ω\OmegaΩ be a set of points. Each point xxx has a decision set DxD_xDx​. A policy δ\deltaδ picks a decision δx∈Dx\delta_x\in D_xδx​∈Dx​ at every point, so the policy space is Δ=×x∈ΩDx\Delta=\times_{x\in\Omega}D_xΔ=×x∈Ω​Dx​. Let VVV be the bounded real functions on Ω\OmegaΩ with the metric ρ(u,v)=sup⁡x∣u(x)−v(x)∣\rho(u,v)=\sup_x|u(x)-v(x)|ρ(u,v)=supx​∣u(x)−v(x)∣; VVV is complete. Write u≥vu\ge vu≥v when u(x)≥v(x)u(x)\ge v(x)u(x)≥v(x) for every xxx.

The return hhh assigns a real number h(x,dx,v)h(x,d_x,v)h(x,dx​,v) to each point xxx, decision dx∈Dxd_x\in D_xdx​∈Dx​ and v∈Vv\in Vv∈V. It defines two kinds of operators on VVV:

[Hδv](x)=h(x,δx,v),(Av)(x)=sup⁡dx∈Dxh(x,dx,v),[H_\delta v](x)=h(x,\delta_x,v),\qquad (Av)(x)=\sup_{d_x\in D_x}h(x,d_x,v),[Hδ​v](x)=h(x,δx​,v),(Av)(x)=dx​∈Dx​sup​h(x,dx​,v),

and both are assumed to map VVV into VVV. An operator BBB on VVV has modulus ccc or less when ρ(Bu,Bv)≤c ρ(u,v)\rho(Bu,Bv)\le c\,\rho(u,v)ρ(Bu,Bv)≤cρ(u,v) for all u,vu,vu,v.

  • Monotonicity assumption: if u≥vu\ge vu≥v then Hδu≥HδvH_\delta u\ge H_\delta vHδ​u≥Hδ​v for every δ\deltaδ.
  • N-stage contraction assumption: for a positive integer NNN and a number c<1c<1c<1, both independent of δ\deltaδ, every HδNH_\delta^NHδN​ has modulus ccc or less and every HδH_\deltaHδ​ has modulus 111 or less.

Under these assumptions HδNH_\delta^NHδN​ is a contraction, so it has a unique fixed point vδv_\deltavδ​, the return function of δ\deltaδ. The optimal return is f(x)=sup⁡δvδ(x)f(x)=\sup_\delta v_\delta(x)f(x)=supδ​vδ​(x). The auxiliary operator EEE is (Ev)(x)=sup⁡δ(HδNv)(x)(Ev)(x)=\sup_\delta(H_\delta^Nv)(x)(Ev)(x)=supδ​(HδN​v)(x).

Formalization targets

Goal: Theorem 4 (p. 169)

Under the monotonicity and N-stage contraction assumptions:

(a) Hδvδ=vδ and vδ is the only fixed point of Hδ;(b) ρ(vδ,v)≤ρ(Hδv,v) N1−c;\text{(a) } H_\delta v_\delta=v_\delta \text{ and } v_\delta \text{ is the only fixed point of } H_\delta;\qquad \text{(b) } \rho(v_\delta,v)\le\frac{\rho(H_\delta v,v)\,N}{1-c};(a) Hδ​vδ​=vδ​ and vδ​ is the only fixed point of Hδ​;(b) ρ(vδ​,v)≤1−cρ(Hδ​v,v)N​; (c) E has modulus c or less;(d) f∈V, Ef=f, Af=f,  and f is the only fixed point of E and of A;\text{(c) } E \text{ has modulus } c \text{ or less};\qquad \text{(d) } f\in V,\ Ef=f,\ Af=f,\ \text{ and } f \text{ is the only fixed point of } E \text{ and of } A;(c) E has modulus c or less;(d) f∈V, Ef=f, Af=f,  and f is the only fixed point of E and of A; (e) v≤f ⟹ ρ(ANv,f)≤c ρ(v,f).\text{(e) } v\le f\ \Longrightarrow\ \rho(A^Nv,f)\le c\,\rho(v,f).(e) v≤f ⟹ ρ(ANv,f)≤cρ(v,f).

Milestones

  1. The observation at the end of §3 (p. 168): if every operator in a nonempty family has modulus ccc or less, then their pointwise supremum has modulus ccc or less, provided it maps VVV into VVV.
  2. Lemma 1 (p. 168): under monotonicity, AAA is monotone; Av≥vAv\ge vAv≥v implies that AnvA^nvAnv is nondecreasing in nnn; Hδv≥vH_\delta v\ge vHδ​v≥v implies that HδnvH_\delta^nvHδn​v is nondecreasing in nnn.
  3. Theorem 4 (a)–(c), the part the paper proves in the text of §5 before stating the theorem. This milestone also includes the existence of EEE as an operator on VVV and f∈Vf\in Vf∈V.
  4. Lemma 2 (p. 169): Av≤vAv\le vAv≤v implies v≥fv\ge fv≥f, and Av≥vAv\ge vAv≥v implies v≤fv\le fv≤f; Avδ≥vδAv_\delta\ge v_\deltaAvδ​≥vδ​; Hδv≥vH_\delta v\ge vHδ​v≥v implies vδ≥Hδvv_\delta\ge H_\delta vvδ​≥Hδ​v.

The mission also contains two consequences that are not milestones: fff is optimal for the mathematical programs min⁡v\min vminv s.t. Av≤vAv\le vAv≤v and max⁡v\max vmaxv s.t. Av≥vAv\ge vAv≥v (§6, p. 171), and a policy is optimal exactly when it attains f(x)=h(x,δx,f)f(x)=h(x,\delta_x,f)f(x)=h(x,δx​,f) at every point (§7, p. 173).

Significance

Theorem 4 lets models whose one-step operators are not contractions use the contraction-mapping theory of dynamic programming. Under its hypotheses the optimality equation v=Avv=Avv=Av has exactly one bounded solution, and that solution is the optimal return. Successive approximation converges geometrically from below (part (e)). Lemma 2 shows that fff is the least vvv with Av≤vAv\le vAv≤v and the greatest vvv with Av≥vAv\ge vAv≥v. This gives the linear-programming formulation of finite Markov decision processes (Program I) and the policy-improvement argument of §6. The characterization Δ∗=Δ+\Delta^*=\Delta^+Δ∗=Δ+ reduces the search for optimal policies to the decisions that attain the maximum in the optimality equation.

The results are proved in the paper. The work of this mission is to formalize them, in the abstract form that Mathlib does not have: monotone operators on bounded functions that are contractive only after NNN steps, with suprema taken over arbitrary, possibly infinite, decision and policy sets. No machine-checked proof of Theorem 4 or of Lemma 2 is known. The closest formal statements, Propositions 4.1–4.2 of Bertsekas and Shreve under their Assumption C, concern a different model (extended-real costs, nonstationary policies) and are themselves unproved formally.

Difficulty

The obvious argument would apply the Banach fixed-point theorem to AAA. That does not work: under the N-stage assumption, ANA^NAN need not be a contraction. The paper gives an example (p. 170) with N=2N=2N=2, c=12c=\tfrac12c=21​, where AnA^nAn has modulus 111 for every nnn. The supremum over decisions does not commute with composition, so the contraction of each HδNH_\delta^NHδN​ says nothing directly about ANA^NAN. The paper therefore works through the auxiliary operator EEE, which is a contraction. The hard step is to show that fff, the supremum of the policy returns, is a fixed point of AAA. This is the second half of Lemma 2(a), an ε\varepsilonε-argument that uses both monotonicity and the modulus-111 bound on HδH_\deltaHδ​.

Part (e) holds only for v≤fv\le fv≤f. It is not a contraction property of ANA^NAN on all of VVV.

Formalization scope

  • VVV is lp (fun _ : Ω => ℝ) ⊤ (as BFun Ω), and its dist is ρ\rhoρ. The order is pointwise (PLe).
  • HHH, AAA and EEE are given as functions V→VV\to VV→V, which is the paper's "range contained in VVV". They are tied to hhh by IsPolicyOperator, IsMaxOperator and IsNStageSupOperator. Every supremum, including fff (IsOptimalReturn), is a genuine least upper bound (IsLUB). sSup/⨆ are never used, so no junk value can make a statement trivial.
  • "Modulus ccc or less" is the inequality ModulusLE B c. NStageContractionAssumption H N c holds 0<N0<N0<N, c<1c<1c<1, ModulusLE (H δ)^[N] c and ModulusLE (H δ) 1, with NNN and ccc independent of δ\deltaδ.
  • The return functions are a family v with HδNvδ=vδH_\delta^Nv_\delta=v_\deltaHδN​vδ​=vδ​, the paper's §5 definition. Hδvδ=vδH_\delta v_\delta=v_\deltaHδ​vδ​=vδ​ is the conclusion (a), never a hypothesis.
  • In the goal, EEE is an operator with IsNStageSupOperator H N E. The milestone Theorem 4 (a)–(c) proves that such an operator exists. fff is never defined as a fixed point of AAA or EEE. The goal asserts that the pointwise least upper bound of {vδ(x)}\{v_\delta(x)\}{vδ​(x)} exists in VVV and is the unique fixed point of both.
  • The trivializing formalizations are ruled out explicitly: assuming Hδvδ=vδH_\delta v_\delta=v_\deltaHδ​vδ​=vδ​, defining fff as AAA's fixed point, or dropping v≤fv\le fv≤f from (e) would each change the theorem.

A complete development needs the Banach fixed-point theorem for iterates (Mathlib's ContractingWith, applied to HδNH_\delta^NHδN​), suprema of families of real numbers, and induction on iterates. The §3 observation and Lemma 1 are reusable for any monotone operator family on bounded functions. Contributions to every milestone and to the two §6–§7 consequences are welcome.

Selected references

  • E. V. Denardo, Contraction Mappings in the Theory Underlying Dynamic Programming, SIAM Review 9(2) (1967) 165–177. https://doi.org/10.1137/1009030
  • L. S. Shapley, Stochastic Games, Proc. Nat. Acad. Sci. 39 (1953) 1095–1100. https://doi.org/10.1073/pnas.39.10.1095
  • R. A. Howard, Dynamic Programming and Markov Processes, MIT Press, 1960.
  • D. Blackwell, Discounted Dynamic Programming, Ann. Math. Statist. 36 (1965) 226–235. https://doi.org/10.1214/aoms/1177700285
  • D. P. Bertsekas, Monotone Mappings with Application in Dynamic Programming, SIAM J. Control Optim. 15(3) (1977) 438–464. https://doi.org/10.1137/0315031
7 thms3 active usersReviewed
🏆Completed
Dynamical SystemsStochastic Systems·Captain: mikedeng1

Stability and Instability of Fluid Models for Reentrant Lines 1: Every Work-Conserving Fluid Model of the Three-Buffer Line 1→2→1 Is Stable When m₁ + m₃ < 1 and m₂ < 1Research Paper

Why reentrant lines, and why this one

A reentrant line is a queueing network in which every job follows the same route and visits some stations more than once. It is the standard model of a semiconductor wafer fab, where a wafer returns to the same lithography station for each of its layers (Kumar, Re-entrant lines, Queueing Systems 13, 1993). Because jobs at different stages compete for the same server, a network can be unstable (queues grow without bound) even though every station has nominal load below one; the Lu–Kumar and Rybko–Stolyar examples of the early 1990s made this concrete. Deciding stability under the usual load condition therefore needs an argument specific to the network and to the scheduling policy.

Fluid models turn that question into one about deterministic dynamics. Dai (Dai, On positive Harris recurrence of multiclass queueing networks: a unified approach via fluid limit models, Ann. Appl. Probab. 5, 1995) showed that if the fluid model of a queueing discipline is stable, the queueing network under that discipline is positive Harris recurrent. Dai and Weiss (1996) then proved fluid stability, or instability, for several classes of reentrant lines. This mission formalizes their first result, about the smallest reentrant line that revisits a station after visiting another one.

Timeline:

  • 1993: Kumar conjectured that the three-buffer line 1→2→11 \to 2 \to 11→2→1 is stable under the first-in-first-out (FIFO) discipline whenever the load condition holds, for exponential distributions.
  • 1993: Wang proved that the FIFO fluid model of this line is stable, which with Dai's theorem confirms the conjecture.
  • 1996: Dai and Weiss (Theorem 3.1) proved stability of the fluid model for every work-conserving discipline, with an explicit emptying time.

Setting

A reentrant line has III stations and KKK classes. Fluid enters as class 111 at rate one; class kkk is served at station σ(k)\sigma(k)σ(k) with mean service time mk>0m_k > 0mk​>0 and service rate μk=1/mk\mu_k = 1/m_kμk​=1/mk​, and on completion becomes class k+1k+1k+1 (class KKK leaves). The constituency of station iii is Ci={k:σ(k)=i}C_i = \{k : \sigma(k) = i\}Ci​={k:σ(k)=i}, and its nominal workload is ρi=∑k∈Cimk\rho_i = \sum_{k\in C_i} m_kρi​=∑k∈Ci​​mk​.

A fluid model solution is a pair of paths Q(t)∈RKQ(t) \in \mathbb R^KQ(t)∈RK (fluid levels) and T(t)∈RKT(t) \in \mathbb R^KT(t)∈RK (cumulative time spent serving each class) such that, for t≥0t \ge 0t≥0:

Qk(t)=Qk(0)+μk−1Tk−1(t)−μkTk(t)(μ0T0(t)=t),Qk(t)≥0,Q_k(t) = Q_k(0) + \mu_{k-1}T_{k-1}(t) - \mu_k T_k(t)\quad(\mu_0T_0(t) = t),\qquad Q_k(t) \ge 0,Qk​(t)=Qk​(0)+μk−1​Tk−1​(t)−μk​Tk​(t)(μ0​T0​(t)=t),Qk​(t)≥0,

each TkT_kTk​ starts at 000 and is nondecreasing, and the idle time Ui(t)=t−Bi(t)U_i(t) = t - B_i(t)Ui​(t)=t−Bi​(t), with busy time Bi(t)=∑k∈CiTk(t)B_i(t) = \sum_{k \in C_i} T_k(t)Bi​(t)=∑k∈Ci​​Tk​(t), is nondecreasing. These are the paper's equations (1.8)–(1.12). The solution is work conserving if, in addition, (1.13): UiU_iUi​ increases only at times when station iii holds no fluid. The immediate volume of station iii is Wi(t)=∑k∈CimkQk(t)W_i(t) = \sum_{k \in C_i} m_k Q_k(t)Wi​(t)=∑k∈Ci​​mk​Qk​(t).

A set of fluid model solutions is stable (Definition 1.3) if there is a δ>0\delta > 0δ>0 such that every solution with ∣Q(0)∣=∑kQk(0)=1|Q(0)| = \sum_k Q_k(0) = 1∣Q(0)∣=∑k​Qk​(0)=1 has Q(t)=0Q(t) = 0Q(t)=0 for all t≥δt \ge \deltat≥δ.

The three-buffer line of Figure 1 has I=2I = 2I=2, K=3K = 3K=3 and route 1→2→11 \to 2 \to 11→2→1: classes 111 and 333 at station 111, class 222 at station 222. The load condition (3.1) is

ρ1=m1+m3<1,ρ2=m2<1.\rho_1 = m_1 + m_3 < 1, \qquad \rho_2 = m_2 < 1 .ρ1​=m1​+m3​<1,ρ2​=m2​<1.

Formalization targets

Goal: Theorem 3.1

m1,m2,m3>0,  m1+m3<1,  m2<1 ⟹ the work-conserving fluid model (1.8)–(1.13) of 1→2→1 is stable.m_1, m_2, m_3 > 0,\ \ m_1 + m_3 < 1,\ \ m_2 < 1 \ \Longrightarrow\ \text{the work-conserving fluid model (1.8)–(1.13) of } 1 \to 2 \to 1 \text{ is stable.}m1​,m2​,m3​>0,  m1​+m3​<1,  m2​<1 ⟹ the work-conserving fluid model (1.8)–(1.13) of 1→2→1 is stable.

The goal fixes no emptying time: it asserts only that some δ>0\delta > 0δ>0 works, which is Definition 1.3.

Milestones, in attack order

  1. Lemma 2.2 (ii): a nonnegative absolutely continuous ggg with g˙(t)≤−ε\dot g(t) \le -\varepsilong˙​(t)≤−ε almost everywhere where g(t)>0g(t) > 0g(t)>0 vanishes from g(0)/εg(0)/\varepsilong(0)/ε on, and is nonincreasing.
  2. Display (3.2) (already proved on the platform): at a regular point, the maximum of finitely many functions has the derivative of every component that attains it.
  3. Lemma 3.2: for nonnegative linear functions GiG_iGi​ of QQQ with (a) G˙i≤−εi\dot G_i \le -\varepsilon_iG˙i​≤−εi​ while Wi>0W_i > 0Wi​>0 and (b) Gi≤min⁡j≠iGjG_i \le \min_{j \ne i} G_jGi​≤minj=i​Gj​ while Wi=0W_i = 0Wi​=0, the maximum GGG is absolutely continuous and nonnegative, and G˙(t)≤−min⁡iεi\dot G(t) \le -\min_i \varepsilon_iG˙(t)≤−mini​εi​ at regular points with G(t)>0G(t) > 0G(t)>0.
  4. Drift identity (proof of Theorem 3.1): with θ=m1/(m1+m3)\theta = m_1/(m_1+m_3)θ=m1​/(m1​+m3​), G1=θQ1++(1−θ)Q3+G_1 = \theta Q_1^+ + (1-\theta)Q_3^+G1​=θQ1+​+(1−θ)Q3+​ and G2=Q2+G_2 = Q_2^+G2​=Q2+​, where Qk+=∑l≤kQlQ_k^+ = \sum_{l \le k} Q_lQk+​=∑l≤k​Ql​, one has Gi(t)=Gi(0)+t−Bi(t)/ρiG_i(t) = G_i(0) + t - B_i(t)/\rho_iGi​(t)=Gi​(0)+t−Bi​(t)/ρi​.
  5. Drift rate: G˙i(t)=−(1/ρi−1)<0\dot G_i(t) = -(1/\rho_i - 1) < 0G˙i​(t)=−(1/ρi​−1)<0 whenever Wi(t)>0W_i(t) > 0Wi​(t)>0.
  6. Condition (b): W1(t)=0⇒G1(t)≤G2(t)W_1(t) = 0 \Rightarrow G_1(t) \le G_2(t)W1​(t)=0⇒G1​(t)≤G2​(t) and W2(t)=0⇒G2(t)≤G1(t)W_2(t) = 0 \Rightarrow G_2(t) \le G_1(t)W2​(t)=0⇒G2​(t)≤G1​(t).
  7. Emptying time: every work-conserving solution with ∣Q(0)∣=1|Q(0)| = 1∣Q(0)∣=1 is empty from max⁡{ρ1/(1−ρ1),ρ2/(1−ρ2)}\max\{\rho_1/(1-\rho_1), \rho_2/(1-\rho_2)\}max{ρ1​/(1−ρ1​),ρ2​/(1−ρ2​)} on.

Significance

Theorem 3.1 settles stability of the three-buffer line for every work-conserving discipline at once, not only FIFO. Through Dai's 1995 theorem it gives positive Harris recurrence of the queueing network under any such discipline whose fluid limits satisfy (1.8)–(1.13), under that theorem's distributional assumptions. By the paper's remark after the proof, every other three-buffer reentrant line is feedforward, so with this theorem all three-buffer reentrant lines are stable under every work-conserving policy. The method, a Lyapunov function that is the maximum of linear functions of the fluid levels, recurs in the paper's later theorems (Lu–Kumar network, two-station Kelly-type lines) and in the wider fluid-stability literature.

The result is proved on paper; no machine-checked version exists. The mission's contribution is a formal fluid-model layer for reentrant lines (equations (1.8)–(1.13), Definition 1.3) shared with the other missions of this series, two reusable real-analysis lemmas (Lemma 2.2 (ii) and Lemma 3.2), and a complete formal proof of Theorem 3.1. The fluid-limit theorem linking fluid stability to the stochastic network is cited, not formalized.

Difficulty

The obvious approach is to split cases on the relative loads, as the paper notes (m1+m3/m2<1m_1 + m_3/m_2 < 1m1​+m3​/m2​<1 or not), and track the fluid explicitly; this gives sharp emptying times but requires following solutions through regime changes, which is unwieldy when the discipline is arbitrary. The Lyapunov approach avoids this but moves the difficulty into analysis: the fluid paths are only Lipschitz, so derivatives exist only almost everywhere; the maximum of two Lyapunov components is not differentiable where they cross; and work conservation is a statement about where the idle time can increase, which has to be converted into "the busy time grows at rate one" at points where a station holds fluid. Lemma 2.2 (ii) itself needs the fundamental theorem of calculus for absolutely continuous functions.

Formalization scope

All declarations live in DaiWeissFluid.ThreeBuffer. Committed conventions:

  • Classes and stations are 0-based (Fin 3, Fin 2). The paper's class kkk is Lean k - 1; the line is threeBuffer m with station map ![0, 1, 0], and (3.1) reads m 0 + m 2 < 1, m 1 < 1.
  • Paths are total functions ℝ → Fin K → ℝ; every equation is imposed only for t≥0t \ge 0t≥0, and derivatives are taken at t>0t > 0t>0 (HasDerivAt).
  • Work conservation (1.13) is in interval form: UiU_iUi​ is constant on every interval [s,t]⊆[0,∞)[s,t] \subseteq [0,\infty)[s,t]⊆[0,∞) on which station iii holds fluid throughout. This is equivalent to the paper's integral condition for continuous paths.
  • No Lipschitz continuity is assumed; it follows from (1.10)–(1.12).
  • mk>0m_k > 0mk​>0 is an explicit hypothesis (the paper takes it for granted). ∣Q(0)∣=∑kQk(0)|Q(0)| = \sum_k Q_k(0)∣Q(0)∣=∑k​Qk​(0).
  • Lemma 2.2 (ii) is stated with g˙(t)≤−ε\dot g(t) \le -\varepsilong˙​(t)≤−ε; the paper prints <<<, but every application uses ≤\le≤, and the stated version is the stronger lemma.
  • Lemma 3.2 is stated for any reentrant line with I≥1I \ge 1I≥1 stations, assuming only (1.8)–(1.12), as in the paper.

A trivializing formalization is ruled out: the work-conserving solution set of the three-buffer line is nonempty for every mmm satisfying (3.1), with ∣Q(0)∣=1|Q(0)| = 1∣Q(0)∣=1 (a sorry-free witness was checked), so the goal is not vacuous, and the goal quantifies over all work-conserving solutions rather than one discipline.

Needed infrastructure: Lipschitz and absolute continuity of the fluid paths, the a.e. fundamental theorem of calculus for absolutely continuous functions (in Mathlib), and the derivative of a finite maximum at a regular point (on the platform as display (3.2)). Lemma 2.2 (ii) and Lemma 3.2 are reusable for the other missions of the series. Proofs of any milestone are welcome independently.

Selected references

  • J. G. Dai and G. Weiss, Stability and instability of fluid models for reentrant lines, Mathematics of Operations Research 21(1), 115–134, 1996. https://doi.org/10.1287/moor.21.1.115
  • J. G. Dai, On positive Harris recurrence of multiclass queueing networks: a unified approach via fluid limit models, Annals of Applied Probability 5(1), 49–77, 1995. https://doi.org/10.1214/aoap/1177004828
  • P. R. Kumar, Re-entrant lines, Queueing Systems 13, 87–110, 1993. https://doi.org/10.1007/BF01158927
  • A. N. Rybko and A. L. Stolyar, Ergodicity of stochastic processes describing the operation of open queueing networks, Problems of Information Transmission 28, 199–220, 1992.
  • D. D. Botvich and A. A. Zamyatin, Ergodicity of conservative communication networks, Rapport de recherche 1772, INRIA, 1992.
10 thms3 active usersReviewed
🏆Completed
Dynamic ProgrammingOptimizationProbability·Captain: mikedeng1

Coordinating Inventory Control and Pricing Strategies with Random Demand and Fixed Ordering Cost: The Finite Horizon Case 2: General Demand: Sym-k-Concave Profit-to-Go, Optimal (s, S, A, p) PolicyResearch Paper

Motivation

A seller with replenishable inventory must decide how much to order and what price to charge before demand is known. A price that increases current revenue can also change the inventory left for later periods; a fixed charge for placing any positive order adds a discontinuity to the decision. Chen and Simchi-Levi study this coordination problem over a finite horizon with backlogging and random, price-dependent demand. Their general-demand result characterizes an optimal order-and-price policy even when a conventional two-threshold ordering rule can fail. The paper gives explicit counterexamples to ordinary kkk-concavity and to optimality of a standard (s,S,p)(s,S,p)(s,S,p) policy in this setting (Chen and Simchi-Levi, 2004, §4, Lemmas 3–4).

Setting

There are periods t=1,…,Tt=1,\ldots,Tt=1,…,T. At the start of period ttt, the firm has inventory xxx, which may be negative because unmet demand is backlogged. It may order to any level y≥xy\ge xy≥x. If y>xy>xy>x, it pays a fixed ordering cost kkk as well as a variable cost ct(y−x)c_t(y-x)ct​(y−x). After ordering it chooses an expected demand level ddd in a closed interval [d‾t,d‾t][\underline d_t,\overline d_t][d​t​,dt​]. The corresponding price is Pt(d)P_t(d)Pt​(d), the inverse of the period's decreasing demand curve, and expected revenue is Rt(d)=dPt(d)R_t(d)=dP_t(d)Rt​(d)=dPt​(d).

Actual demand is αtd+βt\alpha_t d+\beta_tαt​d+βt​. The random pair (αt,βt)(\alpha_t,\beta_t)(αt​,βt​) has a period-dependent law μt\mu_tμt​, with E[αt]=1\mathbb E[\alpha_t]=1E[αt​]=1 and E[βt]=0\mathbb E[\beta_t]=0E[βt​]=0. No sign restriction is placed on αt\alpha_tαt​ in the paper's general model. The inventory after demand is y−αtd−βty-\alpha_t d-\beta_ty−αt​d−βt​, incurring a convex holding or backlog cost hth_tht​ and entering the next period. The paper assumes the random perturbations are independent across periods. Its Bellman equation uses their individual period laws (Chen and Simchi-Levi, 2004, §2, Assumptions 1–5).

The profit-to-go vt(x)v_t(x)vt​(x) starts with vT+1(x)=0v_{T+1}(x)=0vT+1​(x)=0. For a post-order inventory yyy and expected demand ddd, write

gt(y,d)=Rt(d)−cty+E[−ht(y−αtd−βt)+vt+1(y−αtd−βt)].g_t(y,d)=R_t(d)-c_ty+\mathbb E[-h_t(y-\alpha_t d-\beta_t)+v_{t+1}(y-\alpha_t d-\beta_t)].gt​(y,d)=Rt​(d)−ct​y+E[−ht​(y−αt​d−βt​)+vt+1​(y−αt​d−βt​)].

The firm maximizes gt(y,d)g_t(y,d)gt​(y,d) over admissible ddd and then maximizes the resulting value, less the fixed ordering charge, over y≥xy\ge xy≥x. This defines vt(x)v_t(x)vt​(x) by equation (2) of the paper. A symmetrically kkk-convex real function fff satisfies

f((1−λ)x0+λx1)≤(1−λ)f(x0)+λf(x1)+max⁡{λ,1−λ}kf((1-\lambda)x_0+\lambda x_1)\le(1-\lambda)f(x_0)+\lambda f(x_1)+\max\{\lambda,1-\lambda\}kf((1−λ)x0​+λx1​)≤(1−λ)f(x0​)+λf(x1​)+max{λ,1−λ}k

for every x0,x1∈Rx_0,x_1\in\mathbb Rx0​,x1​∈R and λ∈[0,1]\lambda\in[0,1]λ∈[0,1]. A function is symmetrically kkk-concave when its negative is symmetrically kkk-convex. This is Definition 4.1, equation (8), and preserves the symmetry between the two endpoint inventories (Chen and Simchi-Levi, 2004, p. 891).

Formalization targets

The goal is Theorem 4.1(c)–(d). If Gt(y)=max⁡d∈[d‾t,d‾t]gt(y,d)G_t(y)=\max_{d\in[\underline d_t,\overline d_t]}g_t(y,d)Gt​(y)=maxd∈[d​t​,dt​]​gt​(y,d), then for every period

Gt and vt are symmetrically k-concave.G_t\text{ and }v_t\text{ are symmetrically }k\text{-concave}.Gt​ and vt​ are symmetrically k-concave.

There are thresholds st≤Sts_t\le S_tst​≤St​ and a possibly empty set At⊆[st,(st+St)/2]A_t\subseteq[s_t,(s_t+S_t)/2]At​⊆[st​,(st​+St​)/2]. An optimal policy orders to StS_tSt​ if x<stx<s_tx<st​ or x∈Atx\in A_tx∈At​, and places no order otherwise. It chooses the maximizing expected demand for the resulting post-order level. In particular, all states that order to StS_tSt​ can use the same demand level dt(St)d_t(S_t)dt​(St​) and hence the same price Pt(dt(St))P_t(d_t(S_t))Pt​(dt​(St​)).

The milestones state the preceding polynomial growth and continuity assertions from Theorem 4.1(a)–(b), the threshold structure of Lemma 5(d), and the named steps in the proof on p. 892. The link from the paper's earlier kkk-convexity to symmetric kkk-convexity is also included. These targets preserve the paper's general demand law rather than restricting it to the additive case.

Significance

The theorem describes an optimal decision at every inventory level under random price-dependent demand. The exceptional set AtA_tAt​ records states where ordering to StS_tSt​ is optimal inside the interval where a single reorder threshold need not describe all optimal actions. Thus the result retains a concise policy description while allowing the behavior exhibited by the paper's counterexamples (Chen and Simchi-Levi, 2004, §4).

Formalizing the result requires a reusable account of symmetric kkk-convexity, a fixed-cost ordering envelope, and a finite-horizon Bellman recursion with real-valued expectations. The source proves Theorem 4.1 on paper. This mission poses its statements as Lean goals; the theorem files currently contain sorry and therefore are not machine-checked proofs. The published platform definition BertsekasKConvex supplies the earlier notion from Definition 2.1, so the bridge to Definition 4.1 can be stated without duplicating it.

Difficulty

In the additive-demand case, a maximizing expected-demand choice can be selected so that post-demand inventory changes monotonically with the initial inventory. For general demand αtd+βt\alpha_t d+\beta_tαt​d+βt​, that monotonicity can fail: the random multiplier changes how a pricing choice moves the next inventory state. The earlier ordered-chord kkk-concavity argument therefore does not carry over unchanged. A second issue is the fixed ordering charge. It creates ties between ordering and not ordering, so the policy region can include isolated or noninterval states within [st,(st+St)/2][s_t,(s_t+S_t)/2][st​,(st​+St​)/2]. The statement must assert Bellman optimality at every xxx, including those ties, rather than only the geometry of AtA_tAt​ (Chen and Simchi-Levi, 2004, pp. 891–892).

Formalization scope

The Lean model uses expected demand ddd as the decision variable and obtains price from Pt(d)P_t(d)Pt​(d), matching the paper's reformulation after Assumption 5. The admissible demand interval is nonempty. Periods are natural numbers 1,…,T1,\ldots,T1,…,T, with T>0T>0T>0 and terminal value vT+1=0v_{T+1}=0vT+1​=0. Random demand is integrated against a probability measure on R×R\mathbb R\times\mathbb RR×R. The first moments and the paper's demand moment condition are explicit; holding-cost and continuation integrability prevent a nonintegrable real integral from acquiring Lean's default zero value. The paper's O(∣y∣ρ)O(|y|^\rho)O(∣y∣ρ) statements are encoded by constants multiplying 1+∣y∣ρ1+|y|^\rho1+∣y∣ρ.

The formal assumptions include k≥0k\ge0k≥0 and ct≥0c_t\ge0ct​≥0, and set cT+1=0c_{T+1}=0cT+1​=0 where the paper's Assumption 3 uses that otherwise undefined terminal coefficient. The latter two restrictions make the printed finite-horizon claim valid under its cost interpretation; they are stated rather than silently supplied. The paper assumes temporal independence, while the formal Bellman recursion starts from the marginal laws and so needs no separate joint process. The paper's (y,p)(y,p)(y,p) in Theorem 4.1(b) is expressed as (y,d)(y,d)(y,d) through the continuous one-to-one price–expected-demand correspondence. The model places no positivity condition on αt\alpha_tαt​.

The optimized demand value and ordering value are real suprema. The statements include maximizing choices and Bellman attainment; a proof cannot rely on a default value for an empty or unbounded supremum. The goal requires an actual optimal action for every inventory state. Contributions that establish integrability, continuity, coercivity, symmetric convexity preservation, or the ordering-envelope structure are useful beyond this mission.

Selected references

  • Xin Chen and David Simchi-Levi, Coordinating Inventory Control and Pricing Strategies with Random Demand and Fixed Ordering Cost: The Finite Horizon Case, Operations Research 52(6), 887–896, 2004. DOI: 10.1287/opre.1040.0127.
12 thms3 active usersReviewed
🏆Completed
Convex OptimizationOptimizationProbability·Captain: mikedeng1

The Exact Feasibility of Randomized Solutions of Uncertain Convex Programs: Fully-Supported Problems Attain the Binomial Violation Tail ExactlyResearch Paper

Motivation

Many design problems in control, finance and engineering are convex programs whose constraints depend on an uncertain parameter δ\deltaδ: a solution must satisfy x∈Xδx\in\mathcal X_\deltax∈Xδ​ for every δ\deltaδ in a possibly infinite set Δ\DeltaΔ. Enforcing all constraints (robust optimization) is often intractable or overly conservative. The scenario approach draws NNN independent samples of δ\deltaδ, solves the convex program with those NNN constraints only, and asks how likely it is that the resulting solution violates a fresh constraint. The question matters wherever a randomized design is certified by a confidence statement, from robust control to chance-constrained portfolio selection.

Timeline.

  • Calafiore and Campi (Math. Program. 2005; IEEE TAC 2006) introduced the method and bounded the probability that the violation exceeds ε\varepsilonε by a quantity of order (Nd)(1−ε)N−d\binom Nd(1-\varepsilon)^{N-d}(dN​)(1−ε)N−d. The bound is valid but loose.
  • Campi and Garatti (SIAM J. Optim. 2008, this mission's source) proved the bound ∑i=0d−1(Ni)εi(1−ε)N−i\sum_{i=0}^{d-1}\binom Ni\varepsilon^i(1-\varepsilon)^{N-i}∑i=0d−1​(iN​)εi(1−ε)N−i for every convex problem satisfying existence and uniqueness of solutions. They showed it is attained with equality by every fully-supported problem, so it cannot be improved without further assumptions.
  • Later work extended the result to non-unique solutions, constraint removal, and non-convex decisions (Campi and Garatti, Introduction to the Scenario Approach, SIAM 2018).

Setting

Let (Δ,D,P)(\Delta,\mathcal D,\mathbb P)(Δ,D,P) be a probability space, c∈Rdc\in\mathbb R^dc∈Rd with d≥1d\ge1d≥1, and let X⊆Rd\mathcal X\subseteq\mathbb R^dX⊆Rd and Xδ⊆Rd\mathcal X_\delta\subseteq\mathbb R^dXδ​⊆Rd (δ∈Δ\delta\in\Deltaδ∈Δ) be convex closed sets. The violation probability of a point xxx is

V(x)=P{δ∈Δ: x∉Xδ}.V(x)=\mathbb P\{\delta\in\Delta:\ x\notin\mathcal X_\delta\}.V(x)=P{δ∈Δ: x∈/Xδ​}.

For a multi-extraction (δ(1),…,δ(m))∈Δm(\delta^{(1)},\dots,\delta^{(m)})\in\Delta^m(δ(1),…,δ(m))∈Δm, the program PmP_mPm​ minimises c⊤xc^\top xc⊤x over x∈X∩⋂i=1mXδ(i)x\in\mathcal X\cap\bigcap_{i=1}^m\mathcal X_{\delta^{(i)}}x∈X∩⋂i=1m​Xδ(i)​. It is assumed that every PmP_mPm​ has a unique solution xm∗x^*_mxm∗​. A constraint δ(r)\delta^{(r)}δ(r) is a support constraint of PmP_mPm​ if its removal changes the solution. A convex PmP_mPm​ has at most ddd support constraints (Proposition 2.2). The problem is fully-supported if, for every m≥dm\ge dm≥d, the program PmP_mPm​ built from mmm independent samples has exactly ddd support constraints with Pm\mathbb P^mPm-probability one.

Two further objects carry the argument. For I⊆{1,…,m}\mathcal I\subseteq\{1,\dots,m\}I⊆{1,…,m} of cardinality ddd, SIS_{\mathcal I}SI​ is the set of multi-extractions whose support constraints have exactly the indexes in I\mathcal II. The violation law is

F(α)=Pd{V(xd∗)≤α},F(\alpha)=\mathbb P^d\{V(x^*_d)\le\alpha\},F(α)=Pd{V(xd∗​)≤α},

the distribution of the violation of the solution built from ddd samples.

Formalization targets

Goal: Theorem 2.4, equation (2.3)

For a fully-supported problem, every N≥dN\ge dN≥d and every ε∈[0,1]\varepsilon\in[0,1]ε∈[0,1],

PN{V(xN∗)>ε}=∑i=0d−1(Ni)εi(1−ε)N−i.\mathbb P^N\{V(x^*_N)>\varepsilon\}=\sum_{i=0}^{d-1}\binom Ni\varepsilon^i(1-\varepsilon)^{N-i}.PN{V(xN∗​)>ε}=i=0∑d−1​(iN​)εi(1−ε)N−i.

Milestones (PART 1 of §3)

  • Proposition 2.2: at most ddd support constraints.
  • SIˉ⊆S~IˉS_{\bar{\mathcal I}}\subseteq\widetilde S_{\bar{\mathcal I}}SIˉ​⊆SIˉ​ for Iˉ={1,…,d}\bar{\mathcal I}=\{1,\dots,d\}Iˉ={1,…,d}, where S~Iˉ\widetilde S_{\bar{\mathcal I}}SIˉ​ is the set where δ(d+1),…,δ(m)\delta^{(d+1)},\dots,\delta^{(m)}δ(d+1),…,δ(m) are not violated by the solution generated by δ(1),…,δ(d)\delta^{(1)},\dots,\delta^{(d)}δ(1),…,δ(d); and S~Iˉ⊆SIˉ\widetilde S_{\bar{\mathcal I}}\subseteq S_{\bar{\mathcal I}}SIˉ​⊆SIˉ​ up to a probability-zero set.
  • (3.3): Pm{SI}=∫01(1−α)m−dF(dα)\mathbb P^m\{S_{\mathcal I}\}=\int_0^1(1-\alpha)^{m-d}F(\mathrm d\alpha)Pm{SI​}=∫01​(1−α)m−dF(dα) for every I\mathcal II of cardinality ddd.
  • (3.4): (md)∫01(1−α)m−dF(dα)=1\binom md\int_0^1(1-\alpha)^{m-d}F(\mathrm d\alpha)=1(dm​)∫01​(1−α)m−dF(dα)=1 for all m≥dm\ge dm≥d.
  • Moment uniqueness: F(α)=αdF(\alpha)=\alpha^dF(α)=αd is the only distribution on [0,1][0,1][0,1] satisfying (3.4).
  • (3.2): F(α)=αdF(\alpha)=\alpha^dF(α)=αd.
  • Partition chain: PN{V(xN∗)>ε}=(Nd)∫(ε,1](1−α)N−dF(dα)\mathbb P^N\{V(x^*_N)>\varepsilon\}=\binom Nd\int_{(\varepsilon,1]}(1-\alpha)^{N-d}F(\mathrm d\alpha)PN{V(xN∗​)>ε}=(dN​)∫(ε,1]​(1−α)N−dF(dα).
  • Integration by parts: (Nd)∫ε1(1−α)N−d d αd−1 dα=∑i=0d−1(Ni)εi(1−ε)N−i\binom Nd\int_\varepsilon^1(1-\alpha)^{N-d}\,d\,\alpha^{d-1}\,\mathrm d\alpha=\sum_{i=0}^{d-1}\binom Ni\varepsilon^i(1-\varepsilon)^{N-i}(dN​)∫ε1​(1−α)N−ddαd−1dα=∑i=0d−1​(iN​)εi(1−ε)N−i.

Significance

The result. Equation (2.3) shows that the scenario bound (2.2) is tight: no bound that depends only on NNN, ddd and ε\varepsilonε can be smaller, because a fully-supported problem attains it. The distribution of V(xN∗)V(x^*_N)V(xN∗​) is then a Beta law, PN{V(xN∗)≤ε}\mathbb P^N\{V(x^*_N)\le\varepsilon\}PN{V(xN∗​)≤ε} being the probability that a Binomial(N,ε)\mathrm{Binomial}(N,\varepsilon)Binomial(N,ε) variable is at least ddd, the same for every fully-supported problem. This is what fixes the sample sizes used in practice: NNN is chosen so that the binomial tail is below a confidence level β\betaβ. Fact (3.2), that V(xd∗)V(x^*_d)V(xd∗​) has distribution function αd\alpha^dαd whatever the problem, is a distribution-free statement of independent interest.

Formalizing it. The result is proved in the source. As far as is known it has no machine-checked proof. The goal statement is already posed on the platform, and this mission supplies the paper's proof structure as milestones. Two milestones are reusable outside the scenario approach: the uniqueness of a distribution on [0,1][0,1][0,1] given the moments ∫(1−α)k dF=1/(d+kd)\int(1-\alpha)^k\,\mathrm dF=1/\binom{d+k}d∫(1−α)kdF=1/(dd+k​), and the incomplete-beta identity for binomial tails.

Difficulty

The obvious route would compute the law of V(xN∗)V(x^*_N)V(xN∗​) directly, but it depends on the geometry of the constraints. The paper never computes it. It obtains the law of V(xd∗)V(x^*_d)V(xd∗​) only implicitly, through the infinite family of identities (3.4), and recovers it by a uniqueness theorem for moment problems. Two points need care. First, full support holds only almost surely: duplicated samples, for instance, produce programs with fewer than ddd support constraints, so every set identity holds only up to null sets. Second, the claim that removing a non-support constraint keeps the first ddd constraints as the only support constraints uses Proposition 2.2. Two identical non-support constraints show that a constraint can become a support constraint after another is removed, unless the count is bounded by ddd.

Formalization scope

Goal. The goal is the already-posed platform statement ScenarioApproach.Generalization.violation_tail_eq_binomial_sum_of_fullySupported (theorem id cffaa932-832c-42ca-9e81-1848ffab7e34), referenced as it stands and not restated. Proposition 2.2 is the platform statement card_support_constraints_le_dim (f70e8aa3-…). This mission adds the PART 1 steps as milestones under ScenarioExact.PartOne.

Representation. Decisions are vectors in EuclideanSpace ℝ (Fin d). A multi-extraction is ω : Fin m → Δ, with 0-based indexes, so Iˉ\bar{\mathcal I}Iˉ is {i:i<d}\{i : i<d\}{i:i<d} and "δ(d+1),…,δ(m)\delta^{(d+1)},\dots,\delta^{(m)}δ(d+1),…,δ(m)" are the indexes j≥dj\ge dj≥d. Pm\mathbb P^mPm is Measure.pi (fun _ : Fin m => P). VVV, the feasible set, solutions, support constraints and full support are the published definitions violation, feasibleSet, IsSolution, IsSupportConstraint and FullySupported. A support constraint is one whose removal admits a feasible point of strictly smaller cost, which under uniqueness is the paper's "its removal changes the solution". Full support is almost sure, not pointwise.

Hypotheses made explicit. Assumption 1 is entered as existence and uniqueness of the solution for every number of constraints and every sample, together with a family of solution maps θs k, each assumed to solve PkP_kPk​ and to be measurable. Under uniqueness, θs N is the goal's solution map. The paper's "measurability ... is assumed for granted" (p. 4) is replaced by joint measurability of {(x,δ):x∈Xδ}\{(x,\delta):x\in\mathcal X_\delta\}{(x,δ):x∈Xδ​} and measurability of the solution maps, the same two hypotheses as the goal. No set SIS_{\mathcal I}SI​ is assumed measurable. The nonempty-interior clause of Assumption 1 is unused in PART 1 and is not assumed, so the milestones compose with the goal.

Conventions. FFF is the push-forward measure violationLaw on R\mathbb RR, with F(α)F(\alpha)F(α) = violationLaw … (Set.Iic α). Integrals against FFF are lower Lebesgue integrals of nonnegative integrands, as extended nonnegative reals: over [0,1][0,1][0,1] for ∫01\int_0^1∫01​, and over (ε,1](\varepsilon,1](ε,1] for ∫ε1\int_\varepsilon^1∫ε1​ in the partition chain, since that integral comes from the event V>εV>\varepsilonV>ε. The integration-by-parts identity is a real interval integral. Ranges are 1≤d1\le d1≤d, d≤md\le md≤m, d≤Nd\le Nd≤N and 0≤ε≤10\le\varepsilon\le10≤ε≤1.

Ruled out. A pointwise "exactly ddd support constraints for every sample" would be unsatisfiable for many problems (repeated samples) and would trivialise the probabilistic content, so it is not used. Assuming measurability of the event {V(xN∗)>ε}\{V(x^*_N)>\varepsilon\}{V(xN∗​)>ε} or of SIS_{\mathcal I}SI​, or the identity Pm{SI}=Pm{S~I}\mathbb P^m\{S_{\mathcal I}\}=\mathbb P^m\{\widetilde S_{\mathcal I}\}Pm{SI​}=Pm{SI​}, as a hypothesis would assume part of the conclusion, so none of these is a hypothesis.

Infrastructure. A complete development needs: the support-constraint count (Proposition 2.2, a Helly-type argument), invariance of product measures under coordinate permutations, the change-of-variables formula for push-forward measures, the Hausdorff moment uniqueness theorem on [0,1][0,1][0,1], and the binomial–incomplete-beta identity. The last two are general results, and contributions of them are welcome independently.

Selected references

  • M. C. Campi, S. Garatti, The exact feasibility of randomized solutions of uncertain convex programs, SIAM J. Optim. 19(3) (2008) 1211–1230. https://doi.org/10.1137/07069821X
  • G. Calafiore, M. C. Campi, Uncertain convex programs: randomized solutions and confidence levels, Math. Program. 102 (2005) 25–46. https://doi.org/10.1007/s10107-003-0499-y
  • G. Calafiore, M. C. Campi, The scenario approach to robust control design, IEEE Trans. Automat. Control 51(5) (2006) 742–753. https://doi.org/10.1109/TAC.2006.875041
  • M. C. Campi, S. Garatti, Introduction to the Scenario Approach, SIAM, 2018. https://doi.org/10.1137/1.9781611975444
  • A. N. Shiryaev, Probability, 2nd ed., Springer, 1996, Chapter II, §12. https://doi.org/10.1007/978-1-4757-2539-1
14 thms3 active usersReviewed
🏆Completed
Optimal TransportOptimizationProbability·Captain: mikedeng1

Quantifying Distributional Model Risk via Optimal Transport 1: Strong Duality — the Worst-Case Expectation over an Optimal-Transport Ball on a Polish Space Equals Its Dual over (λ, φ)Research Paper

Motivation

A probability model μ\muμ for a random element XXX is rarely known exactly. Distributionally robust performance analysis replaces the single expectation Eμ[f(X)]E_\mu[f(X)]Eμ​[f(X)] by its worst case over all models within a prescribed distance of μ\muμ. When the distance is an optimal-transport cost, the neighbourhood contains models whose support differs from that of μ\muμ. That matters in stochastic-process applications such as ruin probabilities for insurance reserves, where the natural alternatives (a compensated Poisson process against a Brownian motion) are mutually singular and likelihood-based divergences such as Kullback–Leibler are infinite.

Blanchet and Murthy (arXiv:1604.01446, Math. Oper. Res. 2019) prove that the worst-case expectation over an optimal-transport ball equals a one-dimensional dual problem. They assume only that the underlying space is Polish, the cost lower semicontinuous and the performance function upper semicontinuous and integrable.

Timeline. Esfahani and Kuhn (arXiv:1505.05116, 2015/2018) obtained a dual reformulation for Wasserstein balls around empirical measures on Rd\mathbb R^dRd. Gao and Kleywegt (arXiv:1604.02199, 2016) proved a general duality whose proof, as Blanchet and Murthy note, uses the local compactness of the space. Blanchet and Murthy (2016, v2 2017) removed local compactness and continuity of the cost. This covers path spaces such as C[0,T]C[0,T]C[0,T] and D[0,T]D[0,T]D[0,T].

Setting

Let SSS be a Polish space with Borel σ-algebra B(S)\mathcal B(S)B(S), and let μ\muμ be a probability measure on SSS (the baseline model).

  • Cost (A1). c:S×S→[0,∞)c : S\times S\to[0,\infty)c:S×S→[0,∞) is lower semicontinuous, and c(x,y)=0c(x,y)=0c(x,y)=0 if and only if x=yx=yx=y.
  • Performance function (A2). f:S→Rf : S\to\mathbb Rf:S→R is upper semicontinuous and μ\muμ-integrable.
  • Budget. δ>0\delta>0δ>0.

The primal feasible set Φμ,δ\Phi_{\mu,\delta}Φμ,δ​ consists of the probability measures π\piπ on S×SS\times SS×S whose first marginal is μ\muμ and whose transport cost satisfies ∫c dπ≤δ\int c\,d\pi\le\delta∫cdπ≤δ. The second marginal of π\piπ is the alternative model. The primal objective is I(π)=∫f(y) dπ(x,y)I(\pi)=\int f(y)\,d\pi(x,y)I(π)=∫f(y)dπ(x,y), and the primal value is

I=sup⁡{I(π):π∈Φμ,δ}.I=\sup\{I(\pi):\pi\in\Phi_{\mu,\delta}\}.I=sup{I(π):π∈Φμ,δ​}.

The universal σ-algebra U(S)\mathcal U(S)U(S) is the intersection of the completions of B(S)\mathcal B(S)B(S) under all probability measures. Write mU(S;Rˉ)m\mathcal U(S;\bar{\mathbb R})mU(S;Rˉ) for the U(S)\mathcal U(S)U(S)-measurable functions S→[−∞,∞]S\to[-\infty,\infty]S→[−∞,∞]. The dual feasible set Λc,f\Lambda_{c,f}Λc,f​ consists of the pairs (λ,φ)(\lambda,\varphi)(λ,φ) with λ≥0\lambda\ge0λ≥0, φ∈mU(S;Rˉ)\varphi\in m\mathcal U(S;\bar{\mathbb R})φ∈mU(S;Rˉ) and φ(x)+λc(x,y)≥f(y)\varphi(x)+\lambda c(x,y)\ge f(y)φ(x)+λc(x,y)≥f(y) for all x,yx,yx,y. The dual objective is J(λ,φ)=λδ+∫φ dμJ(\lambda,\varphi)=\lambda\delta+\int\varphi\,d\muJ(λ,φ)=λδ+∫φdμ, and the dual value is J=inf⁡{J(λ,φ):(λ,φ)∈Λc,f}J=\inf\{J(\lambda,\varphi):(\lambda,\varphi)\in\Lambda_{c,f}\}J=inf{J(λ,φ):(λ,φ)∈Λc,f​}. Finally,

φλ(x)=sup⁡y∈S{f(y)−λc(x,y)}∈R∪{∞}.\varphi_\lambda(x)=\sup_{y\in S}\{f(y)-\lambda c(x,y)\}\in\mathbb R\cup\{\infty\}.φλ​(x)=y∈Ssup​{f(y)−λc(x,y)}∈R∪{∞}.

Formalization targets

Goal: Theorem 1

Under (A1) and (A2):

  1. strong duality,
sup⁡{I(π):π∈Φμ,δ}=inf⁡{J(λ,φ):(λ,φ)∈Λc,f};\sup\{I(\pi):\pi\in\Phi_{\mu,\delta}\}=\inf\{J(\lambda,\varphi):(\lambda,\varphi)\in\Lambda_{c,f}\};sup{I(π):π∈Φμ,δ​}=inf{J(λ,φ):(λ,φ)∈Λc,f​};
  1. there is λ∗≥0\lambda^*\ge0λ∗≥0 such that (λ∗,φλ∗)(\lambda^*,\varphi_{\lambda^*})(λ∗,φλ∗​) is a dual optimizer;
  2. a feasible π∗\pi^*π∗ and a feasible (λ∗,φλ∗)(\lambda^*,\varphi_{\lambda^*})(λ∗,φλ∗​) with finite J(λ∗,φλ∗)J(\lambda^*,\varphi_{\lambda^*})J(λ∗,φλ∗​) are optimal with I(π∗)=J(λ∗,φλ∗)I(\pi^*)=J(\lambda^*,\varphi_{\lambda^*})I(π∗)=J(λ∗,φλ∗​) if and only if the complementary slackness conditions hold:
f(y)−λ∗c(x,y)=φλ∗(x)  π∗-a.s.,λ∗(∫c dπ∗−δ)=0.f(y)-\lambda^*c(x,y)=\varphi_{\lambda^*}(x)\ \ \pi^*\text{-a.s.},\qquad \lambda^*\Big(\int c\,d\pi^*-\delta\Big)=0.f(y)−λ∗c(x,y)=φλ∗​(x)  π∗-a.s.,λ∗(∫cdπ∗−δ)=0.

The "if" direction is stated without the finiteness assumption.

Milestones

Weak duality I≤JI\le JI≤J (5). Lemma 15. Strong duality with a primal optimizer on compact SSS, first for continuous costs (Proposition 5), then for lower semicontinuous ones (Proposition 6). Universal measurability of φλ\varphi_\lambdaφλ​ (§4.2). Lemma 16. The restricted dual bound of Proposition 7. Lemma 8. The univariate formula (9):

I=inf⁡λ≥0{λδ+Eμ[sup⁡y∈S{f(y)−λc(X,y)}]}.I=\inf_{\lambda\ge0}\Big\{\lambda\delta+E_\mu\Big[\sup_{y\in S}\{f(y)-\lambda c(X,y)\}\Big]\Big\}.I=λ≥0inf​{λδ+Eμ​[y∈Ssup​{f(y)−λc(X,y)}]}.

Significance

The result. Formula (9) turns an infinite-dimensional optimization over probability measures into a one-dimensional convex minimization that involves only the baseline μ\muμ. A modeller can therefore evaluate it by sampling from μ\muμ. Theorem 1 is the input for the worst-case probability formula for closed sets (Theorem 3 of the paper) and for the existence of worst-case transport plans (Corollary 1). Its complementary slackness conditions describe the structure of every worst-case plan: mass is moved from xxx to maximizers of f(z)−λ∗c(x,z)f(z)-\lambda^*c(x,z)f(z)−λ∗c(x,z), and the budget is exhausted whenever λ∗>0\lambda^*>0λ∗>0.

Formalizing it. The result is proved on paper. To our knowledge it has no machine-checked proof. The only related statement on Prove2Me is a special case (empirical baseline, bounded continuous loss, power-of-norm cost on Rm\mathbb R^mRm). A complete development would contain duality on compact spaces via Fenchel duality, the extension to σ-compact supports, and measurable-selection arguments for universally measurable functions. The measurable-selection part reuses Bertsekas–Shreve's analytic-set theory, which is already posed on the platform.

Difficulty

The obvious route copies Kantorovich duality. That route fails here because the feasible set Φμ,δ\Phi_{\mu,\delta}Φμ,δ​ fixes only one marginal, so it is not tight on a non-compact space. Prokhorov compactness is available only on compact pieces Sn×SnS_n\times S_nSn​×Sn​. The duality must then be transported to the whole space by a limiting argument that keeps control of the dual multipliers.

A second obstacle is measurability. For a merely lower semicontinuous cost on a non-locally-compact space, φλ\varphi_\lambdaφλ​ need not be Borel measurable, so the dual must range over universally measurable functions. Removing the restriction y∈Sπy\in S_\piy∈Sπ​ from the envelope (Lemma 8) needs a measurable selection theorem. Arguments that assume closed balls are compact do not apply in the target spaces C[0,T]C[0,T]C[0,T] and D[0,T]D[0,T]D[0,T].

Formalization scope

  • Space and costs. S carries [TopologicalSpace S] [PolishSpace S] [MeasurableSpace S] [BorelSpace S]. The cost is a real-valued curried function c : S → S → ℝ; (A1) is the structure AssumptionA1; (A2) is UpperSemicontinuous f together with Integrable f μ; and 0 < δ is assumed throughout.
  • Extended reals. III, JJJ, I(π)I(\pi)I(π), J(λ,φ)J(\lambda,\varphi)J(λ,φ) and φλ\varphi_\lambdaφλ​ live in EReal. The integral of an extended-real function is ∫φ+−∫φ−\int\varphi^+-\int\varphi^-∫φ+−∫φ− with lower Lebesgue integrals, and ∞−∞\infty-\infty∞−∞ evaluates to −∞-\infty−∞. A coupling with ∫f− dπ=∞\int f^-\,d\pi=\infty∫f−dπ=∞ therefore never raises III, which is the paper's reading in footnote 2.
  • Measurability and integrals. Universal measurability is the published BertsekasShreve.AnalyticSelection.IsUniversallyMeasurable. For such φ\varphiφ the lower integral equals the integral against the completion of μ\muμ.
  • Variants. The dual feasible set takes a set KKK: with K=SK=SK=S it is (6b), and with K=SπK=S_\piK=Sπ​ it is (29).
  • Hidden hypothesis. The "only if" part of Theorem 1(b) carries the hypothesis J(λ∗,φλ∗)<∞J(\lambda^*,\varphi_{\lambda^*})<\inftyJ(λ∗,φλ∗​)<∞. Without it the equivalence fails when I=J=∞I=J=\inftyI=J=∞.
  • Ruled-out trivializations. A primal that fixes both marginals (or neither), a dual over Borel-measurable φ\varphiφ, and a Bochner integral for ∫f dπ\int f\,d\pi∫fdπ (which is 000 off L1(π)L^1(\pi)L1(π)) all describe different problems and are ruled out by the definitions.
  • Infrastructure and contributions. Needed: Fenchel duality on Cb(S×S)C_b(S\times S)Cb​(S×S) and its dual M(S×S)M(S\times S)M(S×S) (Riesz–Markov–Kakutani), Prokhorov's theorem, Sion's minimax theorem, and Jankov–von Neumann selection. Several are on the platform or in Mathlib, and all are reusable beyond this mission. Proofs of the milestones in any order, and of the posed Bertsekas–Shreve tools, are welcome.

Selected references

  • J. Blanchet and K. Murthy, Quantifying Distributional Model Risk via Optimal Transport, Math. Oper. Res. 44(2):565–600, 2019. arXiv:1604.01446v2, doi:10.1287/moor.2018.0936
  • R. Gao and A. Kleywegt, Distributionally Robust Stochastic Optimization with Wasserstein Distance, 2016. arXiv:1604.02199
  • P. Mohajerin Esfahani and D. Kuhn, Data-driven distributionally robust optimization using the Wasserstein metric, Math. Program. 171:115–166, 2018. arXiv:1505.05116
  • D. Bertsekas and S. Shreve, Stochastic Optimal Control: The Discrete-Time Case, Academic Press, 1978, Chapter 7. MIT open copy
  • C. Villani, Optimal Transport: Old and New, Springer, 2008. doi:10.1007/978-3-540-71050-9
19 thms3 active usersReviewed
🏆Completed
OptimizationProbability·Captain: mikedeng1

Airline Seat Allocation with Multiple Nested Fare Classes 2: With Integer-Valued Demands an Optimal Integer Protection-Level Policy ExistsResearch Paper

Motivation

Airlines sell the seats of one flight leg at several prices. Cheaper fare classes tend to book earlier, so the seller must decide, as low-fare requests arrive, how many seats to hold back for later and more valuable passengers. The standard control is nested protection levels: a number pkp_kpk​ of seats is reserved for the kkk most expensive classes together, and a request of class k+1k+1k+1 is accepted only while more than pkp_kpk​ seats remain. Littlewood (1972) gave the optimal rule for two classes; Belobaba's EMSR heuristic (1987, 1989) extended it to many classes without an optimality guarantee.

S. L. Brumelle and J. I. McGill, Airline Seat Allocation with Multiple Nested Fare Classes (Operations Research 41(1), 1993) treat any number of classes with independent random demands and characterize optimal protection levels by first-order conditions on the expected revenue: Theorem 1 states that a policy with fk+1f_{k+1}fk+1​ in the subdifferential of the expected revenue of the kkk highest classes at pkp_kpk​, for every kkk, is optimal. Their Theorem 2 addresses the question practitioners face first: seats and bookings are whole numbers. If demand is integer valued, is an optimal policy available among integer protection levels? The theorem answers yes. This mission formalizes that theorem and the chain of results in its proof.

Timeline.

  • Littlewood (1972): two fare classes, rule f2=f1Pr⁡[X1>p1]f_2 = f_1 \Pr[X_1 > p_1]f2​=f1​Pr[X1​>p1​].
  • Belobaba (1987, 1989): EMSR heuristic for many classes.
  • Curry (1990) and Wollmer (1992): multiple nested classes, continuous and discrete demand respectively.
  • Brumelle and McGill (1993): subdifferential optimality conditions for any number of classes (Theorem 1), existence of an optimal integer policy for integer demand (Theorem 2), and the probability conditions (31) (Theorem 3).

Setting

Classes are numbered k=1,2,…k = 1, 2, \dotsk=1,2,…, class 111 paying the highest fare. Class kkk has a random demand Xk≥0X_k \ge 0Xk​≥0 and fare fkf_kfk​, with f1>f2>⋯f_1 > f_2 > \cdotsf1​>f2​>⋯. The demands are mutually independent on a probability space (Ω,F,P)(\Omega, \mathcal F, P)(Ω,F,P). A protection-level policy is a sequence p=(p1,p2,… )p = (p_1, p_2, \dots)p=(p1​,p2​,…) with pk≥0p_k \ge 0pk​≥0; the dummy level p0=0p_0 = 0p0​=0 is never used.

For a demand vector xxx and sss available seats, the revenue of the kkk highest classes is defined recursively (Eqs. (8)–(9), p. 130):

R1[s;p;x]={f1s0≤s<x1,f1x1x1≤s,R_1[s; p; x] = \begin{cases} f_1 s & 0 \le s < x_1,\\ f_1 x_1 & x_1 \le s,\end{cases}R1​[s;p;x]={f1​sf1​x1​​0≤s<x1​,x1​≤s,​ Rk+1[s;p;x]={Rk[s;p;x]0≤s<pk,(s−pk)fk+1+Rk[pk;p;x]pk≤s<pk+xk+1,xk+1fk+1+Rk[s−xk+1;p;x]pk+xk+1≤s.R_{k+1}[s; p; x] = \begin{cases} R_k[s; p; x] & 0 \le s < p_k,\\ (s - p_k) f_{k+1} + R_k[p_k; p; x] & p_k \le s < p_k + x_{k+1},\\ x_{k+1} f_{k+1} + R_k[s - x_{k+1}; p; x] & p_k + x_{k+1} \le s.\end{cases}Rk+1​[s;p;x]=⎩⎨⎧​Rk​[s;p;x](s−pk​)fk+1​+Rk​[pk​;p;x]xk+1​fk+1​+Rk​[s−xk+1​;p;x]​0≤s<pk​,pk​≤s<pk​+xk+1​,pk​+xk+1​≤s.​

The expected revenue is ERk[s;p;X]=E Rk[s;p;X]ER_k[s; p; X] = E\,R_k[s; p; X]ERk​[s;p;X]=ERk​[s;p;X]. A policy is optimal if it maximizes ERk[s;⋅ ;X]ER_k[s; \cdot\,; X]ERk​[s;⋅;X] for every kkk and every s≥0s \ge 0s≥0 (p. 130).

For a function ggg and t≥0t \ge 0t≥0, δ+g(t)\delta_+ g(t)δ+​g(t) and δ−g(t)\delta_- g(t)δ−​g(t) are the right and left derivatives, with δ−g(0)=+∞\delta_- g(0) = +\inftyδ−​g(0)=+∞, and the subdifferential is δg(t)=[δ+g(t),δ−g(t)]\delta g(t) = [\delta_+ g(t), \delta_- g(t)]δg(t)=[δ+​g(t),δ−​g(t)] (p. 131). Condition (20) is

fk+1∈δERk[pk;(p0,…,pk−1);X],k=1,2,…f_{k+1} \in \delta ER_k[p_k; (p_0, \dots, p_{k-1}); X], \qquad k = 1, 2, \dotsfk+1​∈δERk​[pk​;(p0​,…,pk−1​);X],k=1,2,…

A function is CLBI (Concave and Linear Between Integers, p. 132) if it is concave on s≥0s \ge 0s≥0 and linear on each interval [m,m+1][m, m+1][m,m+1], m=0,1,2,…m = 0, 1, 2, \dotsm=0,1,2,…

Formalization targets

Goal: Theorem 2 (p. 132)

If every XkX_kXk​ is integer valued and the fares are positive, there is a policy p∗p^*p∗ with pk∗∈{0,1,2,… }p^*_k \in \{0, 1, 2, \dots\}pk∗​∈{0,1,2,…} such that

ERk[s;q;X]≤ERk[s;p∗;X]for every policy q, k≥1, s≥0,ER_k[s; q; X] \le ER_k[s; p^*; X] \qquad \text{for every policy } q,\ k \ge 1,\ s \ge 0,ERk​[s;q;X]≤ERk​[s;p∗;X]for every policy q, k≥1, s≥0,

and p∗p^*p∗ satisfies (20). The competitor qqq ranges over all real protection levels.

Milestones (in proof order)

  1. (27): δER1[s;p;X]=[f1Pr⁡[X1>s],f1Pr⁡[X1≥s]]\delta ER_1[s; p; X] = [f_1 \Pr[X_1 > s], f_1 \Pr[X_1 \ge s]]δER1​[s;p;X]=[f1​Pr[X1​>s],f1​Pr[X1​≥s]], and ER1ER_1ER1​ is CLBI.
  2. Covering property (p. 132): if ggg is CLBI and δ+g(s2)<c<δ−g(s1)\delta_+ g(s_2) < c < \delta_- g(s_1)δ+​g(s2​)<c<δ−​g(s1​) with s1<s2s_1 < s_2s1​<s2​, then c∈δg(n)c \in \delta g(n)c∈δg(n) for an integer n∈[s1,s2]n \in [s_1, s_2]n∈[s1​,s2​].
  3. (28)–(29): for s≥pks \ge p_ks≥pk​,
δ+ERk+1[s]=fk+1Pr⁡[Xk+1>s−pk]+∑i=0⌊s−pk⌋δ+ERk[s−i]Pr⁡[Xk+1=i],\delta_+ ER_{k+1}[s] = f_{k+1}\Pr[X_{k+1} > s - p_k] + \sum_{i=0}^{\lfloor s - p_k\rfloor} \delta_+ ER_k[s - i]\Pr[X_{k+1} = i],δ+​ERk+1​[s]=fk+1​Pr[Xk+1​>s−pk​]+i=0∑⌊s−pk​⌋​δ+​ERk​[s−i]Pr[Xk+1​=i],

and the analogous formula for δ−\delta_-δ−​ at s>pks > p_ks>pk​. 4. Corollary 1 (p. 131): concavity of ERkER_kERk​ and fk+1∈δERk[pk]f_{k+1} \in \delta ER_k[p_k]fk+1​∈δERk​[pk​] give concavity of ERk+1ER_{k+1}ERk+1​. 5. CLBI propagation (p. 133): if ERk[⋅;p∗;X]ER_k[\cdot; p^*; X]ERk​[⋅;p∗;X] is CLBI and integer p1∗,…,pk∗p^*_1, \dots, p^*_kp1∗​,…,pk∗​ satisfy (20), then ERk+1[⋅;p∗;X]ER_{k+1}[\cdot; p^*; X]ERk+1​[⋅;p∗;X] is CLBI. 6. (30): for sss large enough, δ+ERk+1[s;p;X]<fk+2\delta_+ ER_{k+1}[s; p; X] < f_{k+2}δ+​ERk+1​[s;p;X]<fk+2​. 7. Theorem 1 (p. 131): a policy satisfying (20) is optimal.

Significance

The result. Theorem 2 justifies computing protection levels in whole seats: with integer demand, restricting to integer policies loses nothing against arbitrary real protection levels. The construction also shows that (20) is solvable at every level, so the sufficient condition of Theorem 1 is never empty for integer demand. Many later revenue-management models assume an optimal nested policy exists and rely on this result or its dynamic-programming analogues.

Formalizing it. The theorem is proved on the page by an induction on the class index, but several steps are compressed: (28)–(29) are printed without the range of sss on which they hold, and (30) is asserted "by recursive application". To our knowledge none of these statements has a machine-checked proof. A formal development gives a verified account of one-sided derivatives of expectations of piecewise-linear random functions and of the integer covering property. These pieces are reusable for other newsvendor-type and nested-inventory models. The probability-condition characterization (Theorem 3) is the subject of a companion mission in the same series.

Difficulty

Concavity of the expected revenue does not hold for arbitrary policies. It is only guaranteed level by level, when the protection level already chosen at level kkk satisfies (20). Existence of an integer optimum therefore cannot be obtained by rounding a real optimum: the integer levels must be chosen one at a time, and each choice must preserve both concavity and the CLBI shape needed for the next. A second obstacle is analytic. The one-sided derivatives of ERk+1ER_{k+1}ERk+1​ are expectations of derivatives of a random piecewise-linear function. Exchanging differentiation and expectation, and computing the sums in (28)–(29) exactly at integer and non-integer sss, is where informal arguments and formal ones diverge. Finally there are infinitely many classes, so the policy p∗p^*p∗ is an infinite sequence built by recursion.

Formalization scope

  • Model. Classes are indexed by N\mathbb NN from 111; fares, demands and protection levels are sequences N→R\mathbb N \to \mathbb RN→R. Seats, demands and protection levels are real; an integer policy is a sequence of natural numbers read as reals. Integer-valued demand means each Xk(ω)X_k(\omega)Xk​(ω) is a natural number. Expectations are Bochner integrals.
  • Standing assumptions (§1). PPP is a probability measure. The demands are measurable, nonnegative and mutually independent, and the fares are strictly decreasing.
  • Added hypotheses. The goal assumes positive fares, fk>0f_k > 0fk​>0 for k≥1k \ge 1k≥1. The page leaves this implicit (fares are average revenues), and without it the theorem is false. The same assumption appears in (30), and (27) assumes f1≥0f_1 \ge 0f1​≥0, without which ER1ER_1ER1​ is convex rather than concave.
  • Derivatives. One-sided derivatives are required to exist, with their value asserted; no default value of an undefined derivative is used. The convention δ−g(0)=+∞\delta_- g(0) = +\inftyδ−​g(0)=+∞ is built into the subdifferential.
  • Optimality. Optimality is global: against every real protection-level policy, at every level k≥1k \ge 1k≥1 and every s≥0s \ge 0s≥0.
  • Paper's slips corrected. (28)–(29) are stated on their range s≥pks \ge p_ks≥pk​ (resp. s>pks > p_ks>pk​). (30) is stated for every k≥1k \ge 1k≥1, as the induction uses it, rather than the printed k=2,3,…k = 2, 3, \dotsk=2,3,…
  • Not a trivialization. The goal assumes only the model, integer demand and positive fares. It does not assume concavity, CLBI, (20) or any derivative formula, and optimality is not restricted to integer competitors or to one kkk.
  • Duplication. Corollary 1 and Theorem 1 are restated from the companion mission in this series.
  • Contributions. Proofs of the measure-theoretic derivative lemmas, of the covering property (a statement about real functions), and of the induction are all welcome.

Selected references

  • S. L. Brumelle and J. I. McGill, Airline Seat Allocation with Multiple Nested Fare Classes, Operations Research 41(1):127–137, 1993. https://doi.org/10.1287/opre.41.1.127
  • K. Littlewood, Forecasting and Control of Passenger Bookings, AGIFORS Symposium Proceedings 12:95–117, 1972; reprinted in Journal of Revenue and Pricing Management 4(2), 2005. https://doi.org/10.1057/palgrave.rpm.5170134
  • P. P. Belobaba, Air Travel Demand and Airline Seat Inventory Management, PhD thesis, MIT, 1987. http://hdl.handle.net/1721.1/68077
  • P. P. Belobaba, Application of a Probabilistic Decision Model to Airline Seat Inventory Control, Operations Research 37(2):183–197, 1989. https://doi.org/10.1287/opre.37.2.183
  • R. E. Curry, Optimal Airline Seat Allocation with Fare Classes Nested by Origins and Destinations, Transportation Science 24(3):193–203, 1990. https://doi.org/10.1287/trsc.24.3.193
  • R. D. Wollmer, An Airline Seat Management Model for a Single Leg Route When Lower Fare Classes Book First, Operations Research 40(1):26–37, 1992. https://doi.org/10.1287/opre.40.1.26

Related work on the platform. The two-class, integer-capacity EMSR rule of Belobaba (1987) is formalized as SeatInventory.Nested.emsr_protection_level_optimal. It is a relative of the k=1k = 1k=1 case of Theorem 2, but it lives in a different model: two classes, a fixed integer capacity, and only integer competitors.

70 thms3 active usersReviewed
🏆Completed
Bandit AlgorithmsProbabilityStatistics·Captain: mikedeng1

Dynamic Pricing Without Knowing the Demand Function: Risk Bounds and Near-Optimal Algorithms I: The Nonparametric Learn-then-Price Policy Has Regret at Most C(log n)^{1/2}/n^{1/4}Research Paper

Why price without knowing demand

A seller with a fixed stock of a single product and a finite selling season has to set prices without knowing how demand responds to them. This is the standard situation in revenue management: airline seats, hotel rooms, fashion goods and event tickets. The classical theory of dynamic pricing (Gallego and van Ryzin, 1994) assumes that the demand function λ(p)\lambda(p)λ(p), the rate of purchase requests at price ppp, is known. In practice it has to be learned from sales, while the season runs and the stock is consumed.

Besbes and Zeevi (2009) asked how much revenue is lost for not knowing λ\lambdaλ. They answered it with explicit policies and matching-order bounds. Their setting differs from the multi-armed bandit literature it borrows from in three ways:

  • the problem is constrained by an initial inventory;
  • the set of prices is a continuum;
  • the set of possible demand functions is a nonparametric class.

This mission formalizes their first main result, Proposition 1: a simple learn-then-price policy has worst-case relative regret of order (log⁡n)1/2n−1/4(\log n)^{1/2}n^{-1/4}(logn)1/2n−1/4 in a market of size nnn.

Setting

Prices. Fix 0<p‾<p‾<∞0<\underline p<\overline p<\infty0<p​<p​<∞ and an off price p∞>0p_\infty>0p∞​>0 outside [p‾,p‾][\underline p,\overline p][p​,p​]. The seller may charge any price in [p‾,p‾]∪{p∞}[\underline p,\overline p]\cup\{p_\infty\}[p​,p​]∪{p∞​}; charging p∞p_\inftyp∞​ stops demand.

Demand. Requests arrive as a Poisson process whose intensity at time ttt is λ(p(t))\lambda(p(t))λ(p(t)). Let NNN be a unit-rate Poisson process. By the time change (1), the cumulative requests up to time ttt under a price path p(⋅)p(\cdot)p(⋅) are N(∫0tλ(p(s)) ds)N\big(\int_0^t\lambda(p(s))\,ds\big)N(∫0t​λ(p(s))ds). The seller starts with inventory xxx and sells until either the horizon TTT ends or the stock runs out. The expected revenue of a policy π\piπ is Jπ(x,T;λ)J^\pi(x,T;\lambda)Jπ(x,T;λ).

Demand class. L=L(M,K‾,K‾,m)\mathcal L=\mathcal L(M,\underline K,\overline K,m)L=L(M,K​,K,m) is the set of regular demand functions satisfying Assumption 1. Regular means:

  • λ≥0\lambda\ge0λ≥0 and λ(p∞)=0\lambda(p_\infty)=0λ(p∞​)=0;
  • λ\lambdaλ is non-increasing on [p‾,p‾][\underline p,\overline p][p​,p​], with inverse γ\gammaγ;
  • the revenue rate r(l)=lγ(l)r(l)=l\gamma(l)r(l)=lγ(l) is concave.

Assumption 1 requires:

  • (i) λ≤M\lambda\le Mλ≤M on [p‾,p‾][\underline p,\overline p][p​,p​];
  • (ii) λ\lambdaλ is K‾\overline KK-Lipschitz and γ\gammaγ is K‾−1\underline K^{-1}K​−1-Lipschitz;
  • (iii) max⁡ppλ(p)≥m\max_p p\lambda(p)\ge mmaxp​pλ(p)≥m.

Benchmark. The deterministic relaxation (5) replaces the random demand by its mean:

JD(x,T∣λ)=sup⁡{∫0Tp(s)λ(p(s)) ds:∫0Tλ(p(s)) ds≤x}.J^D(x,T\mid\lambda)=\sup\Big\{\int_0^T p(s)\lambda(p(s))\,ds:\int_0^T\lambda(p(s))\,ds\le x\Big\}.JD(x,T∣λ)=sup{∫0T​p(s)λ(p(s))ds:∫0T​λ(p(s))ds≤x}.

The regret of a policy is Rπ=1−Jπ/JD\mathcal R^\pi=1-J^\pi/J^DRπ=1−Jπ/JD.

Scaling. In a market of size nnn the inventory is nxnxnx and the demand function is nλn\lambdanλ, as in (11). The corresponding quantities are JnπJ^\pi_nJnπ​, JnD=nJDJ^D_n=nJ^DJnD​=nJD and Rnπ\mathcal R^\pi_nRnπ​.

Algorithm 1, π(τ,κ)\pi(\tau,\kappa)π(τ,κ). The policy has three phases.

  1. Learning. On [0,τ][0,\tau][0,τ] it tests κ\kappaκ equally spaced prices pi=p‾+(i−1)(p‾−p‾)/κp_i=\underline p+(i-1)(\overline p-\underline p)/\kappapi​=p​+(i−1)(p​−p​)/κ, each for Δ=τ/κ\Delta=\tau/\kappaΔ=τ/κ time units. It estimates λ(pi)\lambda(p_i)λ(pi​) by the normalized request counts λ^(pi)\hat\lambda(p_i)λ^(pi​).
  2. Optimization. It chooses p^u=arg⁡max⁡ipiλ^(pi)\hat p^u=\arg\max_i p_i\hat\lambda(p_i)p^​u=argmaxi​pi​λ^(pi​) and p^c=arg⁡min⁡i∣λ^(pi)−x/T∣\hat p^c=\arg\min_i|\hat\lambda(p_i)-x/T|p^​c=argmini​∣λ^(pi​)−x/T∣, and sets p^=max⁡{p^u,p^c}\hat p=\max\{\hat p^u,\hat p^c\}p^​=max{p^​u,p^​c}.
  3. Pricing. It charges p^\hat pp^​ on (τ,T](\tau,T](τ,T] until the stock runs out.

Formalization targets

Goal: Proposition 1

Let τn≍n−1/4\tau_n\asymp n^{-1/4}τn​≍n−1/4 and κn≍n1/4\kappa_n\asymp n^{1/4}κn​≍n1/4, and let πn=π(τn,κn)\pi_n=\pi(\tau_n,\kappa_n)πn​=π(τn​,κn​). Then there is a finite constant CCC, independent of λ\lambdaλ and nnn, such that

sup⁡λ∈LRnπ(x,T;λ)≤C(log⁡n)1/2n1/4(n≥2).\sup_{\lambda\in\mathcal L}\mathcal R^{\pi}_n(x,T;\lambda)\le\frac{C(\log n)^{1/2}}{n^{1/4}}\qquad(n\ge2).λ∈Lsup​Rnπ​(x,T;λ)≤n1/4C(logn)1/2​(n≥2).

The constant is left unspecified, as in the paper. Its dependence on the class parameters, xxx and TTT is "somewhat complex" (p. 12), and the order (log⁡n)1/2n−1/4(\log n)^{1/2}n^{-1/4}(logn)1/2n−1/4 is the content of the result.

Milestones

The milestones follow the proof in the appendix, in order:

  • the scaling JnD=nJDJ^D_n=nJ^DJnD​=nJD (p. 12);
  • Fact 1, JD≥mmin⁡{T,x/M}J^D\ge m\min\{T,x/M\}JD≥mmin{T,x/M} on L\mathcal LL;
  • Lemma 1, the solution of (5): charge pD=max⁡{pu,pc}p^D=\max\{p^u,p^c\}pD=max{pu,pc} until the stock runs out;
  • Lemma 2, a Poisson deviation bound;
  • the revenue lower bound (A-2);
  • Lemma 3, the learned price is near pDp^DpD with high probability;
  • Lemma 4 and the Case 1 bound (A-11), for λ(p‾)≤x/T\lambda(\overline p)\le x/Tλ(p​)≤x/T;
  • Lemma 5 and the Case 2 bound (A-15), for λ(p‾)>x/T\lambda(\overline p)>x/Tλ(p​)>x/T;
  • the Step 4 bound Rnπ≤C12(un+τn)\mathcal R^\pi_n\le C_{12}(u_n+\tau_n)Rnπ​≤C12​(un​+τn​), where un=(log⁡n)1/2max⁡{1/κn,(nΔn)−1/2}u_n=(\log n)^{1/2}\max\{1/\kappa_n,(n\Delta_n)^{-1/2}\}un​=(logn)1/2max{1/κn​,(nΔn​)−1/2}.

Significance

Proposition 1 shows that a seller who knows only a nonparametric class of demand functions can approach the full-information revenue uniformly over the class. Learning costs a vanishing fraction of revenue, and the policy needs no parametric model. Together with the paper's lower bound of order n−1/2n^{-1/2}n−1/2 for every admissible policy (Proposition 2, not in this mission), it brackets the minimax regret of nonparametric pricing under an inventory constraint. The result is a reference point for the learning-and-earning literature in operations management that followed it.

The result is proved in the paper; to our knowledge, it has no machine-checked proof. Formalizing it requires:

  • a working theory of policies driven by a time-changed Poisson process, with sales capped by an inventory;
  • the deterministic relaxation of Gallego and van Ryzin for a continuum of prices with an off price;
  • uniform (over the class) Poisson concentration bounds.

The mission produces Lean statements of all of these. A proof would also check every constant chain of the appendix, where the argument uses some displays in a form slightly different from their printed statement (see the scope section).

Difficulty

The obvious argument controls the estimation error at the tested prices and concludes that p^\hat pp^​ is close to the optimal price. It breaks in two places.

First, pDp^DpD is the larger of two prices, the revenue maximizer and the price that sells the inventory exactly. Near the boundary between these regimes, the revenue rate at p^\hat pp^​ is not controlled by the error in p^\hat pp^​ alone: it needs the concavity of the revenue rate and the inverse Lipschitz bound on γ\gammaγ.

Second, when demand at the highest price exceeds the inventory rate (λ(p‾)>x/T\lambda(\overline p)>x/Tλ(p​)>x/T), the revenue is limited by stock-outs rather than by the price. The bound must then show that nearly all of the inventory is sold during the pricing phase, uniformly over the class.

Throughout, every constant must be independent of the demand function, so the estimates have to hold uniformly over an infinite-dimensional class.

Formalization scope

  • Poisson process. The demand is driven by IsPoissonProcess N 1 on a probability space (Ω,P)(\Omega,\mathbb P)(Ω,P), a published platform definition: ℕ-valued, N(0)=0N(0)=0N(0)=0, monotone paths, independent Poisson increments. The time change (1) is rendered by evaluating NNN at cumulative intensities.
  • Inventory. The inventory of the market of size nnn is ⌊nx⌋\lfloor nx\rfloor⌊nx⌋ units, and sales are min⁡{N(⋅),⌊nx⌋}\min\{N(\cdot),\lfloor nx\rfloor\}min{N(⋅),⌊nx⌋}. The cap is never dropped.
  • Revenue. JnπJ^\pi_nJnπ​ is the Bochner expectation of a bounded, finitely-valued revenue, so it is a genuine integral.
  • Demand functions. A demand function is a map R→R\mathbb R\to\mathbb RR→R, nonnegative, with λ(p∞)=0\lambda(p_\infty)=0λ(p∞​)=0. Regularity and Assumption 1 are imposed on [p‾,p‾][\underline p,\overline p][p​,p​], and the inverse γ\gammaγ is Function.invFunOn.
  • Benchmark. JDJ^DJD is a supremum over measurable price paths with integrable demand rate. The supremum is genuine: the set of path revenues is nonempty and bounded.
  • Algorithm. The grid excludes p‾\overline pp​, as in the paper. Ties in the grid argmax and argmin go to the smallest index. The estimates compare λ^(pi)\hat\lambda(p_i)λ^(pi​) with x/Tx/Tx/T.
  • Tuning. τn≍n−1/4\tau_n\asymp n^{-1/4}τn​≍n−1/4 and κn≍n1/4\kappa_n\asymp n^{1/4}κn​≍n1/4 are encoded with explicit constants 0<c≤c′0<c\le c'0<c≤c′, with τn∈(0,T]\tau_n\in(0,T]τn​∈(0,T] and κn≥1\kappa_n\ge1κn​≥1. Constants may depend on c,c′c,c'c,c′, the class parameters, the prices, xxx and TTT, but never on λ\lambdaλ or nnn.
  • Range of nnn. Bounds whose right side vanishes at n=1n=1n=1 because log⁡1=0\log1=0log1=0 are stated for n≥2n\ge2n≥2: the goal and (A-15).
  • Typo correction. Lemma 5's event uses nx−C9nunnx-C_9nu_nnx−C9​nun​, as in its proof, not the printed nx−C9unnx-C_9u_nnx−C9​un​.
  • Ruled out. A specific demand curve, a fixed nnn, deterministic demand, a finite price set, a known λ\lambdaλ, constants depending on λ\lambdaλ, or dropping the inventory cap would each make the statement a different and easier theorem. None is used.
  • Not included. The lower bound of Proposition 2 and the second assertion of Lemma 1 (Jπ≤JDJ^\pi\le J^DJπ≤JD for all admissible policies) are not included.

Contributions are welcome at any level: proofs of the milestones (Fact 1, Lemma 1 and Lemma 2 are self-contained), measurability and integrability lemmas for the revenue functional, and a reusable Poisson concentration library built on Mathlib's poissonMeasure.

Selected references

  • O. Besbes and A. Zeevi, Dynamic Pricing Without Knowing the Demand Function: Risk Bounds and Near-Optimal Algorithms, Operations Research 57(6):1407–1420, 2009. https://doi.org/10.1287/opre.1080.0640
  • G. Gallego and G. van Ryzin, Optimal Dynamic Pricing of Inventories with Stochastic Demand over Finite Horizons, Management Science 40(8):999–1020, 1994. https://doi.org/10.1287/mnsc.40.8.999
  • K. Talluri and G. van Ryzin, The Theory and Practice of Revenue Management, Springer, 2005. https://doi.org/10.1007/b139000
15 thms3 active usersReviewed
🏆Completed
CombinatoricsGraph TheoryTheoretical Computer Science·Captain: mikedeng1

On the Approximability of Single-Machine Scheduling with Precedence Constraints 1: A k-Fold Realizer of Size t Yields a Vertex Cover of Expected Weight at Most (2 − 2/(t/k)) Times OptimalResearch Paper

Motivation

Single-machine scheduling with precedence constraints, written 1∣prec∣∑wjCj1|\mathrm{prec}|\sum w_jC_j1∣prec∣∑wj​Cj​ in the notation of Graham et al., asks for an order of nnn weighted jobs on one machine that respects a given partial order and minimizes the weighted sum of completion times. The problem is strongly NP-hard (Lawler 1978; Lenstra and Rinnooy Kan 1978), and closing its approximability gap is listed by Schuurman and Woeginger among ten outstanding open problems in scheduling theory. Several 2-approximation algorithms are known (Schulz 1996; Hall et al. 1997; Chudak and Hochbaum 1999; Chekuri and Motwani 1999; Margot et al. 2003).

A line of work by Chudak and Hochbaum, Correa and Schulz, and Ambühl and Mastrolilli showed that the problem is a special case of minimum weighted vertex cover in a graph built from the precedence order. Ambühl, Mastrolilli, Mutsanas and Svensson (Math. Oper. Res. 36(4), 2011) observed that this graph is the graph of incomparable pairs of dimension theory, and used that identification to obtain (2−2/f)(2-2/f)(2−2/f)-approximations for orders of fractional dimension at most fff. This mission formalizes that framework: the identification of the two graphs and the rounding guarantee of the paper's Theorem 5.1.

Setting

An instance SSS consists of a finite set NNN of jobs, a partial order PPP on NNN (reflexive, antisymmetric, transitive; (i,j)∈P(i,j)\in P(i,j)∈P with i≠ji\ne ji=j means job iii finishes before job jjj starts), processing times pj≥0p_j\ge 0pj​≥0 and weights wj≥0w_j\ge 0wj​≥0.

Two jobs x,yx,yx,y are incomparable, x∥yx\parallel yx∥y, when neither (x,y)(x,y)(x,y) nor (y,x)(y,x)(y,x) lies in PPP. The set inc⁡(P)\operatorname{inc}(P)inc(P) of incomparable pairs consists of ordered pairs and is closed under swapping. A linear extension of PPP is a linear order L⊇PL\supseteq PL⊇P on NNN; it reverses (x,y)∈inc⁡(P)(x,y)\in\operatorname{inc}(P)(x,y)∈inc(P) when y<xy<xy<x in LLL. A nonempty multiset L1,…,LtL_1,\dots,L_tL1​,…,Lt​ of linear extensions is a k:tk:tk:t-realizer if every incomparable pair is reversed by at least kkk of them. The fractional dimension fdim⁡(P)\operatorname{fdim}(P)fdim(P) is the least ratio t/kt/kt/k over all k:tk:tk:t-realizers.

The vertex cover graph GPSG^S_PGPS​ has the incomparable pairs as nodes; nodes (i,j)(i,j)(i,j) and (k,ℓ)(k,\ell)(k,ℓ) are adjacent if j=kj=kj=k and i=ℓi=\elli=ℓ, or j=kj=kj=k and (i,ℓ)∈P(i,\ell)\in P(i,ℓ)∈P, or (i,ℓ),(k,j)∈P(i,\ell),(k,j)\in P(i,ℓ),(k,j)∈P (symmetrically closed). Node (i,j)(i,j)(i,j) has weight w(i,j)=piwjw_{(i,j)}=p_iw_jw(i,j)​=pi​wj​, and w(C)=∑u∈Cwuw(C)=\sum_{u\in C}w_uw(C)=∑u∈C​wu​. OPT\mathrm{OPT}OPT is the minimum weight of a vertex cover of GPSG^S_PGPS​. The LP relaxation [CS-LP] asks for x∈[0,1]inc⁡(P)x\in[0,1]^{\operatorname{inc}(P)}x∈[0,1]inc(P) with xu+xv≥1x_u+x_v\ge1xu​+xv​≥1 on every edge, minimizing ∑uwuxu\sum_u w_ux_u∑u​wu​xu​. For a solution xxx write Va={u:xu=a}V_a=\{u: x_u=a\}Va​={u:xu​=a}, and for a linear extension LLL let I1/2(L)I_{1/2}(L)I1/2​(L) be the pairs of V1/2V_{1/2}V1/2​ reversed in LLL.

The graph of incomparable pairs GPG_PGP​ (Felsner and Trotter 2000) also has the incomparable pairs as vertices; two of them are adjacent when the pair of them is a minimal set of incomparable pairs that no linear extension reverses entirely.

Formalization targets

Goal: Theorem 5.1 (p. 658)

For an instance SSS, a k:tk:tk:t-realizer L1,…,LtL_1,\dots,L_tL1​,…,Lt​ of PPP, and a half-integral optimal solution xxx of [CS-LP], put Ci=V1∪(V1/2∖I1/2(Li))C_i=V_1\cup\bigl(V_{1/2}\setminus I_{1/2}(L_i)\bigr)Ci​=V1​∪(V1/2​∖I1/2​(Li​)). Then every CiC_iCi​ is a vertex cover of GPSG^S_PGPS​, and

1t∑i=1tw(Ci)  ≤  (2−2t/k)OPT.\frac1t\sum_{i=1}^t w(C_i)\;\le\;\Bigl(2-\frac{2}{t/k}\Bigr)\mathrm{OPT}.t1​i=1∑t​w(Ci​)≤(2−t/k2​)OPT.

Milestones

  • Proposition 3.2 (p. 657): GPS=GPG^S_P=G_PGPS​=GP​.
  • Footnote 4 (p. 659): the pairs reversed by a linear extension are independent in GPSG^S_PGPS​.
  • Eq. (4): 1t∣{i:Li reverses u}∣≥k/t\frac1t|\{i: L_i\text{ reverses }u\}|\ge k/tt1​∣{i:Li​ reverses u}∣≥k/t for every incomparable pair uuu.
  • Eq. (5): 1t∑iw(I1/2(Li))≥kt w(V1/2)\frac1t\sum_i w(I_{1/2}(L_i))\ge \frac kt\,w(V_{1/2})t1​∑i​w(I1/2​(Li​))≥tk​w(V1/2​).
  • Hochbaum's observation (§5, p. 659): for half-integral feasible xxx, V1∪CV_1\cup CV1​∪C covers GPSG^S_PGPS​ whenever CCC covers GPS[V1/2]G^S_P[V_{1/2}]GPS​[V1/2​].
  • Eqs. (6)–(8): 1t∑iw(Ci)≤w(V1)+(1−kt)w(V1/2)≤2(1−kt)(w(V1)+12w(V1/2))≤(2−2t/k)OPT\frac1t\sum_iw(C_i)\le w(V_1)+(1-\frac kt)w(V_{1/2})\le 2(1-\frac kt)(w(V_1)+\frac12w(V_{1/2}))\le(2-\frac2{t/k})\mathrm{OPT}t1​∑i​w(Ci​)≤w(V1​)+(1−tk​)w(V1/2​)≤2(1−tk​)(w(V1​)+21​w(V1/2​))≤(2−t/k2​)OPT when PPP is not a linear order.

Significance

The result. Combined with the cited Theorem 2.1 (Ambühl–Mastrolilli 2009; Correa–Schulz 2005), which turns an α\alphaα-approximate vertex cover of GPSG^S_PGPS​ into an α\alphaα-approximate schedule, Theorem 5.1 gives a (2−2/f)(2-2/f)(2−2/f)-approximation for 1∣prec∣∑wjCj1|\mathrm{prec}|\sum w_jC_j1∣prec∣∑wj​Cj​ whenever the precedence order has an efficiently samplable realizer with t/k≤ft/k\le ft/k≤f. The paper applies it to interval orders (3/23/23/2), convex bipartite orders and semiorders (4/34/34/3), orders of bounded degree and orders of interval dimension two; for the earlier special classes it matched or improved the best known ratios, and for the last two it gave the first results. Proposition 3.2 makes the dimension theory of posets (realizers, critical pairs, fractional dimension) directly available to the vertex cover approach.

Formalizing it. The results are proved in the paper; to the best of current knowledge none of them has a machine-checked proof. The mission produces a Lean development of incomparable pairs, linear extensions, kkk-fold realizers and the hypergraph of incomparable pairs, which other dimension-theory missions can reuse, and a verified LP-rounding argument for half-integral vertex cover solutions under a distribution of independent sets.

Difficulty

Most of the rounding argument is arithmetic over finite sums. The central nontrivial step is the inclusion GP⊆GPSG_P\subseteq G^S_PGP​⊆GPS​ in Proposition 3.2: for two incomparable pairs that are not adjacent under the three-case rule, one must construct a single linear extension reversing both. This needs an extension of PPP by two new comparabilities whose transitive closure is still antisymmetric, followed by Szpilrajn's theorem; checking that every potential cycle is excluded by the three cases is the actual content. The opposite inclusion, and footnote 4, follow from transitivity and antisymmetry of linear orders. A second point of care is the inequality t≥2kt\ge 2kt≥2k used in step (7): it is not part of the definition of a realizer, and follows from each linear extension reversing exactly one of (x,y)(x,y)(x,y) and (y,x)(y,x)(y,x).

Formalization scope

  • Jobs form a finite type N; the precedence order is a relation P : N → N → Prop with IsPartialOrder, carried by the structure Instance. Processing times and weights are nonnegative reals.
  • inc⁡(P)\operatorname{inc}(P)inc(P) is the subtype IncPair P of N × N; a linear extension is a relation with IsLinearOrder containing P; a k:tk:tk:t-realizer is a family Fin t → LinearExtension P with t>0t>0t>0. Reversal of (x,y)(x,y)(x,y) means y<xy<xy<x in LLL throughout; the page's "y>xy>xy>x" in Eq. (4) and "Prob[j>i]\mathrm{Prob}[j>i]Prob[j>i]" in Eq. (5) are the same family of inequalities because inc⁡(P)\operatorname{inc}(P)inc(P) is symmetric.
  • GPSG^S_PGPS​ is the symmetric closure of the printed three-case rule on distinct nodes. GPG_PGP​ is defined through linear extensions and hyperedge minimality, never through the three-case rule, so Proposition 3.2 is a genuine statement and not a definitional equality.
  • [CS-LP] drops the constant term ∑jpjwj+∑(i,j)∈Ppiwj\sum_jp_jw_j+\sum_{(i,j)\in P}p_iw_j∑j​pj​wj​+∑(i,j)∈P​pi​wj​ of [CS-IP], which does not affect optimality. OPT\mathrm{OPT}OPT is the minimum weight of a vertex cover of GPSG^S_PGPS​, taken over a finite nonempty family.
  • Not formalized: "efficiently samplable", "polynomial time" and "randomized algorithm". The expectation over a uniformly sampled LiL_iLi​ is stated as the average 1t∑i=1t\frac1t\sum_{i=1}^tt1​∑i=1t​, which is equivalent to it and stronger than the existence of one good index. The existence of a half-integral optimal [CS-LP] solution (Nemhauser–Trotter, cited) is a hypothesis on xxx. The conversion of a vertex cover into a schedule (Theorem 2.1, cited) is not formalized; the goal is stated for vertex covers of GPSG^S_PGPS​.
  • Constants: 2−2/(t/k)2-2/(t/k)2−2/(t/k) in real arithmetic; it equals 2−2k/t2-2k/t2−2k/t, and equals 222 when k=0k=0k=0.
  • The paper assumes fdim⁡(P)≥2\operatorname{fdim}(P)\ge2fdim(P)≥2, i.e. PPP is not a linear order. Eqs. (6)–(8) carry that hypothesis as the paper does; the goal omits it because for a linear order both sides are 000.
  • Conclusion (a), that each CiC_iCi​ is a vertex cover, is part of the goal and is not assumed.

Contributions welcome: proofs of the milestones in any order, and a reusable Szpilrajn-style lemma producing a linear extension that reverses a prescribed set of compatible incomparable pairs.

Selected references

  • C. Ambühl, M. Mastrolilli, N. Mutsanas, O. Svensson, On the approximability of single-machine scheduling with precedence constraints, Math. Oper. Res. 36(4):653–669, 2011. https://doi.org/10.1287/moor.1110.0512
  • C. Ambühl, M. Mastrolilli, Single machine precedence constrained scheduling is a vertex cover problem, Algorithmica 53(4), 2009 (reference [2] of the paper).
  • J. R. Correa, A. S. Schulz, Single-machine scheduling with precedence constraints, Math. Oper. Res. 30(4):1005–1021, 2005. https://doi.org/10.1287/moor.1050.0158
  • G. R. Brightwell, E. R. Scheinerman, Fractional dimension of partial orders, Order 9(2):139–158, 1992 (reference [7]).
  • S. Felsner, W. T. Trotter, Dimension, graph and hypergraph coloring, Order 17(2):167–177, 2000 (reference [13]).
  • D. S. Hochbaum, Efficient bounds for the stable set, vertex cover and set packing problems, Discrete Appl. Math. 6(3):243–254, 1983 (reference [20]).
  • G. L. Nemhauser, L. E. Trotter, Vertex packings: structural properties and algorithms, Math. Programming 8(1):232–248, 1975 (reference [29]).
10 thms3 active usersReviewed
PreviousPage 11 of 44Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me