The discipline of applying mathematical analysis to complex decision problems in operations: allocating scarce resources, scheduling, routing, inventory, and the design of service and production systems. Drawing on mathematical programming, stochastic modeling, queueing, simulation, and game-theoretic reasoning, it seeks policies that perform provably well in systems shaped by constraints, congestion, and uncertainty.
An Exact Algorithm for the Two-Echelon Capacitated Vehicle Routing Problem 2: The Best Lagrangean Bound of the Integer Relaxation RF Is at Least the LP Relaxation Bound, Sometimes StrictlyResearch Paper
Motivation
In two-echelon distribution goods travel from a central depot to intermediate facilities, called satellites, on large first-level vehicles, and from the satellites to customers on smaller second-level vehicles. City logistics schemes that keep heavy trucks out of urban centres are the standard example. The two-echelon capacitated vehicle routing problem (2E-CVRP) asks for the cheapest set of routes on both levels that serves every customer while respecting vehicle, fleet and satellite capacities.
Exact methods for problems of this kind are branch-and-bound or enumeration schemes whose speed depends on the quality of the lower bounds they use. Baldacci, Mingozzi, Roberti and Wolfler Calvo (Oper. Res. 61(2), 2013) built their exact algorithm on a Lagrangean-type relaxation RF of a set-partitioning formulation F, rather than on the LP relaxation LF of that formulation. Their Theorem 2 is the justification for that design choice: the best bound RF can deliver is never weaker than z(LF), and can be strictly stronger. This mission formalizes that comparison.
Setting
An instance has a depot 0, satellites NS and customers NC, a symmetric travel cost duv (in which the fixed vehicle costs U1,U2 have already been folded into the depot–satellite and satellite–customer entries), positive integer demands qi, capacities Q1>Q2>0 for first- and second-level vehicles, a bound m1 on first-level vehicles, mk second-level vehicles at satellite k, a global bound m2≤∑kmk on second-level vehicles, a capacity Bk and a unit handling cost Hk for each satellite.
A first-level router∈M leaves the depot, visits a set Rr of satellites and returns; its cost gr is the cost of that closed walk. A second-level routel∈Rk leaves satellite k, visits a set Rkl of customers and returns; its load is wkl=∑i∈Rklqi≤Q2, aikl counts its visits to customer i, and its cost ckl is its closed-walk cost plus Hkwkl.
Formulation F uses binaries xkl (route l of satellite k is used), binaries yr, and nonnegative integers qkr (quantity route r delivers to satellite k∈Rr). It minimizes ∑cklxkl+∑gryr subject to: each customer is covered exactly once (2); at most mk routes at satellite k (3) and m2 overall (4); the load delivered from satellite k is at most Bk (5); at most m1 first-level routes (6); what first-level routes bring to satellite k equals what its second-level routes carry (7); and ∑k∈Rrqkr≤Q1yr (8).
The LP relaxation LF replaces the integrality of x,y,q by 0≤x,y≤1, q≥0. Its value is z(LF), equal to +∞ when LF is infeasible.
The relaxation RF(β,λ,μ) relaxes (2)–(4) with penalties λ∈RNC, μk≤0 and μ0≤0, and replaces the second-level routes by marginal routing costsβik that must satisfy, for every route l∈Rk,
i∑aiklβik≤ckl−i∑aiklλi−μk−μ0.(12)
Its variables are binaries ξik (customer i is supplied from satellite k), yr and qkr; it minimizes
k,i∑βikξik+r∑gryr+i∑λi+k∑mkμk+m2μ0
subject to single assignment of each customer, flow balance ∑r∈Mkqkr=∑iqiξik, satellite capacity ∑iqiξik≤Bk, and (6), (8). A choice (β,λ,μ,μ0) with μ,μ0≤0 and (12) is admissible.
Formalization targets
Goal: Theorem 2
β,λ,μmaxz(RF(β,λ,μ))≥z(LF),and the inequality can be strict.
Formally: (1) for every instance and route families whose LF is feasible, some admissible (β,λ,μ,μ0) satisfies z(LF)≤z(RF(β,λ,μ)); (2) some instance, route families and admissible choice give z(LF)<z(RF(β,λ,μ))<+∞.
Milestones
§3, remark on LF: if every gr>0, every optimal LF solution has yr=(∑k∈Rrqkr)/Q1.
Theorem 2, first clause: the bound, for every instance with LF feasible.
Theorem 2, second clause: the strict instance.
Significance
Theorem 2 places the relaxation RF in the hierarchy of bounds for the 2E-CVRP. The remark on LF explains its weakness: in the LP relaxation each first-level route is paid for only in proportion to the load it carries, so z(LF) degrades as first-level routing costs grow. RF keeps yr binary and therefore pays the full cost of every first-level route used, while the second-level routing is priced through β. The theorem guarantees that optimizing over penalties never loses against the LP bound, which is what makes the bounds LD1 and the further relaxation RF of the paper worth computing.
The paper's proof is in its electronic companion and is not reproduced in the article. A formal proof makes the comparison checkable, and fixes the exact conditions under which it holds: the remark on LF needs positive first-level route costs, and the "max" in Theorem 2 is attained only when LF is feasible. Neither part is formalized elsewhere. Linear programming strong duality is available on the platform as LinearOptimization.lp_strong_duality (Bertsimas and Tsitsiklis, Theorem 4.4, Proved); a related but different statement is LinearOptimization.lagrangean_dual_eq_lp_over_hull (Theorem 11.4 there), which concerns the Lagrangean dual of a generic integer program rather than RF.
Difficulty
RF is not the Lagrangean dual of F in the textbook sense: it changes the variables (customer-to-satellite assignments ξ instead of routes x), keeps the assignment constraints, and couples the multipliers through the inequalities (12). So the general fact that a Lagrangean dual is at least the LP bound does not apply directly; one must construct, from the data of LF, an admissible β that is compatible with the flow-balance and capacity constraints of RF. For the strict clause, the instance must satisfy every structural requirement of the model (positive demands, Q2<Q1, route loads at most Q2, m2≤∑kmk), and RF must be feasible, so that the gap is a genuine gap between finite bounds.
Formalization scope
Satellites and customers are Fin ns and Fin nc (0-based). The travel cost is an arbitrary symmetric real matrix; the triangle inequality is not assumed. Demands are positive integers. Route families M, R are arbitrary finite families of nonempty elementary routes (repetitions allowed), with costs computed from d along the closed walk, so the statements cover the paper's families of all routes as a special case. Binary variables are Bool, integer quantities ℕ, LF variables real. Optimal values are infima over the feasible set in EReal, +∞ for an infeasible problem; there is no junk value 0.
Part 1 of the goal assumes LF feasible: when LF is infeasible the printed relation would read "sup=+∞", which is not attained by any single choice of penalties. Part 2 requires z(RF)<+∞, which rules out the trivial witness of an instance with RF infeasible; admissibility includes μ,μ0≤0, without which the supremum is +∞ for trivial reasons.
The definitions (instance, route systems, F, LF, (12), RF) are shared in shape with the two companion missions of this series and are intended for consolidation. Proofs of the bound will need finite-dimensional LP duality; contributions that connect LF to the platform's general-form LP and its strong duality theorem are welcome.
Selected references
R. Baldacci, A. Mingozzi, R. Roberti, R. Wolfler Calvo, An Exact Algorithm for the Two-Echelon Capacitated Vehicle Routing Problem, Operations Research 61(2), 298–314, 2013. https://doi.org/10.1287/opre.1120.1153
D. Bertsimas, J. N. Tsitsiklis, Introduction to Linear Optimization, Athena Scientific, 1997 (Theorem 4.4, strong duality; Theorem 11.4, Lagrangean duality).
Efficiency of Coordinate Descent Methods on Huge-Scale Optimization Problems 3: For Block-Constrained Problems, Uniform Coordinate Descent Has Rate n/(n + k), Linear Under Strong ConvexityResearch Paper
Motivation
Coordinate descent methods update one block of variables at a time. They are the method of choice when the number of variables is so large that even one full gradient is too expensive, while a single partial derivative is cheap: support vector machines, ℓ1-regularized regression, and large sparse least-squares problems are the standard examples. Yu. Nesterov's paper Efficiency of coordinate descent methods on huge-scale optimization problems (CORE Discussion Paper 2010/2; journal version SIAM J. Optim. 22 (2012), doi:10.1137/100802001) gave the first global efficiency estimates for randomized coordinate descent, and these estimates started a large literature on random coordinate and block methods.
Many applications carry simple constraints on each block: bounds on each variable, a simplex or a ball per block. Section 4 of the paper shows that randomized coordinate descent handles such block-separable constraints at no loss: a projected block step, chosen uniformly at random, enjoys the same O(n/k) expected rate as the unconstrained method, and a linear rate under strong convexity. This mission formalizes that result, Theorem 5.
Setting
The space RN is split into n≥1 blocks, RN=Rn1×⋯×Rnn with N=∑ini and every ni≥1. A point x is the family of its blocks x(i)∈Rni, and Uih is the point whose i-th block is h and whose other blocks are zero. Each block carries a Euclidean norm∥h∥(i)2=⟨Bih,h⟩ with Bi≻0 (3.4).
The objective f:RN→R is convex and differentiable, and its gradient is coordinate-wise Lipschitz (2.2): writing fi′(x)=UiT∇f(x) for the i-th block of the gradient, there are constants Li>0 with
∥fi′(x+Uih)−fi′(x)∥(i)∗≤Li∥h∥(i)for all x,i,h.
The weighted norm is ∥x∥12=∑iLi∥x(i)∥(i)2 (3.5). The function f is strongly convex in ∥⋅∥1 with constant σ>0 if f(y)≥f(x)+⟨∇f(x),y−x⟩+2σ∥y−x∥12 for all x,y (3.1).
The problem is (4.1), minx∈Qf(x) with Q=Q1×⋯×Qn and each Qi⊆Rni nonempty, closed and convex. Its optimal value is f∗, attained at an optimal solutionx∗∈Q. The constrained coordinate update (4.2) is
The uniform coordinate descent method UCDM(x0) (4.5) draws ik uniformly from {1,…,n} and sets xk+1=Vik(xk). Its expected objective is φk=Ef(xk), the expectation over i0,…,ik−1. The level-set radiusR1(x0) is the largest ∥⋅∥1-distance between a feasible x with f(x)≤f(x0) and an optimal solution.
Formalization targets
Goal: Theorem 5
For every k≥0,
φk−f∗≤n+kn[21R12(x0)+f(x0)−f∗],
and, if f is strongly convex in ∥⋅∥1 with constant σ>0,
(4.3): the optimality condition ⟨fi′(x)+LiBi(u(i)(x)−x(i)),u−u(i)(x)⟩≥0 for all u∈Qi.
(4.4): for feasible x, f(x)−f(Vi(x))≥2Li∥u(i)(x)−x(i)∥(i)2.
(4.7): with rk=∥xk−x∗∥1, Eik(21rk+12+f(xk+1)−f∗)≤21rk2+f(xk)−f∗+n1⟨∇f(xk),x∗−xk⟩.
Footnote 2: under (2.2), the strong convexity constant satisfies σ≤1.
Significance
The result. Theorem 5 shows that the cost of a constrained problem with separable constraints is, up to the projection onto each Qi, the cost of the unconstrained one: O(n/ϵ) block steps for accuracy ϵ, and O(σnlogϵ1) under strong convexity. The method needs no knowledge of σ; the same iteration attains whichever rate applies. The Lyapunov function 21∥x−x∗∥12+f(x)−f∗ of (4.7) needs no level-set argument, so it applies wherever the projected step is cheap.
Formalizing it. The theorem is proved in the paper; no machine-checked proof of it, or of any rate for a randomized constrained coordinate method, appears in the Prove2Me catalogue or in Mathlib. The Prove2Me catalogue holds Bubeck's scalar, unconstrained random coordinate descent results (ConvexOptAlg.CoordDescent.*) and the deterministic Tseng–Yun coordinate gradient descent; neither covers a projected block step. A formalization produces the first verified rate for a randomized method with constraints, and a reusable model of block-structured spaces, block projections and expectations over random index sequences.
Difficulty
The unconstrained analysis of the paper (Theorem 1) bounds the distance to the optimum by a level-set radius and uses the decrease f(x)−f(Ti(x))≥(∥fi′(x)∥(i)∗)2/(2Li) of a gradient step. Neither carries over: with constraints the gradient at the optimum need not vanish, so the decrease of a projected step is not controlled by the gradient norm, and the unconstrained recursion φk−φk+1≥(φk−f∗)2/C is not available. A different potential is needed, and its one-step estimate (4.7) is the central milestone. For the linear rate, the contraction factor must be shown nonnegative without assuming σ≤1, which is where footnote 2 enters.
Formalization scope
RN is the dependent product Blocks E=∏i:FinnEi, each Ei a finite-dimensional real inner product space whose inner product is the paper's ⟨Bi⋅,⋅⟩. Indices are 0-based. The dual norm is the operator norm of linear functionals, and fi′(x) is the Fréchet derivative of f composed with the block inclusion. Random draws are explicit index sequences, so φk is the finite average of f(xk) over all nk sequences of draws; no measure theory is involved.
Explicit choices where the paper is silent:
n≥1, every block nontrivial (ni≥1), and Li>0 are hypotheses.
Every Qi is nonempty, and x0∈Q. The paper leaves both implicit; without x0∈Q the iterates are infeasible and φk−f∗ can be negative.
u(i)(x) is a choice among the minimizers of the block subproblem. Under the hypotheses the minimizer exists and is unique, so the choice is the paper's update.
R1(x0) is never computed: the theorem takes any R with ∥x−x∗∥1≤R for every feasible x with f(x)≤f(x0) and every optimal solution x∗. This is equivalent to the paper's bound when R1(x0) is finite and avoids the default value of a supremum. The level set is taken inside Q, the reading of the p. 7 definition for problem (4.1).
f∗ is the constrained optimum f(x∗) for an optimal solution x∗∈Q, not an unconstrained minimum.
Strong convexity is (3.1) on all of RN in ∥⋅∥1. The linear rate does not assume σ≤1; footnote 2 derives it.
Printed typos are corrected in the Lean: UiT in (4.2) is Ui; ui in (4.3) is u(i).
A formalization in which the update is an arbitrary point of Qi or an unprojected gradient step, the draws are not uniform, or f∗ is the unconstrained minimum, proves a different theorem and is ruled out by the definitions above.
Needed infrastructure: existence and the variational characterization of the minimizer of a strongly convex quadratic over a closed convex set (Mathlib has projections onto closed convex sets in Hilbert spaces), the block descent inequality (2.3) obtained from (2.2), and manipulation of the finite expectations over index sequences (conditioning on the last draw). The block model, the weighted norm and the expectation are shared with the other missions of this series. Proofs of the milestones, and of (2.3) as a supporting lemma, are welcome.
Selected references
Yu. Nesterov, Efficiency of coordinate descent methods on huge-scale optimization problems, CORE Discussion Paper 2010/2, Université catholique de Louvain, 2010. https://core.ac.uk/download/6430808.pdf
Yu. Nesterov, Efficiency of coordinate descent methods on huge-scale optimization problems, SIAM Journal on Optimization 22(2) (2012), 341–362. https://doi.org/10.1137/100802001
Yu. Nesterov, Introductory Lectures on Convex Optimization: A Basic Course, Kluwer, 2004 (Section 2.1, cited in the proof). https://doi.org/10.1007/978-1-4419-8853-9
P. Tseng and S. Yun, A coordinate gradient descent method for nonsmooth separable minimization, Mathematical Programming 117 (2009), 387–423. https://doi.org/10.1007/s10107-007-0170-0
An Exact Algorithm for the Two-Echelon Capacitated Vehicle Routing Problem 3: Every Solution Cheaper Than an Upper Bound Uses a Configuration of First-Level Routes Passing the Pruning TestsResearch Paper
Motivation
City logistics often moves goods in two stages: large trucks bring freight from a central depot to a few intermediate satellites, and small vehicles distribute it from the satellites to the customers. The two-echelon capacitated vehicle routing problem (2E-CVRP) is the basic optimization model of such systems; it contains the capacitated location-routing problem as a special case. Baldacci, Mingozzi, Roberti and Wolfler Calvo (Oper. Res. 61(2), 2013) gave an exact method that solved benchmark instances out of reach for earlier algorithms.
Their method does not attack the whole problem at once. It enumerates configurations, sets of first-level (depot–satellite) routes, discards most of them with cheap tests, and solves a second-level problem only for the survivors. The correctness of the method rests on two facts stated in §5 of the paper: the problem decomposes exactly over configurations (Eq. (26)), and the pruning tests of Propositions 1 and 2 never discard the configuration of a solution better than the incumbent. This mission formalizes those facts.
Setting
An instance has a depot 0, satellites NS and customers NC, a symmetric cost d on the edges (with the fixed vehicle costs folded in), positive integer demands qi with total qtot, m1 first-level vehicles of capacity Q1, mk second-level vehicles of capacity Q2<Q1 at satellite k with a global limit m2, satellite capacities Bk and handling costs Hk.
A first-level router∈M leaves the depot, visits a set Rr of satellites and returns; its cost gr is the length of the closed walk. A second-level routel∈Rk leaves satellite k, visits a set Rkl of customers of total demand wkl≤Q2 and returns; its cost ckl is the walk length plus Hkwkl. Formulation F chooses binary xkl, yr and integer deliveries qkr≥0 minimizing ∑cklxkl+∑gryr subject to: each customer on exactly one used second-level route; at most mk used routes at k and m2 in total; load at k at most Bk; at most m1 first-level routes; the deliveries to k equal the load leaving k; each used first-level route carries at most Q1. Its optimal value is z(F), +∞ when infeasible.
The set of configurations is
P={M⊆M:∣M∣Q1≥qtot,∣M∣≤m1}.
For M⊆M, NS(M)=⋃r∈MRr, Mk={r∈M:k∈Rr} and U(M)=∑r∈Mgr. Problem F(M) is F with the first-level routes fixed to M: second-level routes only at satellites of NS(M), real deliveries qkr≥0 for r∈M, and ∑k∈Rrqkr≤Q1. Its value z(F(M)) is +∞ when infeasible.
The bounds of §5.1 use multipliers λi, μk≤0, μ0≤0 and marginal costs βik satisfying the penalty system (12), ∑iaiklβik≤ckl−∑iaiklλi−μk−μ0 for every route l of satellite k:
§5.1: LBR is at most the second-level routing cost of every feasible solution of F.
§5.1: LBW(M)≤z(F(M)).
Proposition 2: if θ(k) bounds from below the supply to satellite k in every feasible solution of F(M), and ∑k∈NS(M)⌈θ(k)/Q2⌉>m2 or ⌈θ(k)/Q2⌉>mk for some k∈NS(M), then F(M) is infeasible.
§5.2.2, Eq. (33): the capacity constraints ∑k∈NS(M)∑l:Rkl∩H=∅xkl≥⌈∑i∈Hqi/Q2⌉, ∣H∣≥2, hold for every feasible solution of F(M).
Significance
Eq. (26) is what makes the method exact: once every configuration that can carry a solution better than the incumbent is examined, the best U(M)+z(F(M)) is the optimum. Propositions 1 and 2 are what make it fast: they remove configurations from P before any second-level problem is solved. If a pruning test discarded the configuration of a cheaper solution, the method would return a suboptimal value and still report it as optimal; the formal statements rule this out for every instance, not just the benchmark ones. The capacity constraints (33) play the same role inside F(M): a cut that removed a feasible solution would make the bound z(Fˉ(M)) invalid.
The paper's proofs are in an electronic companion; none of these statements has been machine-checked before, and none is on the platform. The formalization also records exactly what the tests need: positive demands, integral vehicle counts, and the sign conditions on the multipliers, and nothing about the optimality of the incumbent.
Difficulty
Most statements are elementary counting and Lagrangean weak-duality arguments over finite index sets. The work lies in the bookkeeping between two formulations with different index sets: F sums over all satellites, F(M) only over NS(M), and a solution of one must be turned into a solution of the other. One step is not elementary: F has integer deliveries and F(M) real ones, so the inequality z(F)≤U(M)+z(F(M)) in (26) needs an integral delivery plan from a fractional one. That is an integrality property of a bipartite transportation problem (routes to satellites, integral capacities and demands), which no counting argument gives.
Formalization scope
Satellites and customers are Fin ns and Fin nc, 0-based. The route families M and R are arbitrary finite families of elementary routes with costs computed along the closed walk; the paper uses all such routes, so every statement here is a generalization. Demands are positive integers; the triangle inequality is not assumed. Binary variables are Bool; optimal values are infima in EReal, with ⊤ for an infeasible problem. A configuration is a Finset of route indices. The penalties are any λ, μ≤0, μ0≤0 and β satisfying (12), not only those producing the paper's bound LD1. Ceilings of qtot/Q2 and ∑i∈Hqi/Q2 are natural-number ceilings of rationals; those in Proposition 2 are integer ceilings of reals.
The goal departs from the printed proposition in three disclosed ways. Only necessity is stated: the "if" direction is false, because (b)–(e) ignore the satellite capacities Bk. Condition (a), ∣Rr∩Rr′∣≤1, is omitted: it holds for some optimal solution, not every one (its split-delivery analogue is posed, and open, on the platform as SplitDeliveryVRPTW.Known.exists_optimal_split_customers; it is not reused here). "An optimal solution" becomes "a feasible solution of cost below z(UB)", the property the paper's own justification uses. Proposition 2 is stated with θ as a hypothesis; the paper's computation of θ by problem (27)–(32) is not formalized, because (32) forces positive deliveries that F(M) does not require. The goal is not trivialized by an infeasible hypothesis: feasible solutions of F exist on small instances, and a toy instance was checked in Lean.
A complete development needs finite-sum manipulations, Lagrangean weak duality for (12), and, for (26), integrality of bipartite transportation polytopes, which is reusable well beyond this mission. Proofs of any milestone, and a general transportation-integrality lemma, are welcome.
Selected references
R. Baldacci, A. Mingozzi, R. Roberti, R. Wolfler Calvo, An Exact Algorithm for the Two-Echelon Capacitated Vehicle Routing Problem, Operations Research 61(2), 298–314, 2013. https://doi.org/10.1287/opre.1120.1153
R. Baldacci, A. Mingozzi, A unified exact method for solving different classes of vehicle routing problems, Mathematical Programming 120(2), 347–380, 2009. https://doi.org/10.1007/s10107-008-0218-9
G. Perboli, R. Tadei, D. Vigo, The two-echelon capacitated vehicle routing problem: models and math-based heuristics, Transportation Science 45(3), 364–380, 2011. https://doi.org/10.1287/trsc.1110.0368
Time-Inconsistent Stochastic Linear–Quadratic Control II: With a Scalar State and Deterministic Coefficients, Coupled Riccati Equations Give an Explicit Linear Feedback EquilibriumResearch Paper
Motivation
In a time-inconsistent control problem, a control that is optimal when planned at time t stops being optimal when the problem is re-solved at a later time. Two sources of time inconsistency are common in finance and economics. One is a variance term in the objective, as in continuous-time Markowitz mean–variance portfolio selection (Zhou–Li 2000; Basak–Chabakauri 2010). The other is a state-dependent target, as in Björk–Murgoci–Zhou 2014. Dynamic programming does not apply. A standard response is to look for an equilibrium: a control that no planner at any time t can improve by an infinitesimal deviation on [t,t+ε).
Hu, Jin and Zhou define open-loop equilibria for a general stochastic linear–quadratic (LQ) problem with both sources of time inconsistency. They give a sufficient condition through a flow of forward–backward SDEs, which is the subject of mission I of this series. This mission covers §4 of the paper: the scalar-state case with deterministic coefficients, where the equilibrium is computed explicitly from a system of coupled Riccati equations. Mission III covers §5, the mean–variance application with random coefficients.
Setting
On a probability space carrying a standard d-dimensional Brownian motion W with its filtration (Ft), the state X is scalar (n=1) and the control u takes values in Rl:
The coefficients are deterministic functions on [0,T]: As,bs,Qs∈R, Bs∈Rl, Cs,σs∈Rd, Ds∈Rd×l and Rs∈Rl×l symmetric. A,B,C,D,Q,R are bounded, b,σ are square integrable, Q≥0, R⪰0, and G≥0. At time t, in state xt, the planner evaluates
where Et=E[⋅∣Ft]. The third term (the variance-like term) and the fourth term (which depends on xt) make the problem time-inconsistent. A control u∗ with state X∗ is an equilibrium (Definition 2.1) if, for every t∈[0,T) and every Ft-measurable square-integrable v, the spike ut,ε,v=u∗+v1[t,t+ε) satisfies
ε↓0liminfεJ(t,Xt∗;ut,ε,v)−J(t,Xt∗;u∗)≥0.
With Γs(1)=μ1e∫sTArdr, ∣C∣2=C′C and K=(R+MD′D)−1, the coupled Riccati system (4.9) for deterministic (M,N) is
(i) R⪰δI, lQD′D+∣C∣2R+Γ(1)S(D′CB′)⪰0 and B=λD′C with λ≥0;
(ii) the first two conditions of (i) and D′D⪰δI;
(iii) R≡0, D′D⪰δI, Q+Γ(1)B′(D′D)−1(B+D′C)≥0 and Q+Γ(1)B′(D′D)−1D′C≥0.
Then
(4.9) has a unique positive solution pair (M,N) on [0,T],
and, for every solution Φ of (4.8), the closed-loop equation of (4.4) has a solution, and the feedback control along every closed-loop state is an equilibrium.
Milestones
Proposition 4.1: a positive solution (M,J) of the transformed system (4.10) gives the positive solution (M,M/J) of (4.9).
Theorem 4.2: existence and uniqueness of positive solutions of (4.10) and (4.9) in the standard case R⪰δI.
Theorem 4.3: existence for (4.13) and (4.9) in the singular case R≡0.
Three steps from the proof of Theorem 4.4:
α is bounded, so u∗ is admissible and X∗ has continuous paths with Esups∣Xs∗∣2<∞;
the ansatz p(s;t)=MsXs∗−NsEt[Xs∗]−Γs(1)Xt∗+Φs, k(s;t)=Ms[CsXs∗+Dsus∗+σs] solves the adjoint flow (3.10);
the identity Λ(s;t)=Ns[Xs∗−EtXs∗]Bs+Γs(1)(Xs∗−Xt∗)Bs holds, and Λ satisfies condition (3.4).
Significance
The theorem gives an equilibrium in closed form, as a linear feedback of the current state with deterministic gains. That makes the equilibrium computable and comparable with the classical, time-consistent LQ regulator. Setting h=μ1=0 recovers a standard LQ problem, but (4.9) differs from the classical Riccati equation even then: it is a nonsymmetric coupled system (footnote 2, p. 10), and the cases (i)–(iii) are the conditions under which it is solvable. The mean–variance results of §5 (mission III) follow the same pattern.
The result is proved in the paper; to our knowledge it has not been formalized. A formal proof needs global existence for a nonlinear, nonautonomous ODE system with Carathéodory coefficients, obtained by truncation and a priori bounds. It also needs linear SDEs with bounded feedback, Itô calculus for products of deterministic and Itô processes, and the sufficient condition of mission I. Uniqueness in case (iii) is claimed by Theorem 4.4 but not proved in Theorem 4.3; it is part of the goal.
Difficulty
The system (4.9) is quadratic in (M,N). Its solutions can blow up in finite time, and (R+MD′D)−1 can degenerate when M changes sign. Picard–Lindelöf therefore gives only local solutions, and a global solution needs a priori bounds 0<η≤M≤L and J≥1, with η and L independent of the truncation level. Those bounds are where the case hypotheses enter. In the stochastic half, the equilibrium property is not proved by computing J directly. It requires checking that the explicit candidate meets the flow-of-FBSDE sufficient condition, and the flow carries a parameter t and the conditional expectations Et[Xs∗] for every s≥t.
Formalization scope
The general model (data, standing assumptions, states, conditional cost, spike, equilibrium) is stated for arbitrary n and instantiated at n=1 through toData. It is built on the published substrate Peng1990_SMP_Stochastic (Brownian motion, natural filtration, LF2, Itô integrals, SDE solutions). The formalization commits to the following choices.
Definition 2.1 uses liminf in R, along every sequence εk↓0, almost surely for each sequence, and for every version of the state and of the perturbed states. The page writes lim, which need not exist.
The filtration is the natural, uncompleted filtration of W, not the augmented one.
The state from time t is encoded through the full horizon. The spike is additive on [t,t+ε).
"Essentially bounded" and "a.s., a.e." are read dP⊗ds-a.e.
Every ODE ((4.8), (4.9), (4.10), (4.13)) is stated in integral form on [0,T], because the coefficients are only bounded measurable. A solution includes invertibility of R+MD′D (resp. D′D) on [0,T]. Uniqueness means agreement on [0,T].
The constants δ,λ are uniform in s, and the case conditions hold for every s∈[0,T]. In lQD′D+∣C∣2R, l is the control dimension.
"Let Φ be a solution of (4.8)" means every solution. "u∗ is an equilibrium" means that a closed-loop state exists and that the feedback is an equilibrium along every closed-loop state.
Conditional-expectation families Et[Xs∗] are handled through arbitrary progressive versions. Condition (3.4) is stated exactly: its first part as a localization on Ft-sets, its second part with a jointly measurable version and "a.e. s".
The paper's "β uniformly bounded" is false when σ is only square integrable. The milestone states the true claim: α is essentially bounded on [0,T] (the coefficients are only essentially bounded) and β is square integrable.
The goal's conclusion is Definition 2.1 itself; it does not mention Λ, p or (3.4). Existence of the closed-loop state is asserted, not assumed. A formalization that assumes existence, or that replaces equilibrium by condition (3.4), is a different and weaker theorem.
Theorem 3.3 (the n=1 sufficient condition) is not posed here. Under the shared model it is mission I's goal at n=1. Contributions are welcome on the ODE layer (truncation, comparison and Gronwall bounds for Carathéodory systems), on linear SDEs with bounded feedback, and on the Itô product rule. These parts are reusable well beyond this paper.
Selected references
Y. Hu, H. Jin, X. Y. Zhou, Time-Inconsistent Stochastic Linear–Quadratic Control, arXiv:1111.0818v1, 2011; SIAM J. Control Optim. 50(3), 2012. https://arxiv.org/abs/1111.0818
S. Basak, G. Chabakauri, Dynamic mean–variance asset allocation, Review of Financial Studies 23(8), 2010. https://doi.org/10.1093/rfs/hhq028
X. Y. Zhou, D. Li, Continuous-time mean–variance portfolio selection: a stochastic LQ framework, Applied Mathematics and Optimization 42, 2000. https://doi.org/10.1007/s002450010003
S. Peng, A general stochastic maximum principle for optimal control problems, SIAM J. Control Optim. 28(4), 1990. https://doi.org/10.1137/0328054
Matroid Prophet Inequalities 2: On an Intersection of p Matroids, the Summed-Threshold Algorithm Earns at Least 1/(4p−2) of the Expected OptimumResearch Paper
Motivation
A prophet inequality compares a gambler who sees independent random rewards one at a time, and must accept or reject each on arrival, with a prophet who sees all rewards in advance. The classical inequality of Krengel, Sucheston and Garling (1977–78, as cited in the paper) says that when only one reward may be kept, a single threshold rule earns at least half of E[maxiXi], and Samuel-Cahn (1984) showed that the threshold can be chosen as a median. Such statements are the analytical core of sequential posted-price mechanisms: Hajiaghayi, Kleinberg and Sandholm (2007) observed that threshold rules are truthful online auctions, and Chawla, Hartline, Malec and Sivan (2010) showed that sequential posted prices approximate the optimal Bayesian revenue in many settings, with prophet inequalities for the feasibility constraint as the key technique.
When several items may be accepted subject to a combinatorial constraint, the natural constraints in this application are matroids (for example, at most k items, or at most one item per group) and intersections of matroids (for example, bipartite matchings, which are intersections of two partition matroids). Kleinberg and Weinberg (STOC 2012) proved that for every matroid there is an online algorithm with expected payoff at least half of the expected maximum-weight basis, and that for the intersection of p matroids the summed version of the same algorithm earns at least 4p−21 of the expected optimum. This mission formalizes the second result.
Timeline:
1977–78: Krengel–Sucheston and Garling, single-choice prophet inequality with factor 2.
1984: Samuel-Cahn, the median threshold rule attains factor 2.
2007: Hajiaghayi–Kleinberg–Sandholm, threshold rules from prophet inequalities read as truthful online auction mechanisms.
2010: Chawla–Hartline–Malec–Sivan, sequential posted pricing; factor 2 for matroids when the algorithm may choose the order in which elements are observed.
2012: Kleinberg–Weinberg, factor 2 for matroids and 4p−2 for intersections of p matroids, against online weight-adaptive adversaries.
Setting
A finite ground setU carries p≥1 matroids M1,…,Mp with independent sets I1,…,Ip and closure operators cl1,…,clp. A set is feasible if it lies in I=⋂jIj. Each element x has a random weightw(x)≥0; the weights are independent and w(x) has law Fx. For a set S, w(S)=∑x∈Sw(x), OPT(w)=max{w(S):S∈I}, and OPT=E[OPT(w)].
An online weight-adaptive adversary reveals the elements one at a time; it chooses the i-th element xi after learning w(x1),…,w(xi−1), but without knowing w(xi) or any other unrevealed weight. A threshold algorithm offers xi a threshold Ti computed from what has been revealed and from the set Ai−1 already selected, and selects xi exactly when Ai−1∪{xi}∈I and w(xi)≥Ti.
The algorithm of the paper uses a ghost samplew′, an independent copy of w. Let B be a w′-maximum feasible set. For a set A and each j, Rj(A)⊆B∖A is a set of maximum w′-weight with A∪Rj(A)∈Ij and B⊆clj(A∪Rj(A)), and Cj(A)=B∖Rj(A). Put R(A)=⋂jRj(A) and C(A)=⋃jCj(A). For a parameter α, the summed thresholds are
and the algorithm of §4.2 uses Ti=T(Ai−1,i). An algorithm has α-balanced thresholds (Definition 3) if, for every input sequence with selected set A and every V disjoint from A with A∪V∈I,
For every p≥1, all matroids M1,…,Mp on U, all laws Fx on [0,∞) with finite means, and every online weight-adaptive adversary, the algorithm of §4.2 with α=2p selects a set A with
E[w(A)]≥4p−21E[OPT(w)].
For p=1 this is the factor-2 matroid prophet inequality.
Proposition 3
If a threshold algorithm has α-balanced thresholds for some α≥2, then against every online weight-adaptive adversary
E[w(A)]≥α(α−1)α−pOPT.
Milestones
Proposition 2 for each matroid Mj; the identity between the two forms of T(A,i,j); properties (13) and (14) for the summed thresholds; the identities (20)–(21); and the inequalities (23)–(24) of Appendix A. Together with Proposition 3 these give the goal.
Significance
The bound gives a posted-price style selection rule for any feasibility constraint that is an intersection of p matroids, with a guarantee depending only on p; the paper's §5 shows that a ratio of order p is necessary. Section 6 of the paper turns the result into sequential posted-price mechanisms for multi-dimensional mechanism design, and that application needs the guarantee against the online weight-adaptive adversary, not only against a fixed order. The reduction "balanced thresholds imply an approximation" (Proposition 3) is reusable for other threshold constructions.
The result is proved in the paper; to our knowledge no machine-checked proof exists. The mission produces a formal proof of the 4p−21 guarantee, with the probabilistic part (the ghost-sample argument against an adaptive adversary) and the combinatorial part (the per-matroid exchange inequality) as separate milestones. The paper justifies the per-matroid use of Proposition 2 in one paragraph; because B maximizes w′ over the intersection rather than over Ij, the description of Rj(A) as a maximum-weight basis of a contraction (Lemma 2 in the single-matroid case) does not apply verbatim, and the formal proof of that milestone is not a copy of the paper's single-matroid argument.
Difficulty
Two steps do not follow from routine bookkeeping. First, the inequality (23) compares the gambler's surplus, collected along an order that the adversary adapts to the realized weights, with the ghost sample's surplus on the random set R(A). The index xi revealed at step i is itself random, so the step "the weight of the element offered next is distributed as its ghost weight" has to be justified for an adaptively chosen index under a product measure; it fails for an adversary that may look at unrevealed weights. Second, the paper obtains (14) by applying the single-matroid Proposition 2 to each Mj, but its proof of Proposition 2 describes R(A) as a maximum-weight basis of a contraction, which uses that B is optimal for the matroid in question. Here B is optimal only for the intersection I, so the obvious transfer of the single-matroid argument does not go through as written and the per-matroid statement needs its own proof.
Formalization scope
The ground set is a Fintype; the matroids are Mathlib's Matroid α, indexed by Fin p, each with ground set Set.univ; sets are Finset α. Weights are functions α → ℝ, the weight law is Measure.pi F, and every theorem assumes each F x is a probability measure with F x (Iio 0) = 0 and a finite mean. Expectations are Bochner integrals; under these assumptions every integrand is integrable. Ties in the maximizers B and Rj(A) are broken by a fixed rule that does not depend on the weights. Rj(A) is taken disjoint from A. The threshold ∞ on infeasible steps is a feasibility test in the selection rule. Adversaries and generic threshold rules are deterministic, see only revealed weights, and are measurable in them; randomized adversaries are mixtures of deterministic ones. Generic thresholds in Proposition 3, (23) and (24) are non-negative, as in the paper's Ti∈R+∪{∞}.
The goal fixes the thresholds to the summed thresholds of §4.2 with α=2p, computed from the ghost-sample objects. A version in which the thresholds are free parameters assumed to satisfy (13)–(14) would be Proposition 3 itself and is ruled out; conversely, Proposition 3 does not mention the §4.2 thresholds.
A complete development needs: elementary facts about maximizers over finite families; matroid exchange properties (a bijective exchange between equal-size independent sets, available in Schrijver's book but not in Mathlib); submodularity of weighted-rank-type functions; and the independence argument for adaptively chosen indices under a product measure. The last two are reusable beyond this mission, as is Proposition 3. Proofs of individual milestones and of these auxiliary facts are welcome.
U. Krengel, L. Sucheston, Semiamarts and finite values, Bull. Amer. Math. Soc. 83 (1977), 745–747.
E. Samuel-Cahn, Comparison of threshold stop rules and maximum for independent nonnegative random variables, Ann. Probab. 12 (1984). https://doi.org/10.1214/aop/1176993150
M. T. Hajiaghayi, R. Kleinberg, T. Sandholm, Automated online mechanism design and prophet inequalities, Proc. 22nd AAAI Conference on Artificial Intelligence, 2007, pp. 58–65.
S. Chawla, J. Hartline, D. Malec, B. Sivan, Multi-parameter mechanism design and sequential posted pricing, STOC 2010, pp. 311–320; arXiv:0907.2435. https://arxiv.org/abs/0907.2435
A. Schrijver, Combinatorial Optimization: Polyhedra and Efficiency, Springer 2003 (Corollary 39.12a).
Time-Inconsistent Stochastic Linear–Quadratic Control III: Explicit Equilibrium Mean–Variance Strategy with State-Dependent Risk Aversion and a Random Risk PremiumResearch Paper
Motivation
Mean–variance portfolio selection (Markowitz, 1952) trades off the expected terminal wealth of an investor against its variance. In a dynamic setting the problem is time-inconsistent: the variance is not a conditional expectation of a function of terminal wealth, so the dynamic-programming principle fails, and a strategy that is optimal when computed at time 0 is no longer optimal when re-evaluated at a later time. A standard response is to treat the investor at each time t as a separate player and to look for a subgame-perfect equilibrium strategy, which no future self wishes to deviate from locally (Björk–Murgoci, Ekeland–Lazrak, and others).
Hu, Jin and Zhou (arXiv:1111.0818v1; SIAM J. Control Optim. 50(3), 2012) define open-loop equilibria for a general class of time-inconsistent stochastic linear–quadratic (LQ) problems and characterize them through a flow of forward–backward SDEs. Their §5 applies this to mean–variance investment in a complete market with a random risk premium, where the weight on expected wealth depends on current wealth (a state-dependent risk aversion, motivated in Björk–Murgoci–Zhou, 2014). Earlier equilibrium results for mean–variance investment (Basak–Chabakauri, 2010; Björk–Murgoci–Zhou) work with deterministic or Markovian coefficients and within feedback classes.
This mission is the third of a series on the paper. Mission I formalizes the general sufficient condition (Theorem 3.2); Mission II treats deterministic coefficients and coupled Riccati equations (Theorem 4.4). This mission targets the explicit mean–variance equilibrium of Theorem 5.4.
Setting
Fix a horizon T>0 and a probability space carrying a standard d-dimensional Brownian motion W with its filtration (Ft); write Et=E[⋅∣Ft]. The market has a deterministic bounded interest rate r and a progressively measurable, essentially bounded risk premiumθ with values in Rd. A strategy is a progressively measurable u with E∫0T∣us∣2ds<∞ (the class LF2(0,T;Rd)); the wealth X under u solves
dXs=rsXsds+θs′usds+us′dWs,X0=x0.(5.2)
At time t, with current wealth xt, the investor's cost is
This is the case n=1 of the paper's general LQ problem, with A=r, B=θ, C=0, D=I, Q=R=0, G=h=1; the mission states it that way. For t∈[0,T), ε>0 and an Ft-measurable square-integrable v, the spikeust,ε,v=us+v1[t,t+ε)(s) perturbs u on a short window. A strategy u∗ with wealth X∗ is an equilibrium (Definition 2.1) if, for all such t and v,
ε↓0liminfεJ(t,Xt∗;ut,ε,v)−J(t,Xt∗;u∗)≥0a.s.
The equilibrium is built from Γs(1)=μ1e∫sTr, Γs=−μ2e∫sTr, and two backward SDEs: an indefinite stochastic Riccati equation for (M,U),
and a linear BSDE (5.13) for (Γ(2),γ(2)) whose coefficients involve M and U. A process Z gives a BMO martingaleZ⋅W if E[∫τT∣Zs∣2ds∣Fτ]≤C for all stopping times τ≤T.
Formalization targets
Goal: Theorem 5.4
If (M,U) solves (5.8) with M bounded and M≥c>0, and (Γ(2),γ(2)) solves (5.13) with Γ(2) bounded, then
is an equilibrium: the closed-loop wealth exists, and for every closed-loop wealth X∗ the strategy u∗ satisfies Definition 2.1.
Milestones
Proposition 5.1: (5.8) has a unique solution in L∞×L2 with M≥c>0, and U⋅W is BMO.
Proposition 5.2: (5.13) has a unique solution in L∞×L2, and γ(2)⋅W is BMO.
Proposition 5.3: the closed-loop wealth under the feedback exists with continuous paths, Esupt∣Xt∗∣2<∞, and u∗∈L2.
Proof of Theorem 5.4: the processes p(s;t), k(s;t) of (5.5) and (5.7) solve the adjoint equation (5.4), Λ(s;t)=p(s;t)θs+k(s;t) has the closed form displayed on p. 22, and Λ meets condition (3.4).
Significance
Theorem 5.4 gives the equilibrium of a time-inconsistent mean–variance investor in closed form, linear in current wealth, for a random risk premium. With a deterministic premium it reduces to explicit formulas (§5.4), and for μ1=0 it recovers the equilibrium of Basak–Chabakauri and Björk–Murgoci; for μ2=0 it differs from the feedback equilibrium of Björk–Murgoci–Zhou, which shows that open-loop and feedback equilibria are different notions. The random premium is what makes U=0 and the feedback gain unbounded.
The result is proved in the paper; nothing here is formalized elsewhere. The mission produces machine-checked statements of the equilibrium, of solvability of the Riccati-type BSDE (5.8), and of the integrability of a linear SDE with BMO-type coefficients, on the platform's published stochastic-calculus substrate. The definition of BMO martingales and the encoding of open-loop equilibria are reusable beyond this paper.
Difficulty
The verification step that most readers try first, plugging u∗ into the wealth equation and applying standard SDE estimates, fails: the gain α=(Γ(1)θ−U)/M is unbounded, because U is only BMO, so the closed-loop SDE is linear with non-Lipschitz-bounded random coefficients and neither existence of the wealth nor u∗∈L2 follows from standard theory (Proposition 5.3). The BSDE (5.8) has a driver with quadratic growth in U and a singular factor M−1; it is not covered by the standard theory of stochastic Riccati equations and its solution must be bounded away from zero for the feedback to make sense. Uniqueness in (5.8) and solvability of (5.13) rely on BMO-martingale and change-of-measure facts (Kazamaki) that are not in Mathlib. Finally, the equilibrium property is a statement about every t and every perturbation, and the sufficient condition (Theorem 3.3) needs the limit behaviour of conditional expectations Et[Λ(s;t)] as s↓t.
Formalization scope
Everything is built on the published definition Peng1990_SMP_Stochastic (Brownian motion, LF2, Itô integrals, SDEs and BSDEs as relations). The general LQ model, the spike, the conditional cost and Definition 2.1 are in Model; the adjoint equation on [t,T], Λ and condition (3.4) in Adjoint; the market, Γ(1), Γ, BMO, (5.8), (5.13) and (5.14) in Market. Conventions the statements commit to:
Lower limit. Definition 2.1 is stated with liminf in R, along every sequence εk↓0, almost surely for each sequence. The page writes lim; the limit need not exist, and the paper's own argument bounds the lower limit.
Filtration. The natural, uncompleted filtration of W instead of the augmented one; conditional expectations and progressive processes agree up to null sets.
States from time t are solutions on the whole horizon [0,T] for a control equal to u∗ before t.
Versions. Conditions involving conditional expectations at uncountably many times are stated through jointly measurable versions; "a.s., a.e." means ds⊗dP-a.e.; uniqueness of BSDE solutions is up to modification and ds⊗dP-null sets; BMO is in integrated form.
Market primitive. The risk premium θ is the primitive, as in (5.2); every bounded progressive θ comes from some bounded (μ,σ) with σσ′⪰εI.
Existence statements. Peng's SDE solutions already carry u∗∈L2 and suptE∣Xt∣2<∞, so Proposition 5.3 is stated as existence of a closed-loop solution with continuous paths and Esupt∣Xt∗∣2<∞. Theorem 5.4 asserts existence of the closed-loop wealth instead of assuming it.
The goal does not assume the BMO properties of U and γ(2) (they are conclusions of Propositions 5.1–5.2), does not assume θ deterministic or U=0 (that is the special case of §5.4), and keeps Q=R=0, G=h=1; a formalization that assumes any of these, or that admits the junk value M−1=0 on a non-null set, proves a different theorem. Theorem 3.3, the sufficient condition used in the last line of the proof, is the n=1 case of Mission I's goal and is not restated here. Welcome contributions: a BMO and Girsanov library on the Peng substrate, existence for quadratic BSDEs, and a proof of the sufficient condition.
Selected references
Y. Hu, H. Jin, X. Y. Zhou, Time-Inconsistent Stochastic Linear–Quadratic Control, arXiv:1111.0818v1, 2011; SIAM J. Control Optim. 50(3), 2012. https://arxiv.org/abs/1111.0818
N. Kazamaki, Continuous Exponential Martingales and BMO, Lecture Notes in Math. 1579, Springer, 1994. https://doi.org/10.1007/BFb0073585
M. Kobylanski, Backward stochastic differential equations and partial differential equations with quadratic growth, Ann. Probab. 28(2), 2000. https://doi.org/10.1214/aop/1019160253
S. Peng, A general stochastic maximum principle for optimal control problems, SIAM J. Control Optim. 28(4), 1990. https://doi.org/10.1137/0328054
Quantity Flexibility Contracts and Supply Chain Performance 2: The Minimum Commitment Policy Is Optimal for the Open-Loop Program (F-OLFC) and AdmissibleResearch Paper
Rolling schedules and quantity flexibility
Manufacturers routinely share rolling schedules with their suppliers: each period the buyer commits to a purchase for the current period and issues non-binding estimates for future periods, then revises those estimates as the horizon rolls forward. Unconstrained revisions push forecast risk upstream and are a recognized source of the bullwhip effect. A quantity flexibility (QF) contract bounds how far each estimate may move between consecutive issues, giving the supplier a guarantee in exchange for a commitment to cover any order within the bounds. Tsay and Lovejoy (MSOM 1(2), 1999) model a chain of firms linked by QF contracts and ask how a firm in the middle of the chain, the flex node, should translate the schedules it receives into the schedules it issues. Their answer is the Minimum Commitment (MC) policy, justified by Proposition 1: MC solves the node's open-loop planning problem and never breaks either contract.
This mission formalizes Proposition 1. A companion mission (Quantity Flexibility Contracts and Supply Chain Performance 1) formalizes Proposition 2, on when MC keeps zero inventory.
Setting
Periods are t=0,1,2,…. In period t the node receives from its customer a release schedulef(t)=[f0(t),f1(t),…]: f0(t) is bought now, fj(t) estimates the purchase in period t+j. The node issues to its supplier a replenishment scheduler(t)=[r0(t),r1(t),…] of the same form. Its ending stock is I(t)=I(t−1)+r0(t)−f0(t).
The contracts carry parameters αq≥0 and 0≤ωq≤1 (q≥1): output parameters (αout,ωout) with the customer and input parameters (αin,ωin) with the supplier. The incremental revision (IR) constraints are, for all t and j≥1,
The cumulative parameters are 1+Aj=∏q=1j(1+αq) and 1−Ωj=∏q=1j(1−ωq), so A0=Ω0=0. A convex cost G, minimized at 0, is charged on ending stock.
At period t, with I(t−1), r(t−1) and f(t) known, the open-loop program (F-OLFC) chooses r(t) and the planned purchases r0(t+j), j=0,…,h, to minimize ∑j=0hG(I(t+j)) subject to the stock balance I(t+j)=I(t+j−1)+r0(t+j)−(1+Ajout)fj(t) (17), coverage I(t+j)≥0 (18), the input IR constraints (19) between r(t−1) and r(t), and the cumulative bounds (1−Ωjin)rj(t)≤r0(t+j)≤(1+Ajin)rj(t) (20).
The MC policy computes r(t) and projected inventories lj(t) by one recursion on j: l0(t)=I(t−1),
and for every t≥2 the schedule r(t), with suitable planned purchases, is feasible for (F-OLFC) at period t and attains its minimum.
Milestones
Lemma 1 (p. 108): under (a) I(t−1)≥0 and (b) the upside of (6), lj(t)≥lj+1(t−1) for all j≥0.
(30)–(31) (pp. 107–108): with the upper bounds of (19) and (20) removed, the lot-for-lot purchases r0∗(t+j)=max{(1+Ajout)fj(t)−lˉj(t),(1−Ωj+1in)rj+1(t−1)} are optimal.
Upper bound of (19) (p. 108): rj(t)≤(1+αj+1in)rj+1(t−1) along the run.
Significance
Proposition 1 is what makes MC a well-defined operating rule for an intermediate firm: whatever the customer does within its contract, the node can serve it from stock and its own revisions stay within the supplier's contract, so the chain of contracts composes. Proposition 2 and the paper's simulation study of how flexibility propagates along a supply chain (§§5–6) both assume the node uses MC, and rely on Proposition 1 for that choice being both feasible and myopically optimal.
The paper's optimality argument is sketched: the relaxed solution is attributed to "a straightforward application of Kuhn–Tucker conditions" with details in an unpublished thesis, the equivalence of (32) with (21)–(23) is omitted, and Lemma 1's proof is replaced by intuition. A machine-checked proof supplies these steps. To our knowledge no part of this paper has been formalized before. The mission also fixes the statement: the printed range of (19) makes the optimality claim false, and the claim needs a start of the run that the paper leaves implicit.
Difficulty
The obvious argument treats (F-OLFC) as a lot-sizing problem with minimum lot sizes and observes that the greedy purchases (30) are optimal. That only solves the relaxation. The difficulty is that MC is not stated through (30): it is a recursion on the replenishment schedule with a positive part in the projected inventory, and one has to show that the MC schedule can carry the greedy purchases within the upper bounds of (19) and (20). Those bounds can bind, and whether they do depends on the previous period's schedule, so the optimality claim is not a one-period statement: it needs an induction over the run, through Lemma 1 and the customer's IR constraints. The admissibility half needs the same induction, with the nonnegativity of the schedules carried along.
Formalization scope
All quantities are real numbers. Parameters are sequences ℕ → ℝ whose index 0 is unused; schedules are infinite sequences, and the MC recursion runs over all j. (6) and (7) are written with j replaced by j+1. The standing assumptions αq≥0, 0≤ωq≤1 (q≥1) are hypotheses. G is any convex function with G(0)≤G(y) for all y; no strict convexity, differentiability or monotonicity is assumed.
The run starts from an arbitrary state (I(0),r(0)) (run period 0); the MC policy acts from period 1. The following departures from the printed statement are disclosed:
(19) is imposed for j=0,…,h, not the printed j=0,…,h−1. With the printed range optimality fails: with all α=ωin=0, ω1out=1/2, I(0)=0 and r(0)=f(0)=f(1)≡10, take f0(2)=5 and h=0. Then (F-OLFC) at t=2 has optimum r0(2)=5 with I(2)=0, while MC orders r0(2)=r1(1)=10. With (19) at j=0, the order r0(2)≥10 is forced and MC is optimal. Both (21) and (30) already use rh+1(t−1).
Input IR and optimality are claimed for t≥2, coverage for t≥1. At the first MC period the predecessor schedule is the arbitrary r(0) and (7) can fail.
r(0)≥0 is assumed: with a negative entry the two bounds of (19) cross. Neither I(0) nor f carries a sign hypothesis.
(F-OLFC) ranges over all real schedules and purchases; the only MC-specific object in the goal is the candidate schedule. Optimality is stated as "feasible, and no feasible point has a smaller objective", never as an infimum, so an infeasible program cannot make it vacuous. The MC step is literally (21)–(23), with the carried-over term and the positive part; a run that sets r(t):=f(t) or drops the max is a different policy.
Infrastructure: the model and (F-OLFC) are self-contained over Mathlib (Finset.prod, ConvexOn). Proofs of the three milestones, and of the monotonicity of a convex function minimized at zero on [0,∞), are welcome as separate contributions.
Selected references
A. A. Tsay, W. S. Lovejoy, Quantity flexibility contracts and supply chain performance, Manufacturing & Service Operations Management 1(2):89–111, 1999. https://doi.org/10.1287/msom.1.2.89
D. P. Bertsekas, Dynamic Programming and Stochastic Control, Academic Press, 1976 (open-loop feedback control).
A. Federgruen, P. Zipkin, An inventory model with limited production capacity and uncertain demands, Mathematics of Operations Research 11(2):193–215, 1986. https://doi.org/10.1287/moor.11.2.193
Matroid Prophet Inequalities 1: Against Any Online Weight-Adaptive Adversary, the 2-Balanced Threshold Algorithm Earns at Least Half the Expected Max-Weight BasisResearch Paper
Motivation
The prophet inequality of optimal stopping compares a gambler, who sees independent non-negative random values X1,…,Xn one at a time and must accept or reject each on arrival, with a prophet who sees them all in advance. Krengel, Sucheston and Garling showed that the gambler can secure E[Xτ]≥21E[maxiXi], and Samuel-Cahn showed that a single threshold suffices. Since Hajiaghayi, Kleinberg and Sandholm (2007) and Chawla, Hartline, Malec and Sivan (2010), prophet inequalities have served as the approximation guarantees of sequential posted-price mechanisms: an online selection rule with a prophet guarantee turns into a truthful mechanism with a revenue guarantee.
The natural multi-choice generalization lets the gambler accept a set of elements, subject to a feasibility constraint. Kleinberg and Weinberg, Matroid Prophet Inequalities (STOC 2012, arXiv:1201.4764), proved that when the feasible sets are the independent sets of a matroid, the factor 21 is still achievable, by an explicit threshold rule, and even when the order of arrival is chosen adaptively by an adversary.
Timeline:
1977–78: Krengel and Sucheston, with Garling: the single-choice prophet inequality with factor 21, which is tight.
1984: Samuel-Cahn: a single fixed threshold attains 21.
2007: Hajiaghayi, Kleinberg, Sandholm: prophet inequalities read as truthful online auctions, with multi-choice prophet inequalities.
2010: Chawla, Hartline, Malec, Sivan: posted-price mechanisms via prophet inequalities, and factor 21 for matroids when the algorithm may choose the order of arrival.
2012: Kleinberg–Weinberg: factor 21 for every matroid against an online weight-adaptive adversary, and 4p−21 for intersections of p matroids.
Setting
Let U be a finite ground set and M=(U,I) a matroid; I is its family of independent sets. For each x∈U a distribution Fx on [0,∞) is given; the weightsw(x) are independent with w(x)∼Fx, and w(A)=∑x∈Aw(x). Let OPT(w)=max{w(S):S∈I} and OPT=E[OPT(w)].
An online weight-adaptive adversary reveals the elements one at a time: it picks xi knowing w(x1),…,w(xi−1) but not w(xi). An online algorithm maintains a selected set Ai−1∈I and, when xi arrives with its weight, irrevocably accepts or rejects it, keeping Ai independent. A threshold rule offers xi a threshold Ti computed from the revealed prefix (and Ti=∞ when Ai−1∪{xi}∈/I) and accepts iff w(xi)≥Ti.
The algorithm of the paper uses a ghost sample: an independent copy w′ of the weights. Let B be a w′-maximum-weight basis. For an independent set A, among the partitions B=C⊔R with R∩A=∅ and A∪R a basis, R(A), C(A) denote one maximizing w′(R). The algorithm (9) sets
Ti=21Ew′[w′(R(Ai−1))−w′(R(Ai−1∪{xi}))].
Formalization targets
Goal: the matroid prophet inequality
For every matroid on a finite ground set, every family of distributions Fx on [0,∞) with finite means, and every online weight-adaptive adversary, the set A selected by the algorithm (9) satisfies
E[w(A)]≥21OPT.
The goal is stated for the paper's own algorithm, which is stronger than the existence statement of §3.
Milestones
Proposition 1 (with Definition 1): any threshold rule with α-balanced thresholds,
earns E[w(A)]≥α1OPT.
2. The identity behind (9) = (10), and the telescoping identity ∑xi∈ATi=21E[w′(C(A))] (Property (2) for α=2).
3. Lemma 1 (bijective basis exchange, and its weighted form), Lemma 2 (R(A) is a maximum-weight basis of the contraction M/A), Lemma 3 (S↦w′(R(S)) is submodular on subsets of an independent set).
4. Inequalities (11) and (12), and Proposition 2:
pointwise in w′≥0; then Property (3) with α=2 for the thresholds (9).
Significance
The theorem gives the optimal constant: already for a rank-one matroid (choose one element) no online algorithm beats 21. It covers every matroid with one algorithm, including uniform, partition, graphic and transversal matroids, which model capacity, unit-demand and spanning-tree constraints. Through the reduction of Chawla et al., the paper derives from it order-oblivious posted-price mechanisms that are 2-approximations to the optimal revenue in single-parameter settings with matroid feasibility and, through the adaptive adversary, in multi-dimensional unit-demand settings (§6 of the paper). The decomposition through α-balanced thresholds is reused in the paper for intersections of p matroids, with factor 4p−21.
The result has been proved since 2012; it has not been formalized. The mission produces a machine-checked development of the model (online adaptive adversaries, threshold rules, the ghost-sample expectations), of the general reduction (Proposition 1), and of the matroid facts the algorithm relies on, notably the bijective exchange lemma (Schrijver, Corollary 39.12a), which is not in Mathlib.
Difficulty
The obvious argument fixes the order of arrival and compares the algorithm with the prophet item by item. It fails here because the order is chosen adaptively from the revealed weights, so the set of elements still to come is random and correlated with the past. The proof must instead compare the algorithm's realized selection with a ghost optimum B built from an independent sample, and bound the value the algorithm forgoes by the value the ghost optimum could still add, E[w′(R(A))]. The step that needs matroid structure is Property (3): the total threshold offered to any set V that could still be added must be at most half of E[w′(R(A))]. The thresholds were computed along the history A0⊆A1⊆…, not at the final A, so the bound requires the submodularity of S↦w′(R(S)) (Lemma 3) and a weight-dominating exchange between V and R(A) in the contraction M/A. Neither holds for general downward-closed families.
Formalization scope
The ground set is a Fintypeα; the matroid is Mathlib's Matroid α with ground set Set.univ; sets are Finset α; contraction is Matroid.contract.
The distributions are F : α → Measure ℝ, probability measures with F x (Set.Iio 0) = 0 (support in [0,∞)) and Integrable id (F x) (finite means). The weight law is Measure.pi F, and every expectation is a Bochner integral over it. Finite means make OPT(w), w(A) and the integrands of the thresholds integrable, so no expectation is a junk value.
OPT(w) is a maximum over the nonempty finset of independent sets. The maximum-weight basis B(w′) and the maximizer R(A) are fixed by choice when weights tie; Lemma 2 shows w′(R(A)) does not depend on the choice. R(A) is required to be disjoint from A, as Lemma 2's placement of R(A) in M/A needs.
A threshold rule is a real-valued function of the current selection, the revealed list, the weights and the arriving element, non-negative, depending on the weights only through revealed ones, measurably; the value ∞ on infeasible steps is an independence guard in the acceptance test. "Monotone algorithm" in Proposition 1 means such a rule.
An adversary is a deterministic map from the revealed list and the weights to the next unrevealed element, depending only on revealed weights and measurable. Randomized adversaries are mixtures of these.
Lemma 1, part 2 is stated for disjoint V and R: as printed it fails when they overlap, and the paper uses it only for disjoint sets.
The goal fixes the thresholds by (9) through B, R(⋅) and the ghost expectation; a statement in which the thresholds are free parameters assumed to satisfy (2)–(3) would be Proposition 1 and is not the goal.
Contributions are welcome at every level: the measurability of the online run, the exchange lemma for Mathlib matroids, the greedy characterization of maximum-weight bases of a contraction, and the probabilistic core (7) of Proposition 1. The matroid lemmas are reusable beyond this mission, in particular by the matroid-intersection mission of the same paper.
U. Krengel, L. Sucheston, Semiamarts and finite values, Bull. Amer. Math. Soc. 83, 745–747, 1977.
U. Krengel, L. Sucheston, On semiamarts, amarts, and processes with finite value, Advances in Probability and Related Topics 4, 197–266, 1978.
E. Samuel-Cahn, Comparison of threshold stop rules and maximum for independent nonnegative random variables, Annals of Probability 12(4), 1213–1216, 1984.
M. T. Hajiaghayi, R. Kleinberg, T. Sandholm, Automated mechanism design and prophet inequalities, AAAI 2007, pp. 58–65.
S. Chawla, J. Hartline, D. Malec, B. Sivan, Multi-parameter mechanism design and sequential posted pricing, STOC 2010, pp. 311–320.
A. Schrijver, Combinatorial Optimization: Polyhedra and Efficiency, Springer, 2003 (Corollary 39.12a).
Some Useful Functions for Functional Limit Theorems 1: Composition Preserves J₁ Convergence When the Outer Path Is Continuous or the Inner Path Is Continuous and Strictly IncreasingResearch Paper
Motivation
Random time changes occur when a process is observed on an operational clock rather than calendar time. In queueing models, for example, an arrival-count path may be evaluated at an evolving service clock. A functional limit theorem for the outer path and another for the clock are useful together only when evaluating one path at the times supplied by the other preserves convergence. Ward Whitt's 1980 paper studies several path operations with this question in mind; composition is its first main operation. The issue is specific to paths with jumps, because a small shift of the clock can move an evaluation across a jump.
Setting
Let T1,T2,T3 be nonempty intervals of real time, with T2⊆T3, and let (S,m) be a complete separable metric space. The càdlàg path spaceD(T,S) consists of paths that are right continuous and have left limits on T. Its subspace C(T,S) contains the continuous paths. The nondecreasing clock spaceD0(T1,T2) consists of càdlàg real-valued paths on T1 that are nondecreasing and take their values in T2. Its subspace C0(T1,T2) contains the continuous, strictly increasing clocks. For x∈D(T3,S) and y∈D0(T1,T2), composition is the path (x∘y)(t)=x(y(t)) on T1.
Convergence uses the Skorohod J1 topology. On a compact interval [a,b], let Λ[a,b] be the increasing homeomorphisms of [a,b] and let e(t)=t. With ρ[a,b] denoting uniform distance, Whitt's metric is
Thus close paths may have nearby jumps at different times, provided an increasing time change aligns them. On a general interval, convergence is checked on compact subintervals whose endpoints are continuity points of the limit or endpoints of the full interval. Whitt gives this definition in §2, then gives C, C0, and D0 in §3. All subsets carry relative topologies and products carry product topologies.
Formalization targets
Composition at a continuous outer path
For xn→x in D(T3,S) and yn→y in D0(T1,T2), the first milestone states
x∈C(T3,S)⟹xn∘yn→x∘y in D(T1,S).
The path-space definition and the two preparatory milestones are a small-oscillation partition for a càdlàg path, cited by Whitt from Billingsley, and Whitt's Lemma 2.2, which relates convergence on a compact interval to convergence on the two pieces made by splitting it at a continuity point.
Composition at a strictly increasing clock
The second case, and the combined goal, also allow the outer limit path to jump. Let ∂TT1 mean the endpoints of T1 that belong to T1. The corrected target is
[x∈C(T3,S)or(y∈C0(T1,T2)andx is continuous at y(t) for every t∈∂TT1)]⟹xn∘yn→x∘y in D(T1,S).
The goal includes both cases for simultaneously varying xn and yn. The endpoint condition is vacuous for an endpoint excluded from T1. It is part of the strictly increasing clock case only; it imposes no extra restriction when the outer limit path is continuous.
Significance
This theorem supplies a precise condition for carrying two path limits through a random time transformation. In particular, the assertion includes convergence of the composed paths as elements of a càdlàg space, not merely convergence of their values at individual times. The distinction matters at jumps: pointwise convergence does not control the placement or ordering of nearby jumps. The result is a deterministic continuity statement that can be paired with probabilistic mapping theorems when the corresponding random paths are available.
Whitt proved the composition theorem in 1980, subject to the endpoint issue described below. The formalization work here is to construct its path-space interface in Lean, state the corrected continuity theorem with every domain condition visible, and eventually replace the open sorry proofs with checked proofs. The interface can also support the paper's later results on reflection, first passage, and time reversal; those results are separate missions. No proof of this mission's goal is claimed yet.
Difficulty
The tempting argument is to use separate continuity of xn→x and yn→y and then substitute yn(t) into the first convergence. That argument loses control of evaluations near a jump of x. A J1 time change may align a jump of xn with the corresponding jump of x, while the clock yn may cross those times differently. Continuity of the outer limit path removes that difficulty in one case; in the other, the clock must be continuous and strictly increasing. The source explicitly shows that composition is not continuous on all of D×D0 (§3, p. 75).
The endpoints impose a further obstruction because increasing homeomorphisms of a closed time interval fix its endpoints. Bauer's Remark on p. 75 observes a failure at the right endpoint. There is a symmetric failure at the left endpoint, so the statement here includes both. This is a correction to the printed theorem, not a new claim that the uncorrected theorem is true.
Formalization scope
Paths are represented as total functions R→S, with only values on the named interval used. The domain assumptions OrdConnected and Nonempty express nonempty real intervals. The outer interval T3 is also required to have nonempty interior: the formal convergence predicate checks only compact intervals [a,b] with a<b, so on a one-point T3 it imposes nothing, and the C×D0 case would fail for constant outer paths with different values. A clock's range condition is explicit, as is nondecreasingness for every prelimit clock. Membership of all paths in the relevant càdlàg spaces is part of the convergence predicates. The output predicate likewise requires every composition and its limit to be càdlàg. This rules out the trivialization in which one merely proves convergence of selected point evaluations or assumes the compositions already have the conclusion's path-space properties.
The compact uniform distance and the infimum over time changes take values in [0,∞]. They use the actual metric on S, not a real supremum with a default value on an unbounded set. A time change is a total function whose restriction to the compact interval is continuous, strictly increasing, and onto. Continuity at a time means continuity relative to the path's interval. The general-interval convergence predicate checks the compact intervals specified by Whitt and requires each sequence member to belong to D. The theorem is written as sequential continuity; Whitt's J1 spaces are metrizable, making that equivalent to topological continuity. The real-valued clock space uses the relative topology inherited from real-valued càdlàg paths.
The endpoint correction is exact in the Lean statement. At the right endpoint, take T1=T2=T3=[0,1], y(t)=t, yn(t)=(1−1/n)t for n≥2, and x=1{1}. Then x∘yn is zero while (x∘y)(1)=1. At the left endpoint, take T1=T2=[0,1], T3=[−1,2], yn=y=e, x=1[0,2], and xn=1[1/n,2]. The outer paths converge in J1 on T3, but the compositions disagree at 0. Both examples show why continuity of x at the image of every included endpoint is required in the D×C0 case.
The development needs the càdlàg definition, J1 metric and convergence predicates, compact restriction lemma, and the finite oscillation partition. Their definitions and lemmas are reusable for other functionals on path spaces. Contributions that prove the milestones and goal under the stated hypotheses are welcome. This mission does not formalize the Borel measurability or probability-measure machinery discussed elsewhere in Whitt's paper; Theorem 3.1 itself is a deterministic continuity claim.
Selected references
Ward Whitt, Some Useful Functions for Functional Limit Theorems, Mathematics of Operations Research 5(1), 67–85, 1980. DOI: 10.1287/moor.5.1.67.
Efficiency of Coordinate Descent Methods on Huge-Scale Optimization Problems 5: RCDM with Adaptive Lipschitz Estimates (RACDM) Has Expected Error at Most 8nR₁²(x₀)/(16 + 3k)Research Paper
Motivation
Random coordinate descent minimizes a smooth convex function f:Rn→R by updating one coordinate at a time, chosen at random. Each iteration needs a single partial derivative instead of the full gradient, which is what makes the method usable on problems whose dimension is in the millions or billions ("huge-scale" problems). Nesterov's paper Efficiency of coordinate descent methods on huge-scale optimization problems (CORE Discussion Paper 2010/2; journal version SIAM J. Optim. 22 (2012) 341–362, doi:10.1137/100802001) gave the first global efficiency estimates for such methods and started a large literature on randomized block and coordinate methods.
The basic method RCDM of the paper takes, along coordinate i, a step of length 1/Li, where Li is a Lipschitz constant of the i-th partial derivative along the i-th coordinate. For simple functions these constants are known; for more complicated ones they are not, and a practical method has to estimate them on the fly. Section 6.1 of the paper analyses a backtracking strategy with restore for this purpose and proves that it keeps the efficiency of RCDM up to a constant factor. This mission formalizes that analysis, Theorem 7 of the paper.
Setting
Write ∇if(x)=∂f/∂xi(x) and ei for the i-th standard basis vector of Rn, n≥1. The function f is convex and differentiable, attains its minimum f∗=f(x∗), and its partial derivatives are coordinate-wise Lipschitz with constants Li>0 ((2.2) with one-dimensional blocks):
∣∇if(x+uei)−∇if(x)∣≤Li∣u∣(x∈Rn,u∈R,i=1,…,n).
The weighted norm and its dual are ∥x∥1=(∑iLixi2)1/2 and ∥g∥1∗=(∑igi2/Li)1/2 ((2.7) with α=1), and
R1(x0)=xmax{x∗∈X∗max∥x−x∗∥1:f(x)≤f(x0)}
measures the size of the initial level set, X∗ being the set of minimizers.
The random adaptive coordinate descent method RACDM(x0) (6.1) keeps estimates L^1,…,L^n, initialised with given lower bounds Li0∈(0,Li]. At iteration k it
draws i=ik uniformly from {1,…,n};
sets xk+1=xk−L^i−1∇if(xk)ei and, as long as ∇if(xk)⋅∇if(xk+1)<0, doubles L^i and recomputes xk+1;
halves L^i.
The loop test uses only the sign of one partial derivative and never a function value. With φk=Ef(xk) (the expectation over i0,…,ik−1) and Nk the number of partial derivatives computed in iterations 0,…,k, Theorem 7 states three facts about this method.
Formalization targets
Goal: Theorem 7, item 2, (6.2)
φk−f∗≤16+3k8nR12(x0),k≥0.
This is the rate of RCDM(0,x0), φk−f∗≤2nR12(x0)/(k+4) ((2.14)), with a larger constant.
Milestones
(6.4) — started from an estimate 0<L^i≤Li, the doubling loop terminates and the accepted estimate satisfies L^i≤2Li.
Theorem 7, item 1 — at the beginning of each iteration L^i≤Li for every i.
One-step decrease (proof of Theorem 7, p. 19) — f(xk)−f(xk+1)≥8Lik3(∇ikf(xk))2.
Expected decrease (proof of Theorem 7, p. 19) — f(xk)−Eikf(xk+1)≥8n3(∥∇f(xk)∥1∗)2.
The result shows that the constants Li in RCDM need not be known: a method that starts from any lower bounds and adjusts them by doubling and halving converges at the same O(nR12(x0)/k) rate, and pays on average about two partial derivatives per iteration plus a logarithmic one-time overhead. This is what makes random coordinate descent applicable to functions whose coordinate smoothness is not available in closed form, and the doubling-with-restore pattern recurs in later adaptive and accelerated coordinate methods (the paper itself indicates the same technique for its accelerated method, (6.5)).
The theorem is proved in the paper; to our knowledge no machine-checked proof exists. The known-constant analogues for scalar coordinates are on Prove2Me in Bubeck's §6.4 development (the one-step and expected decreases are proved there; the rate is open). This mission adds a formal model of the adaptive method itself, including its doubling loop as a first-failure search, and the three statements of Theorem 7 on top of the published coordinate-descent definitions.
Difficulty
The analysis of RCDM rests on the one-step bound f(x)−f(x−Li−1∇if(x)ei)≥(∇if(x))2/(2Li), which follows from the smoothness of f along the coordinate line. For RACDM the step uses an estimate L^i that may be smaller than Li, and then the same argument gives no decrease at all: a step that is too long can increase f. The method never checks function values, so the decrease has to be extracted from the sign test alone, and it holds only because f is convex along the line, not merely smooth. A second point is that the estimates are random and depend on the whole history, so the expected decrease must hold for every state the method can reach; this is what item 1 secures. The counting statement needs the exact number of loop iterations, so the loop has to be modelled as the least number of doublings after which the test fails, not as some number of doublings.
Formalization scope
The formalization works with scalar coordinates (N=n, as the paper does in §6.1) on EuclideanSpace ℝ (Fin n), coordinates indexed 0,…,n−1. It reuses the published definition ConvexOptAlg_CoordDescent_Defs: IsCoordSmooth f g L is (2.2) with an explicit gradient map g=∇f, wnorm L 1 and wnormDual L 1 are ∥⋅∥1 and ∥⋅∥1∗, and rcdExpect L 0 k is the expectation over k uniform draws as a finite weighted sum. The mission's own definition NesterovRCD.Adaptive.RACDM encodes the trial point, the number of doublings (a minimum over N), one iteration, the run along an explicit sequence of draws, and the count Nk.
The following choices are made explicitly.
Step 3 of (6.1) is printed "Set Lik:=21Lik"; it is read as L^ik:=21L^ik, as the paper's proof requires. The true constants Li never change and enter only hypotheses and bounds.
R1(x0) is not computed: the goal takes any R with ∥x−y∗∥1≤R for all x in the level set and all minimizers y∗. "X∗ nonempty" is a hypothesis; "X∗ bounded" follows from the existence of R.
Implicit hypotheses made explicit: n≥1; Li0>0 and Li0≤Li; in the milestones, 0<L^i≤Li on the entry state.
Convexity is assumed in the statements that need it (the decreases and the rate); (6.4) and items 1 and 3 hold without it and are stated without it.
Nk counts dj+1 evaluations of ∇ijf at iteration j with dj doublings, the count the paper's proof uses; counting ∇ijf(xj) as well would give 3(k+1)+∑ilog2(Li/Li0).
A trivializing encoding is ruled out: the loop count is the least d at which the sign test fails (an arbitrary admissible d would change the method and make the count meaningless), the draws are uniform, and the rate is stated in the norm of the true constants Li, not of the estimates. Contributions welcome: proofs of the milestones, a one-dimensional co-coercivity lemma for convex smooth functions of one variable (reusable well beyond this mission), and the recursion argument from the expected decrease to the rate.
Selected references
Yu. Nesterov, Efficiency of coordinate descent methods on huge-scale optimization problems, CORE Discussion Paper 2010/2, Université catholique de Louvain, 2010. Journal version: SIAM J. Optim. 22(2) (2012) 341–362. doi:10.1137/100802001
Yu. Nesterov, Introductory Lectures on Convex Optimization: A Basic Course, Kluwer, 2004 (reference [6] of the paper; inequality (2.1.17)). doi:10.1007/978-1-4419-8853-9
S. Bubeck, Convex Optimization: Algorithms and Complexity, Foundations and Trends in Machine Learning 8(3–4) (2015) 231–357, §6.4. arXiv:1405.4980
Time-Inconsistent Stochastic Linear–Quadratic Control I: A Flow of Forward–Backward SDEs Gives a Sufficient Condition for Open-Loop Equilibrium ControlsResearch Paper
Motivation
Dynamic programming rests on time consistency: a control that is optimal when viewed from time 0 stays optimal when viewed from any later time. Many problems of mathematical finance lack this property. The continuous-time mean–variance portfolio problem (Zhou–Li 2000) contains a variance, that is, a nonlinear function of an expectation, and state-dependent risk aversion (Björk–Murgoci–Zhou) lets the criterion itself depend on the current state. For such problems an optimal control computed today is abandoned tomorrow, and the HJB equation is not available.
One response, going back to the game-theoretic view of non-commitment (Ekeland–Lazrak, arXiv:math/0604264; Björk–Murgoci, SSRN 1694759), is to replace optimality by equilibrium: a control that no "future self" can improve by deviating on an infinitesimally short interval. Those works consider feedback (Markov) controls. Hu, Jin and Zhou (arXiv:1111.0818v1) define equilibrium within open-loop controls for a general stochastic linear–quadratic (LQ) problem with random coefficients, and characterize it by a flow of forward–backward SDEs, in the spirit of the stochastic maximum principle (Peng 1990). This mission formalizes that characterization: §2 and §3 of the paper, up to Theorem 3.2. The other two missions of the series build on it. Mission II treats a scalar state with deterministic coefficients (Theorem 4.4), and Mission III treats mean–variance portfolio selection (Theorem 5.4).
Setting
Let W=(W1,…,Wd) be a standard d-dimensional Brownian motion on (Ω,F,P) with its filtration (Ft), and let T>0. A control is a process u∈LF2(0,T;Rl), that is, progressively measurable with E∫0T∣us∣2ds<∞. Its stateX solves the linear SDE
Here A is a bounded deterministic n×n matrix function. B (l×n), Cj (n×n) and Dj (n×l) are essentially bounded progressive processes, and b,σj∈LF2(0,T;Rn). At time t, with state xt and Et=E[⋅∣Ft], the cost is
Q,R are bounded symmetric processes with Q,R⪰0, and G,h are symmetric with G⪰0. The last two terms make the problem time-inconsistent. Given u∗ with state X∗, the spike variation at t is ust,ε,v=us∗+v1[t,t+ε)(s) for v∈LFt2(Ω;Rl). The control u∗ is an equilibrium (Definition 2.1) if for every t∈[0,T) and every such v, almost surely
ε↓0liminfεJ(t,Xt∗;ut,ε,v)−J(t,Xt∗;u∗)≥0.
For each t, the first adjoint process(p(⋅;t),k(⋅;t)) solves on [t,T] the BSDE (3.1) with driver A′p+∑j(Cj)′kj+QX∗ and terminal value GXT∗−hEtXT∗−μ1Xt∗−μ2. The second adjoint process(P(⋅;t),K(⋅;t)) solves the matrix BSDE (3.2) with terminal value G. With these, define
Theorem 3.2 is the paper's general tool. Its two explicit results are applications of it. With a scalar state and deterministic coefficients, a pair of coupled Riccati-type equations gives a linear feedback equilibrium (Theorem 4.4). In mean–variance portfolio selection with state-dependent risk aversion and a possibly random risk premium, the equilibrium strategy is found through a quadratic BSDE (Theorem 5.4). Each is proved by exhibiting a solution of the flow (3.6) and checking (3.4). The theorem therefore separates the existence question (solving a flow of FBSDEs) from the equilibrium question. The paper notes that the general existence question remains open.
The results are proved in the paper and have no machine-checked proof. The mission produces a precise statement of open-loop equilibrium for a stochastic LQ problem with random coefficients, together with Lean statements of the spike expansion and of the adjoint flows. Mission II and Mission III restate the same model, and their final steps apply this theorem. Formal proofs of the milestones exercise Itô calculus for linear SDEs and BSDEs with bounded coefficients: product rules, conditional L2 estimates, and uniqueness and sign properties of linear BSDEs. This is infrastructure that Mathlib does not yet have.
Difficulty
The obvious argument is a first-order expansion of J in ε. It fails because the spike changes the control by v, which is not small, on a set of small measure. The state's deviation is then of order ε in L2, its square contributes at order ε, and a second-order term H(s;t) appears that a first-order adjoint cannot capture. Two features are absent from the classical maximum principle. The adjoint equations form a whole flow indexed by t, because the terminal value of (3.1) contains EtXT∗ and Xt∗. And every statement is conditional on Ft, so the expansion has to hold almost surely at the level of conditional expectations. That rules out arguments based on unconditional expectations.
Formalization scope
Brownian motion, LF2, Itô integrals and SDE solutions come from the published definition Peng1990_SMP_Stochastic. The formalization commits to the following conventions.
The filtration is the natural, uncompleted filtration of W. This changes no statement.
The state from time t (2.2) is the full-horizon state of the control that equals u∗ before t.
The spike is additive on [t,t+ε).
Definition 2.1 uses the lower limit, in R, along every sequence εk↓0, almost surely for each sequence, for every state of u∗ and of each perturbed control. The page writes "lim". That limit need not exist for merely bounded measurable R, and the proof of Theorem 3.2 only bounds the quotient from below.
Each adjoint BSDE lives on [t,T], not on [0,T]. Equation (3.2) is read entrywise, with symmetric values.
Condition (3.4) is encoded version-robustly. Part (a) is the generalized conditional expectation, via Ft-sets of full union. Part (b) requires a jointly measurable process that is, for almost every s, a version of Et[Λ(s;t)] and that tends to 0 as s↓t.
The O(⋅) estimates carry an explicit constant times ∣v∣2, and suprema are taken over rational times.
"Essentially bounded" and "a.s., a.e." mean ds⊗dP-almost everywhere.
The conclusion of the goal is Definition 2.1 itself. It mentions neither Λ nor the adjoint processes, so the goal cannot be closed by unfolding. A definition of equilibrium in terms of (3.4) or (3.5) would make Theorem 3.2 trivially true and is ruled out. Condition (3.5) of p. 6 is not a hypothesis of any statement. A degenerate, noise-free example checks that the hypotheses of the goal can hold together.
Contributions are welcome as follows. Proofs of the three milestones are reusable for Missions II and III and for any spike-variation argument. So are general lemmas on linear SDEs and BSDEs over Peng's Itô integral: uniqueness, conditional moment bounds, the Itô product rule, and positivity of linear matrix BSDEs.
S. Peng, A general stochastic maximum principle for optimal control problems, SIAM J. Control Optim. 28 (1990), 966–979. https://doi.org/10.1137/0328054
T. Björk, A. Murgoci, A general theory of Markovian time inconsistent stochastic control problems, SSRN 1694759, 2010. https://ssrn.com/abstract=1694759
I. Ekeland, A. Lazrak, Being serious about non-commitment: subgame perfect equilibrium in continuous time, arXiv:math/0604264, 2006. https://arxiv.org/abs/math/0604264
The Quantity Flexibility Contract and Supplier-Customer Incentives II: With a Perfect Demand Signal the Transfer Price c̄(ψ) Makes the Quantity Flexibility Contract System-EfficientResearch Paper
Motivation
A manufacturer must commit to production before its retail customer knows what the market will demand, while the customer would rather postpone its purchase until better information arrives. Left uncoordinated, each firm protects itself: the customer inflates forecasts it is not bound by, and the manufacturer, discounting those forecasts, builds less than the supply chain as a whole should. Quantity flexibility (QF) contracts, used in practice in the electronics and computer industries (Sun Microsystems, Solectron, Nippon Otis and others are cited in the paper), address this by tying the customer's forecast to a band: the manufacturer guarantees supply up to a percentage above the forecast, and the customer promises to buy at least a percentage below it.
Tsay (1999) gives a two-stage model of such a contract with a demand signal that arrives between production and purchase, shows that a supply chain without commitment underproduces, and characterizes when a QF contract restores efficiency. This mission formalizes the efficiency result for the case in which the signal predicts demand perfectly (Proposition 6(a)), together with the steps of the equilibrium that it rests on.
Setting
A manufacturer (EM) produces at unit cost m and sells to a retailer at unit transfer pricec; the retailer sells at price p, unsold units are salvaged at u at either site, and each unit of unmet demand costs a goodwill loss s. The standing assumptions are p>m>0, u<m and s≥0.
Before production, the retailer states a forecastq≥0. A QF contract {c,(α,ω)} with ω∈[0,1] and α≥−ω obliges the EM to make up to q(1+α) available and the retailer to buy at least q(1−ω). The EM then builds Q. A demand signalμ with distribution function Θ is observed, the retailer buys r, and market demand is filled from the retailer's stock. In this mission the signal is perfect (σε=0): market demand equals μ, so its distribution F equals Θ.
Given μ, the retailer's profit from buying r is
G(r∣μ)=pmin[μ,r]−cr−s[μ−r]++u[r−μ]+,
and it buys rQF∗=μ⊥[q(1−ω),Q], the point of the interval closest to μ. The EM's expected profit (2) is πEM,QF(Q;q)=(c−u)Eμ{rQF∗}−(m−u)Q. The retailer's forecast problem maximizes πR,QF(q)=Eμ{G(rQF∗∣μ)} with the EM building q(1+α). A central planner earns ΠCC(Q)=Eμ{pmin[μ,Q]−s[μ−Q]++u[Q−μ]+}−mQ, maximized at
QCC∗=F−1(p+s−up+s−m).
The total flexibility of the contract is ψ=(1+α)/(1−ω).
Formalization targets
Goal: Proposition 6(a)
With σε=0, the QF contract with flexibility ψ and transfer price
is system-efficient: the retailer's unique optimal forecast is q^=QCC∗/(1+α), the EM's unique optimal production given q^ is q^(1+α)=QCC∗, and the resulting expected system profit equals maxQΠCC(Q).
Milestones
§4: QCC∗ exists and is the unique maximizer of ΠCC.
§6.1: given μ, the retailer's unique optimal purchase in [a,b] is μ⊥[a,b].
Proposition 3(a): for ω<1, the optimal forecast qQF∗ is strictly positive, finite, and the unique solution of the first-order condition (3).
§7: for any forecast q≥0, expected system profit equals ΠCC(q(1+α)); hence it is maximal when the production level q(1+α) matches QCC∗.
Significance
The result shows that one contract form, by choosing the transfer price as a function of the flexibility, yields a whole menu of contracts each of which coordinates the supply chain, so that the two firms can trade price against flexibility without losing system profit. Its corollaries in the paper, that any split of expected profit is achievable by some efficient contract and that more flexibility shifts profit to the manufacturer, rest on (4).
The paper prints no proofs ("All proofs are omitted due to space limitations", p. 1341). A machine-checked development supplies them, makes explicit the regularity the argument needs (finite variance, a continuous and strictly increasing Θ, a positive efficient quantity), and gives reusable statements about newsvendor objectives with a clipped purchase. To our knowledge none of these results has been formalized before; the platform's quantity-flexibility theorems in other models (no manufacturer production stage, α=0, retailer side only) do not cover them.
Difficulty
Each firm optimizes its own objective, and the efficient price must work for both at once. Making the retailer's first-order condition hold at q^ pins down c, so nothing is left to adjust for the EM, whose incentive to build more than the contracted q(1+α) has to be ruled out separately at that same price. The retailer's objective is an expectation of a non-smooth function of a clipped purchase, so its derivative must be computed through the distribution of μ on two moving thresholds q(1+α) and q(1−ω), and strict concavity must come from the strict increase of Θ rather than from a density.
Formalization scope
All objects live in the namespace TsayQF.EffQF. The law of μ is a probability measure ν on R with μ∈L2(ν), whose distribution function cdf ν is differentiable and strictly increasing on R (the paper's "differentiable and invertible"). Expectations are Bochner integrals; finite variance makes every integrand integrable. Inverse distribution functions are not used: QCC∗ enters as a real number with the hypothesis F(QCC∗)=κS, which determines it uniquely, and (4) is defined in its printed shape. Optimality is IsMaxOn over the decision's natural set: forecasts in [0,∞), the EM's production in [q(1+α),∞), purchases in [q(1−ω),Q], central production in R.
Hypotheses made explicit: QCC∗>0 in the goal and a positive marginal value of the forecast at q=0 in Proposition 3(a), both standing for the paper's presumption that demand is almost certainly nonnegative; ω<1 (Proposition 3's case). The transfer price is only required to satisfy u<c<p+s rather than m<c<p, because cˉ(ψ) can exceed p when s>0. The milestones are the σε=0 instances of the paper's general statements.
Two modelling choices are fixed. The retailer's forecast objective takes the EM's production to be q(1+α), as §6.1 does after Proposition 2; the full game in which the retailer anticipates other EM responses is not modelled, and the goal instead verifies that the EM's unique best response at cˉ(ψ) is exactly q(1+α). The efficient price is the explicit formula (4), not "a price that makes QCC∗ optimal", which would make the goal a tautology; likewise system efficiency is stated as an inequality against ΠCC at every production level, not by definition.
Needed infrastructure: derivatives of expectations of piecewise-linear functions of a clipped variable, and the newsvendor fractile characterization. Both are reusable for other contract models. Proofs of any milestone, and of the goal from the milestones, are welcome.
Selected references
A. A. Tsay, The Quantity Flexibility Contract and Supplier-Customer Incentives, Management Science 45(10):1339–1358, 1999. https://doi.org/10.1287/mnsc.45.10.1339
The Quantity Flexibility Contract and Supplier-Customer Incentives I: Without Commitment the Manufacturer Underproduces for Every Transfer Price and the Supply Chain Is InefficientResearch Paper
Motivation
A manufacturer must commit to production before a retailer knows how much it will buy. In practice the retailer sends a forecast first, and the manufacturer plans against it. When the forecast binds neither party, the retailer has no reason to report it honestly, and the manufacturer has no reason to plan for the market rather than for its own margin. Purchasing managers have described this to Tsay directly, and Lee, Padmanabhan and Whang (1997) document such "phantom ordering" in several case studies.
A. A. Tsay, The Quantity Flexibility Contract and Supplier-Customer Incentives (Management Science, 1999), models the situation as a two-stage newsvendor game with a demand-information update between production and purchase. Its first result, Proposition 1, is the benchmark the rest of the paper builds on. Even when both parties share the same beliefs about demand, a linear transfer price alone leaves the manufacturer underproducing relative to a central planner, and the supply chain loses expected profit, for every transfer price. That inefficiency motivates the quantity flexibility (QF) contract studied in the remainder of the paper and in the companion mission of this series.
Setting
Costs. The retail price is p and the unit transfer price paid by the retailer to the manufacturer (the EM) is c. The unit production cost is m, the unit salvage value is u (the same for either party), and the unit goodwill loss on unmet demand is s. The paper's standing assumptions (§3.1, p. 1344) are
p>c>m>0,u<m,s≥0.
Three critical fractiles recur:
κR=p+s−up+s−c,κEM=c−uc−m,κS=p+s−up+s−m.
Demand (§3.3). Market demand is X=μ+ε. The signalμ has distribution function Θ, which is differentiable and strictly increasing, and finite variance. The error ε∼N(0,σε2) is independent of μ. F is the distribution function of X, Φ is the standard normal distribution function, and zε=Φ−1(κR).
Timing (§3.2). The EM produces Q knowing only the prior. Then μ is observed and the retailer buys r≤Q. Then X is realized, and both parties salvage their surplus. Given μ, the retailer's expected profit from purchase r is
G(r∣μ)=EX∣μ{pmin[X,r]−cr−s[X−r]++u[r−X]+}.(1)
Without commitment the retailer buys rNC∗(Q,μ)=min[μ+zεσε,Q]. The EM's expected profit is
πEM,NC(Q)=(c−u)EμrNC∗(Q,μ)−(m−u)Q,
and the retailer's is πR,NC(Q)=EμG(rNC∗(Q,μ)∣μ). A central planner producing Q before the signal earns
ΠCC(Q)=EX{pmin[X,Q]−s[X−Q]++u[Q−X]+}−mQ.
Formalization targets
Goal: Proposition 1 (p. 1347)
Let QNC∗ maximize πEM,NC and QCC∗ maximize ΠCC. Then, for every transfer price c admitted by the standing assumptions,
§4, p. 1345. The centralized optimum exists and is unique:
QCC∗=F−1(p+s−up+s−m).
§5.1, (1), p. 1346. The closed form
G(r∣μ)=(p+s−c)r−sμ−(p+s−u)EX∣μ[r−X]+,
and the retailer's optimal purchase under r≤Q is min[μ+zεσε,Q].
3. §5.2, p. 1347. The EM's optimal production exists and is unique:
QNC∗=Θ−1(c−uc−m)+zεσε.
Significance
Proposition 1 shows that sharing demand information does not remove inefficiency. Under common beliefs and with no commitment, no linear transfer price makes the decentralized chain efficient. Adjusting c moves profit between the parties but cannot recover the planner's expected profit. This is the reason the paper studies richer contracts, and the efficiency result for the QF contract (the paper's Proposition 6) is measured against the benchmark QCC∗ defined here.
The paper prints no proofs ("All proofs are omitted due to space limitations", p. 1341). A machine-checked development therefore supplies arguments the published record does not contain. It also exhibits the exact hypotheses the result needs. In particular it covers the degenerate case σε=0, where the signal is perfect. No part of this mission has a prior formal proof. Newsvendor critical-fractile results exist on Prove2Me for single-decision models, but without the production stage and information update used here.
Difficulty
The EM and the planner solve newsvendor problems against different demand laws. The EM faces the retailer's purchase μ+zεσε, while the planner faces X=μ+ε. Their fractiles are κEM and κS. The obvious comparison, κEM<κS, settles the case σε=0 only. For σε>0 the two quantities are inverse distribution functions of different random variables. zε may be negative, and the planner's distribution is a convolution. A comparison of fractiles alone therefore does not order QNC∗ and QCC∗. The strict profit gap also needs more than optimality of QCC∗: it requires comparing the decentralized system profit at QNC∗ with the planner's profit at the same production, and then using uniqueness of the planner's optimum.
The analytic infrastructure is also substantial. It includes differentiating expectations of piecewise-linear functions under a Gaussian law and under a general prior, continuity and strict monotonicity of a convolution's distribution function, and existence of a root of F(Q)=κS.
Formalization scope
All objects live in the namespace TsayQF.NoCommit, in one definitions file Model.
Costs are a structure Data with fields p,c,m,u,s∈R and the standing assumptions (i)–(iii) as fields. "For any c" is quantification over all Data. No sign is imposed on u.
The prior is a probability measure ν on ℝ; Θ is cdf ν. "Differentiable and invertible" is Differentiable ℝ (cdf ν) together with StrictMono (cdf ν), and "mean and variance" is MemLp id 2 ν.
The error variance is v : ℝ≥0, so σε=v and v = 0 is allowed. The law of X is the pushforward of ν.prod (gaussianReal 0 v) under addition, and given μ demand has law gaussianReal μ v.
Inverse distribution functions are not Lean functions here. zε is a real z with hypothesis cdf (gaussianReal 0 1) z = kR D. The milestones state existence of a solution of each fractile equation and characterize the maximizers by it.
Expectations are Bochner integrals. Finite variance of μ makes every integrand integrable, so no expectation silently defaults to zero.
Optimality is IsMaxOn over Set.univ for productions and over Set.Iic Q for the purchase. Productions range over R; the paper's presumption that μ and X are almost certainly nonnegative is not imposed, because no result here needs it.
The goal quantifies over arbitrary maximizers. Milestones 1 and 3 show that maximizers exist, so the goal is not vacuous. A sorry-free sanity file checks the paper's §8 data (p,c,m,u,s)=(15,10,6,3,0) and shows that a normal prior satisfies the hypotheses on Θ.
The goal must not be weakened to non-strict inequalities, and the EM's demand must remain the retailer's purchase min[μ+zεσε,Q], not market demand. Either change trivializes the result or changes it. Reusable pieces are the newsvendor critical-fractile characterization for a general continuous strictly increasing distribution, and monotonicity and continuity of the distribution function of a sum of independent variables with one Gaussian summand. Proofs of the milestones as standalone lemmas are welcome.
Selected references
A. A. Tsay, The Quantity Flexibility Contract and Supplier-Customer Incentives, Management Science 45(10):1339–1358, 1999. https://doi.org/10.1287/mnsc.45.10.1339
A. V. Iyer, M. E. Bergen, Quick Response in Manufacturer-Retailer Channels, Management Science 43(4):559–570, 1997. https://doi.org/10.1287/mnsc.43.4.559
On the Rank of Extreme Matrices in Semidefinite Programs and the Multiplicity of Optimal Eigenvalues: If m > k(n − k), Extreme Optima of Affine EV_k Have λ_k = λ_{k+1} with Multiplicity ≥ n − τResearch Paper
Motivation
Minimizing the sum of the k largest eigenvalues of a symmetric matrix that depends affinely on parameters is a basic problem of eigenvalue optimization (survey: A. S. Lewis and M. L. Overton, Eigenvalue optimization, Acta Numerica 5, 1996, doi:10.1017/S0962492900002646). Its objective is convex, and fk is differentiable at B exactly when λk(B)>λk+1(B); at optimal solutions the eigenvalues tend to coalesce, which makes the problem a model problem of nonsmooth optimization. G. Pataki, On the rank of extreme matrices in semidefinite programs and the multiplicity of optimal eigenvalues (Math. Oper. Res. 23(2), 1998, doi:10.1287/moor.23.2.339), gives a quantitative explanation in terms of the number of free parameters.
The paper also proves a bound on the rank of extreme points of semidefinite programs, now often called the Pataki bound (also obtained by Barvinok, 1995): an extreme point X of {X⪰0:Ai∙X=bi,i≤m} satisfies rankX(rankX+1)/2≤m. This bound is used throughout low-rank semidefinite optimization, for instance in the Burer–Monteiro approach.
Setting
Sn is the space of real symmetric n×n matrices, X⪰0 means X is symmetric positive semidefinite, and A∙B=∑i,jaijbij. For B∈Sn, λ1(B)≥⋯≥λn(B) are its eigenvalues and, for k∈{1,…,n},
fk(B)=λ1(B)+⋯+λk(B).
The multiplicitymult(λi(B)) is the largest p≥1 with λj(B)=⋯=λj+p−1(B) for some j≤i≤j+p−1.
A face of a convex set S is a convex F⊆S such that x∈F, y,z∈S, x=21(y+z) imply y,z∈F; an extreme point is a one-point face; dimS is the maximal number of affinely independent points of S, minus one. Write t(i)=i(i+1)/2 and
τ(l,r,s)=max{i+j:t(i)+t(j)≤l,i≤r,j≤s}.
Let A0,A1,…,Am∈Sn be linearly independent, A(x)=A0+∑i=1mxiAi, and assume m≥1 and k<n (the standing assumptions of §4). The affine eigenvalue problem is
(EVk)min{fk(A(x)):x∈Rm},
and Θ denotes its set of optimal solutions, a closed convex set. For B∈Sn the semidefinite program
minkz+I∙Vs.t.V,W⪰0,zI+V−W=B(3.14)
has optimal value fk(B); Ωk(B) is its set of optimal solutions (z,V,W).
Theorem 2.1: on a face F of the primal feasible set, t(rankX)≤m+dimF; on a face G of the dual feasible set, t(rankZ)≤t(n)−m+dimG.
Theorem 2.2: the multi-block version ∑jt(rankXj)≤m−q+dimG for programs with p semidefinite blocks and q free variables.
Lemmas 3.1, 3.2 and Theorem 3.3: the optimal value of (3.14) and an explicit description of Ωk(B) through an eigendecomposition B=QDiag(λ)QT.
The rank identity of §3: rankV+rankW+mult(λk(B))=n on Ωk(B) when λk(B)=λk+1(B).
Lemma 4.2 and (4.31): {x∗}×Ωk(A(x∗)) is a face of the feasible set of the lifted SDP (4.26), of dimension 1 or 0 according as λk>λk+1 or λk=λk+1.
Lemma 4.1: Θ contains no line, so it has extreme points whenever it is nonempty.
Significance
The theorem says that once the number of free parameters m exceeds k(n−k), the k-th and (k+1)-st eigenvalues necessarily coincide at extreme optimal solutions, so fk∘A is typically nonsmooth at its minimizers, and it bounds from below the dimension of the subdifferential ∂fk(A(x∗)), which is t(mult(λk)). The intermediate rank bounds of §2 are reusable on their own for any semidefinite program.
The results are proved in the paper. As far as is known, none of them (neither the Pataki rank bound, nor the semidefinite characterization of fk, nor Theorem 4.3) has a machine-checked proof. Formalizing them produces a library of faces and dimensions of spectrahedra, the SDP representation of the Ky Fan sum fk, and the multiplicity bound itself.
Difficulty
Extremality of x∗ in Θ is a statement in the parameter space Rm and gives no direct information on the spectrum of A(x∗): perturbation arguments on the eigenvalues alone break down precisely at the coalesced eigenvalues the theorem is about, where fk is not differentiable. The quantitative bound (4.30) also needs more than the optimal value fk(A(x∗)): it depends on the whole optimal set Ωk(A(x∗)), on the dimension of faces of spectrahedra, and on an exact count relating the ranks of the optimal V,W to the multiplicity of λk. None of these (faces and dimension of spectrahedra, the semidefinite representation of fk, eigenvalue run lengths) is in Mathlib.
Formalization scope
Matrices are Matrix (Fin n) (Fin n) ℝ; A∙B is the published BurerMonteiro.RankIncrease.frob, the primal and dual feasible sets are the published IsPrimalFeasible/IsDualFeasible, and λi(B) is the published ProjLikeRetr.Spectral.eig B ⟨i-1,_⟩ (Mathlib's nonincreasing eigenvalues, 0-based). Every matrix whose eigenvalues are taken is assumed symmetric. Faces, extreme points and dimension are defined as on p. 341; dimension is integer valued with dim∅=−1. All rank bounds are compared in Z. Θ is the argmin set {x:fk(A(x))≤fk(A(y))∀y} and Ωk(B) is the set of feasible points no worse than every feasible point; no infimum is used. Optimal values are stated as least elements of the set of feasible objective values.
Hypotheses added relative to the page, each disclosed in its item: 1≤k<n in the statements of §3, which mention λk+1; k≥1 (p. 340) in every §4 statement; one common matrix order in Theorem 2.2; and λk(B)=λk+1(B) in the rank identity of p. 348, which is false as printed when λk(B)>λk+1(B) (n=2, k=1, B=diag(2,0) gives 3=2) and is used in the paper only in the equal case. The linear independence of A0,…,Am is kept with A0 included, as on p. 348.
Trivializing formalizations are ruled out: Θ is not defined through a possibly junk infimum, a face must be convex and contained in the set, the dimension is not a junk 0, mult is the run length of equal eigenvalues and not a constant or an index, and the eigenvalues are only ever taken of symmetric matrices.
A complete development needs: the rank–dimension bound for faces of spectrahedra (reusable for any SDP), the semidefinite characterization of fk with its optimal set, and convexity facts on Θ. Proofs of any milestone, alternative proofs of the rank bounds, and the general smooth case of §5 are welcome.
Selected references
G. Pataki, On the rank of extreme matrices in semidefinite programs and the multiplicity of optimal eigenvalues, Mathematics of Operations Research 23(2), 339–358, 1998. https://doi.org/10.1287/moor.23.2.339
A. I. Barvinok, Problems of distance geometry and convex properties of quadratic maps, Discrete & Computational Geometry 13, 189–202, 1995. https://doi.org/10.1007/BF02574037
M. L. Overton and R. S. Womersley, Optimality conditions and duality theory for minimizing sums of the largest eigenvalues of symmetric matrices, Mathematical Programming 62, 321–357, 1993. https://doi.org/10.1007/BF01585173
F. Alizadeh, Interior point methods in semidefinite programming with applications to combinatorial optimization, SIAM Journal on Optimization 5(1), 13–51, 1995. https://doi.org/10.1137/0805002
A Single-Item Inventory Model for a Nonstationary Demand Process: With Adaptive Base-Stock Control at Two Stages, Upstream Inventory Is N(y₀, σ²∑_{i<K}(1+(L+i)α)²)Research Paper
Motivation
Classical safety-stock formulas assume that demand is stationary: independent and identically distributed around a fixed mean. Many products do not behave that way. Their demand level drifts, and the forecast has to follow it. Graves (A single-item inventory model for a nonstationary demand process, Manuf. Serv. Oper. Manag. 1(1):50–61, 1999) works out what such drift costs in inventory when it is modelled by the simplest nonstationary time series used in forecasting practice. The model is the integrated moving average process of order (0,1,1), for which the exponentially weighted moving average is the optimal forecast (Muth, 1960; Box, Jenkins and Reinsel, 1994).
The paper answers two questions. For one stage under an adaptive base-stock policy, it gives the exact distribution of the inventory, and hence the safety stock. For two stages in series, it shows that the order stream the downstream stage passes upstream is again of the same type, amplified. This is an explicit instance of the bullwhip effect of Lee, Padmanabhan and Whang (1997). The paper then gives the distribution of the upstream inventory. That last distribution, equation (16), is the goal of this mission.
Setting
Time is indexed by periods t∈Z; operation starts in period 1. Fix a mean level μ∈R, a parameter α with 0≤α≤1, a downstream lead time L∈N and an upstream lead time K∈N. The shocksε1,ε2,… are independent random variables, each normal with mean 0 and variance σ2.
Downstream stage (§2). The demand dt is the IMA(0,1,1) process
d1=μ+ε1,dt=dt−1−(1−α)εt−1+εt(t≥2).(1)
The forecastFt+1, made after observing dt, is the exponentially weighted moving average
F1=μ,Ft+1=αdt+(1−α)Ft(t≥1).(3)
The order qt, placed in period t and delivered in period t+L, follows the adaptive base-stock policy
qt=dt+L(Ft+1−Ft)(t≥1),qt=μ(t≤0).(7)
The inventory xt at the end of period t (negative values are backorders) obeys
xt=xt−1−dt+qt−L(t≥1),(6)
where x0 is an initial inventory chosen by the planner. Orders may be negative.
Upstream stage (§3). It sees the orders qt as its demand. It forecasts them with smoothing constant β=α/(1+Lα),
G1=μ,Gt+1=βqt+(1−β)Gt(t≥1),(11)
orders pt=qt+K(Gt+1−Gt) for t≥1 and pt=μ for t≤0 (15), and holds inventory
yt=yt−1−qt+pt−K(t≥1),(14)
with initial inventory y0.
In Lean, IsStage μ α L ε d F q x is the conjunction of (1), (3), (6), (7) and the boundary condition. IsUpstream μ β K q G p y is (11), (14), (15) and its boundary condition. upBeta α L is β, and IsTwoStage is the conjunction of the two stages.
Formalization targets
Goal: the upstream inventory distribution (16)
For every period t≥K (and t≥1), the upstream inventory yt is normally distributed with
E[yt]=y0,Std[yt]=σi=0∑K−1(1+(L+i)α)2.
Milestones, in the paper's order
The closed form of demand (2): dt=εt+α∑j<tεj+μ.
The forecast error (4): dt−Ft=εt.
The forecast update (5): Ft+1=Ft+αεt=α∑j≤tεj+μ.
The lead-time form of the inventory (proof of P1): xt=x0−∑j=t+1−Ltdj+LFt+1−L for t≥L.
Property P1: xt=x0−∑i=0L−1εt−i(1+iα), with εt=0 for t≤0.
The downstream inventory distribution (8): xt∼N(x0,σ2∑i<L(1+iα)2) for t≥L, and ∑i<L(1+iα)2=L(1+α(L−1)+α2(L−1)(2L−1)/6).
The orders in closed form (9): qt=(1+Lα)εt+α∑j<tεj+μ.
The orders are IMA(0,1,1) (10), with shocks ζt=(1+Lα)εt and parameter β, and 0≤β≤α.
The upstream forecast equals the downstream one: qt=Gt+ζt, qt=Ft+(1+Lα)εt, Gt=Ft.
Property P2: yt=y0−∑i=0K−1εt−i(1+(L+i)α), with εt=0 for t≤0.
Two further statements of the paper are included as plain theorems: the order amplification Std[qt∣Ft]=(1+Lα)σ=(1+Lα)Std[dt∣Ft] (p. 55), stated as: qt−Ft and dt−Ft are independent of Ft with laws N(0,(1+Lα)2σ2) and N(0,σ2), and the critical-fractile rule (p. 54). Under that rule, setting x0=zStd[xt] gives P(xt≥0)=Φ(z).
Significance
Equation (8) is a closed-form safety-stock formula for nonstationary demand. For α>0 the standard deviation of the inventory grows faster than L, so the textbook square-root law understates the safety stock. Equation (16) carries the formula one stage up a supply chain. With α>0, the upstream safety stock depends on the downstream lead time L, not only on the upstream lead time K. The paper concludes that shortening the downstream lead time can matter more than shortening the upstream one. P1 and P2 underlie these conclusions: they write each inventory as a fixed linear combination of a bounded window of shocks.
All results here are proved in the paper. None of them, and none of the model's objects, is formalized on Prove2Me or, as far as is known, anywhere else. The mission produces machine-checked versions of the closed forms and distributions. It also produces a reusable statement that a finite linear combination of independent Gaussian shocks is Gaussian, which Mathlib has only for two summands.
Difficulty
The pathwise milestones are inductions on the period, but they are not uniform. The inventory recursion (6) reads orders L periods back, so P1 has two regimes: t≥L, where every order read is a policy order, and 1≤t<L, where some are the boundary orders qs=μ. The paper treats the second regime only by "direct substitution", and a single statement has to cover both.
P2 is not a second copy of P1. The upstream stage is defined by its own recursions (11), (14), (15). It becomes an instance of the single-stage model only after (10) and the forecast identity Gt=Ft have been proved, and P1 must then be applied with parameter β and shocks ζt. The distributional statements (8) and (16) need the law of a finite weighted sum of independent normal variables. Mathlib provides the two-variable case; the finite-sum version, with a Z-indexed window of shocks, has to be built from it.
Formalization scope
All sequences are functions Z→R; lead times are natural numbers, cast to Z in indices and to R in coefficients, so no truncated subtraction occurs. The model is a predicate on sequences, and the objects d,F,q,x,G,p,y are constrained only by the paper's recursions (1), (3), (6), (7), (11), (14), (15) and the boundary conditions qt=pt=μ for t≤0. None of the closed forms (2), (5), (9), (10), P1 or P2 is built into a definition. In particular the upstream stage is not defined as an instance of the downstream one, which would assume (10). The paper's convention εt=0 for t≤0 is implemented by a masked sequence masked ε in P1 and P2, not by a hypothesis. The standing assumption 0≤α≤1 is a hypothesis of every theorem.
In (8) and (16) the shocks live on a probability space (Ω,P). They are measurable and mutually independent over periods t≥1 (iIndepFun over {s:Z∣1≤s}), each with law gaussianReal 0 (σ²). The system equations hold for every outcome, and the initial inventory is a constant. "Normally distributed with mean m and standard deviation s" is the law equality P.map (y t) = gaussianReal m (s²). A statement only about the variance would be weaker than the paper's claim and does not count. The critical-fractile theorem adds σ>0 and L≥1; without them the inventory is constant and the claim fails.
Contributions are welcome on the finite Gaussian-sum lemma, which is independent of this paper, and on any milestone in any order.
Selected references
S. C. Graves, A single-item inventory model for a nonstationary demand process, Manufacturing & Service Operations Management 1(1):50–61, 1999. https://doi.org/10.1287/msom.1.1.50
J. F. Muth, Optimal properties of exponentially weighted forecasts, Journal of the American Statistical Association 55(290):299–306, 1960. https://doi.org/10.1080/01621459.1960.10482056
G. E. P. Box, G. M. Jenkins, G. C. Reinsel, Time Series Analysis: Forecasting and Control, 3rd ed., Prentice Hall, 1994 (book; no DOI for this edition).
H. L. Lee, V. Padmanabhan, S. Whang, Information distortion in a supply chain: the bullwhip effect, Management Science 43(4):546–558, 1997. https://doi.org/10.1287/mnsc.43.4.546
Hardness of Approximating Flow and Job Shop Scheduling Problems 2: Coloring Reduction Gap: Makespan 2L·lb if G Is L-Colorable, Independent Set of Size n/(8L) if Half the Jobs Finish by L·lbResearch Paper
Motivation
In the job shop problem, jobs are sequences of operations, each to be processed on a given machine for a given time, and the goal is a schedule of minimum makespan (the time at which the last job finishes). Two numbers bound the optimum from below: the longest job and the most loaded machine. Their maximum is written lb. The best approximation algorithms for job shops have a performance guarantee polylogarithmic in lb (Shmoys, Stein and Wein 1994; Goldberg, Paterson, Srinivasan and Sweedyk 2001). Whether flow shops and job shops admit a constant-factor approximation was Open Problem 7 of Schuurman and Woeginger (1999).
Mastrolilli and Svensson (J. ACM 58(5), 2011) answered it negatively for the generalized flow shop. Their Theorem 1.2 states that for all sufficiently large constants K it is NP-hard to distinguish generalized flow shop instances with a schedule of makespan 2K⋅lb from instances in which no schedule finishes more than half of the jobs within 81K(1/25)logK⋅lb. The proof is a gap-preserving reduction Γ from graph colouring. This mission formalizes the combinatorial heart of that reduction.
Timeline. Shmoys, Stein and Wein (1994) gave an O((loglb)2/logloglb)-approximation for job shops, improved by a logloglb factor by Goldberg et al. (2001). Williamson et al. (1997) proved that approximating flow shops with unit operations within a ratio better than 5/4 is NP-hard. Feige and Scheideler (2002) gave acyclic job shop instances with optimum Ω(lbloglb/logloglb) and asked whether flow shops admit a much better upper bound than O(lbloglblogloglb). Khot (2001) proved the colouring hardness this reduction starts from. Mastrolilli and Svensson (FOCS 2008; J. ACM 2011) proved Theorem 1.2 and its job shop variants.
Setting
A generalized flow shop (flow shop with jumps) is a job shop with a fixed linear order on the machines in which every job visits its machines in increasing order but may skip machines. Operations may have length 0. A zero-length operation still occupies its machine for an instant, so it cannot be processed strictly inside another operation on the same machine.
Let G=(V,E) be a simple graph with n vertices whose vertices are partitioned into d independent sets I1,…,Id. Vertex v∈If has frequencyf(v)=f. For an integer r write lb=r2d. The instance S(r,d) has r2d groups M1,…,Mr2d of machines, each with one machine mg,v per vertex. The machines are ordered by group first and, within a group, by decreasing frequency. A vertex v of frequency f owns r2(d−f) groups of r2f identical jobs. The job jg,iv has a long-operation of length r2(d−f) on each of the r2f machines ma+1,v,…,ma+r2f,v, where a=(g−1)r2f. It also has a short-operation of length 0 on every machine of every neighbour of v, in every group. A long-operation is good if the next long-operation of the same job starts at most 4r2r2(d−f) time units after it ends. Tg,v is the set of first halves of the good long-operations on mg,v, and L(Tg,v) is the time they cover.
χ(G) is the chromatic number of G and α(G) the size of its largest independent set.
Formalization targets
Goal: the gap of Γ
For every graph G with a proper colouring into d classes and every integer r≥8, with S=S(r,d):
(a)S is a generalized flow shop, every job has length r2d and every machine load r2d;(b)G is K-colourable⟹Cmax∗(S)≤2K⋅r2d;(c)0<L≤r,α(G)<8Ln⟹in every feasible schedule fewer than half of the jobs finish by L⋅r2d.
Milestones
Remark 3.6 (lengths, loads, operation count), Claim 3.8 (an independent set's jobs fit in 2⋅lb), Lemma 3.7 (completeness), Lemma 3.10 (most long-operations are good), Lemma 3.11 (adjacent vertices have disjoint T-intervals), Lemma 3.12 (one group carries lb⋅n/8 of first-half time), and Lemma 3.9 (soundness: an independent set of size n/(8L)).
Significance
The result. Together with Khot's colouring hardness, the gap shows that no polynomial-time algorithm approximates the generalized flow shop within any constant factor unless P = NP, and rules out an O((loglb)1−ϵ)-approximation under a stronger complexity assumption (Theorem 1.3). It also shows that on the no-instances of the reduction every schedule has makespan greater than L⋅lb, far above the trivial lower bound lb. Because soundness bounds the number of jobs finished early, the same reduction also gives hardness for the sum of completion times (footnote 2).
Formalizing it. The paper proves every statement of this mission; none is open. As far as the catalog shows, none has a machine-checked proof. The soundness argument rests on a timing property of zero-length operations: a job of higher frequency must wait for a long-operation of an adjacent lower-frequency job. Such properties are easy to state loosely and easy to get wrong, so a verified proof would be useful. A formal proof would also make explicit the thresholds the paper leaves as "sufficiently large r".
Difficulty
Completeness is constructive and routine once the job and machine indexing is under control. The difficulty is soundness. One might argue directly that jobs of adjacent vertices never overlap in time, but that is false: a schedule may run them in parallel at the cost of delays. The argument controls it only on average. It throws away the jobs that finish late and the long-operations followed by a long delay. It shows that the first halves of the remaining long-operations of adjacent vertices are disjoint in each machine group. Then it finds a moment covered by many such first halves. Each step needs a precise count: of good operations per job, of covered time per group, and of overlap multiplicity at a point. The degenerate conventions (empty colour classes, n=0, the last long-operation of a job) have to be handled throughout.
Formalization scope
The instance is the published JobShopLTAS.Core.Instance (machines and jobs Fin (r^{2d} n), real nonnegative processing times, disjunctive machine constraint under which a zero-length operation cannot sit strictly inside another operation on its machine), with its IsFeasibleSchedule and makespan. The graph has vertex set Fin n and the partition into independent sets is a Mathlib proper colouring G.Coloring (Fin d). Frequencies f(v)=c(v)+1 are 1-based, as are group indices. Within a group the paper leaves machines of equal frequency unordered; they are ordered by vertex index. Every job's operation list is its machine set sorted by the global order. L(Tg,v) is the Lebesgue measure of the union of the intervals.
Explicit readings of the paper's wording:
"sufficiently large r" is r≥8 (from (1−4/r)≥1/2 in the proof of Lemma 3.12 via Lemma 2.4); Lemma 3.11 needs only r≥2, Lemma 3.10 r≥1;
"χ(G)=L" in Lemma 3.7 is L-colourability, and "makespan lb⋅2L" is makespan at most 2Lr2d;
"at least half the jobs finish within lb⋅L" is 2⋅#{j:Cj≤Lr2d}≥r2dn, with Cj the end of the last operation of j, and L is real with 0<L≤r;
the operation count is Remark 3.6's (Δ+1)r2d for a degree bound Δ, not the section introduction's dr2d;
the goal's soundness is the contrapositive of Lemma 3.9; Lemma 3.9 itself is stated positively.
Not formalized: "NP-hard", "for all sufficiently large K", "in time polynomial in n and rd", Khot's Theorem 1.7, the choice d=Δ+1, r=K(1/25)logK, and the randomized Lemma 3.1 behind Theorem 1.3.
A model in which zero-length operations occupy no machine time would make soundness false, and stating soundness only for schedules of an independent set's jobs would make it vacuous. The goal is about every feasible schedule of S(r,d), built from (G,c,r), in the published model, where zero-length operations do conflict.
A complete development needs counting lemmas for the indexing of jobs and machines, sorting facts for the operation lists, and a measure-theoretic averaging argument (a point covered by many intervals). The averaging argument and the good-operation counting are shared with the flow shop gap of Theorem 1.1 and reusable there. Proofs of any milestone, and sorry-free sanity checks on small instances, are welcome.
Selected references
M. Mastrolilli, O. Svensson, Hardness of Approximating Flow and Job Shop Scheduling Problems, J. ACM 58(5), Article 20, 2011. https://doi.org/10.1145/2027216.2027218
S. Khot, Improved inapproximability results for MaxClique, chromatic number and approximate graph coloring, FOCS 2001, 600–609. https://doi.org/10.1109/SFCS.2001.959936
D. B. Shmoys, C. Stein, J. Wein, Improved approximation algorithms for shop scheduling problems, SIAM J. Comput. 23, 617–632, 1994. https://doi.org/10.1137/S009753979222676X
L. A. Goldberg, M. Paterson, A. Srinivasan, E. Sweedyk, Better approximation guarantees for job-shop scheduling, SIAM J. Discrete Math. 14(1), 67–92, 2001. https://doi.org/10.1137/S0895480199326104
A Note on Probability Distributions with Increasing Generalized Failure Rates II: For IGFR X with Support (α, ∞) and g(ξ) → κ, E[Xⁿ] Is Finite iff κ > nResearch Paper
Motivation
Many models in operations management and economics need the demand or valuation distribution to be regular in some way, so that an optimal price, order quantity or contract is unique. Pricing a service to one customer whose valuation X has survival function Φˉ is a typical example. The seller maximizes pΦˉ(p). The first-order condition is Φˉ(p)(1−g(p))=0, where g(ξ)=ξh(ξ) is the generalized failure rate and h is the ordinary failure rate. When g is increasing (the IGFR property, introduced by Lariviere and Porteus 2001), the optimal price is unique and solves g(p∗)=1.
The best-known regularity class is the class of IFR laws, those with increasing failure rate. Every IFR law has finite moments of all orders (Barlow and Proschan 1965). IGFR laws are a larger class that includes heavy-tailed laws, and Lariviere (2006) identifies exactly which of their moments are finite. The answer is given by one number, the limit of the generalized failure rate. A consequence used in pricing models is that a valuation law with a finite mean has g>1 eventually, so the pricing problem has a finite solution.
Setting
Let X be a nonnegative random variable with distribution function Φ(ξ)=P(X≤ξ) and survival functionΦˉ(ξ)=1−Φ(ξ). Assume Φ has a density ϕ. The failure rate is
h(ξ)=Φˉ(ξ)ϕ(ξ),
and the generalized failure rate is g(ξ)=ξh(ξ). X is IGFR if g is weakly increasing on {ξ:Φ(ξ)<1}. X has support (α,∞), with α≥0, if Φ(ξ)=0 exactly for ξ≤α and Φ(ξ)<1 for every ξ. For a real n>0, the n-th moment is E[Xn]=∫xndΦ(x)∈[0,∞].
The comparison law is the Pareto law with scale S>0 and parameter k>0, which has density ϕ(ξ)=kSkξ−k−1 for ξ≥S. Its generalized failure rate is identically k on [S,∞), and its n-th moment is finite exactly when k>n. For a level y with Φˉ(y)>0, write Xy for X conditional on X>y. A random variable A is stochastically smaller than B if P(A>x)≤P(B>x) for all real x.
In Lean, X is its law μ : Measure ℝ, Φ is cdf μ, Φˉ is survival μ, h is failureRate μ φ, g is genFailureRate μ φ, and E[Xn] is nthMoment μ n.
Formalization targets
Goal: Theorem 2 (p. 603)
Suppose X is IGFR with support (α,∞) and limξ→∞g(ξ)=κ, where κ∈[0,∞] may be infinite. Then for every real n>0,
E[Xn]<∞⟺κ>n.
The statement fixes no constants. It covers κ=∞ (all moments finite) and the boundary case n=κ (infinite moment).
Milestones
The two Pareto facts of the §3 preamble come first:
gPareto(S,k)(ξ)=k(ξ≥S),E[Xkn]<∞⟺k>n.
Six claims from the proof follow:
E[Xn]<∞ iff the part of the integral over {X>y} is finite.
hy=h on (y,∞).
Φˉ(ξ)=exp[−∫0ξh].
If h(ξ)>c/ξ beyond y, then Xy is stochastically smaller than Pareto(y,c).
The usual stochastic order between nonnegative variables orders their n-th moments.
If h(ξ)≤c/ξ beyond z, then Pareto(z,c) is stochastically smaller than Xz.
Two consequences stated after the theorem are included as further targets. First, an IGFR law with support (α,∞) and a finite mean has g>1 beyond some finite point. Second, a strictly IGFR law with a finite (n+1)-st moment satisfies the two conditions of Van Mieghem and Dada (1999): h(ξ)−(n+1)/ξ has at most one zero, and limξ↓0ξh(ξ)<n+1.
Significance
The theorem gives a complete moment criterion for IGFR laws in terms of the single number κ. Among IGFR laws, finiteness of the mean, the variance or any higher moment can therefore be read off the tail of g. One consequence is that a finite mean is enough for the IGFR pricing problem to have a finite solution, which replaces the separate condition "g exceeds one at a finite point". The theorem generalizes Lemma 2 of Lariviere and Porteus (2001), and the paper uses it to connect IGFR laws to the Van Mieghem–Dada condition.
The result is proved on paper but has not been formalized. Formalizing it adds three things:
a machine-checked proof of the boundary case n=κ, which the printed argument (with 0<ε<n−κ) does not treat;
the Pareto moment and hazard identities, which Mathlib's Pareto.lean lacks;
a reusable link between failure-rate bounds and the usual stochastic order, through the representation Φˉ=exp(−∫h).
Difficulty
The core of the proof is a comparison: a pointwise bound h(ξ)≷c/ξ beyond a level becomes a stochastic order against a Pareto tail. This needs the representation Φˉ(ξ)=exp[−∫0ξh], which uses the fundamental theorem of calculus for logΦˉ across the left end of the support, where Φ may have a kink. It also needs to be stated for the conditional law, whose density is a rescaled restriction.
An obvious first attempt is to bound E[Xn] directly by ∫xnϕ(x)dx with the given bound on g. That bound controls ϕ/Φˉ, not ϕ, so it says nothing directly. The survival representation is what converts it.
A second obstacle is the boundary case n=κ, with κ finite. A strict margin ε is no longer available there. It needs the non-strict bound g≤κ, which follows from monotonicity, and a Pareto law with parameter exactly κ.
Formalization scope
Laws, not random variables. Every statement is about distributions, so X is represented by a probability measure μ on ℝ with μ (Set.Iio 0) = 0. In the goal, nonnegativity also follows from the support hypothesis, and the separate hypothesis is kept for uniformity with the other items.
The density version is pinned.h and g read ϕ pointwise, while "Φ has density φ" determines ϕ only up to a null set. The predicate IsRegDensity requires ϕ≥0 and μ=ϕ⋅Lebesgue. It also requires ϕ(ξ) to be the right derivative of Φ at every point ξ of {0<Φ<1} and ϕ=0 wherever Φ=0. The exponential law with ϕ(0)=0 satisfies all hypotheses of the goal, with κ=∞.
IGFR is weak monotonicity of g on {Φ<1}, as printed. On this set Φˉ>0, so Lean's convention x/0=0 never enters.
κ is an extended nonnegative real. The limit hypothesis is Tendsto (fun ξ => ENNReal.ofReal (g ξ)) atTop (𝓝 κ) with κ : ℝ≥0∞. A real-valued κ would silently drop the case κ=∞.
Moments are lower Lebesgue integrals∫⁻ x, ENNReal.ofReal (x ^ n) ∂μ with a real exponent. The Bochner integral would make "finite" automatic, because it returns 0 for a non-integrable function, so it is not used.
Conditioning and Pareto.Xy is Mathlib's ProbabilityTheory.cond μ (Set.Ioi y), always with Φˉ(y)>0. The Pareto law is Mathlib's paretoMeasure S k. "Stochastically smaller" is the published definition StochasticOrders.Usual.UsualOrder applied with the identity map.
Trivialization is ruled out. The goal is a full equivalence with a possibly infinite κ and an infinite-valued moment. It is not the weaker "κ>n implies finite", and the hypotheses are jointly satisfiable.
Recorded deviations. The printed bound "E[Xn∣X≤y]<yn+1" is a slip (it fails for y<1). Only the finiteness it is used for is formalized. The Pareto moment fact is stated as an equivalence, which contains the printed "only if".
Infrastructure. A complete development needs:
the Pareto moment integral;
the FTC argument for logΦˉ;
the layer-cake formula for moments under the usual order;
basic facts about cond and cdf.
The survival representation and the failure-rate/Pareto comparisons are reusable for any heavy-tail result stated through hazard rates. Contributions are welcome at every level, including partial results such as the Pareto lemmas alone.
Selected references
M. A. Lariviere, A note on probability distributions with increasing generalized failure rates, Operations Research 54(3):602–604, 2006. https://doi.org/10.1287/opre.1060.0282
M. A. Lariviere and E. L. Porteus, Selling to a newsvendor: an analysis of price-only contracts, Manufacturing & Service Operations Management 3(4):293–305, 2001. https://doi.org/10.1287/msom.3.4.293.9971
J. A. Van Mieghem and M. Dada, Price versus production postponement: capacity and competition, Management Science 45(12):1631–1649, 1999. https://doi.org/10.1287/mnsc.45.12.1631
AdWords and Generalized On-line Matching I: The Tradeoff Algorithm with ψ_k(i) = Σ_{j≥i} y*_j Is (1 − 1/e)-Competitive as k → ∞ When Bids Are SmallResearch Paper
Motivation
Search engines sell advertising space query by query. Each advertiser states a bid for each keyword and a daily budget; queries arrive one at a time, and each must be assigned to an advertiser immediately, without knowledge of the queries still to come. The revenue-maximizing assignment of the day can only be computed offline. The adwords problem asks how close an online rule can get to it. It generalizes online bipartite matching, for which Karp, Vazirani and Vazirani (KVV 1990) showed that randomized ranking attains ratio 1−1/e, and b-matching, for which Kalyanasundaram and Pruhs (KP 2000) showed that the deterministic BALANCE algorithm attains 1−1/e as the budget grows.
Mehta, Saberi, Vazirani and Vazirani (J. ACM 2007) gave a deterministic algorithm for arbitrary bids that weighs each bid by a function of the fraction of budget already spent, and proved that it is (1−1/e)-competitive when bids are small compared to budgets. The algorithm and its tradeoff function became the reference point for the online budgeted-allocation literature, including the primal-dual analysis of Buchbinder, Jain and Naor (ESA 2007).
Setting
There are Nbidders, each with budget 1, and a sequence of Mqueriesq1,…,qM. Bidder b bids cb,t≥0 for the query at position t. An allocationσ assigns each query to at most one bidder. Bidder b's spend before position t is min(1,∑s<t,σ(s)=bcb,s), and b is alive while its spend is below 1. The revenue of σ is rev(σ)=∑bmin(1,∑t:σ(t)=bcb,t).
Fix an integer k and split each budget into k equal slabs; a spent fraction s∈((j−1)/k,j/k] lies in slab j, and s=0 in slab 1. Given a tradeoff functionψ on slabs, the discrete tradeoff algorithm assigns each arriving query to an alive bidder maximizing
cb,tψ(slab(b)),
ties broken arbitrarily. Every allocation produced this way, for any tie-breaking, is a run.
The analysis uses the factor-revealing LPL: maximize ∑i=1k−1kk−ixi subject to ∑j=1i(1+ki−j)xj≤kiN and x≥0, written maxc⋅x, Ax≤b, x≥0, and its dual D. Its optimal dual solution is yi∗=k1(1−k1)k−i−1, and Theorem 8's tradeoff function is
ψk(i)=j=i∑k−1yj∗.
Formalization targets
Goal: Theorem 8 (p. 12)
For every δ>0 there is k0 such that for every k≥k0 there is η>0 such that, for every instance with bids in [0,η], every run σ of the algorithm with ψk, and every allocation τ,
rev(σ)≥(1−e1−δ)rev(τ).
The goal fixes no rate in k or η: it asserts only that the ratio tends to 1−1/e.
Milestones
Proof of Lemma 3 (pp. 8–9): xi∗=kN(1−k1)i−1 and y∗ are optimal for L and D, with value N(1−1/k)k.
Lemma 3 (p. 8): the value of L and D tends to N/e.
Lemma 4 (p. 10): for every nonnegative a and l=Aa, y∗ minimizes l⋅y over the constraints of D.
Lemma 5 (p. 10): l=b+Δ under the relation βi=N/k−(α1+⋯+αi−1)/k.
Lemma 6 (p. 11): OPT(q)ψ(type(q))≤ALG(q)ψ(slab(q)) when 1≤type(q)≤k−1.
Lemma 7 (p. 11): ∑i=1k−1ψ(i)(αi−βi)≤N/k, for a monotonically decreasing nonnegative ψ with ψ(k)=0 (such as ψk).
Significance
Theorem 8 gives an online algorithm for budgeted allocation with arbitrary bids whose revenue is within a factor 1−1/e of the offline optimum, the best possible ratio even for randomized algorithms (Theorem 9 of the same paper, the second mission of this series). It reduces to BALANCE when all bids are equal, and its tradeoff function 1−ex−1 in the limit is the function used in later work on online budgeted allocation and display-ad allocation.
The result is proved in the paper; none of it is formalized. The work here is to formalize the proof in a version that holds for actual runs. The paper's argument makes two simplifications with "negligible error": bidders of type j spend exactly j/k of their budget, and the offline optimum exhausts every budget. A formal proof must carry the bid size through the slab boundaries and compare with an arbitrary offline allocation. The LP lemmas (Lemmas 3–5) are self-contained statements about one triangular linear program and are reusable for factor-revealing analyses of BALANCE.
Difficulty
The milestones are short: Lemmas 3–5 are finite linear algebra with geometric sums, Lemma 6 is one application of the assignment rule plus monotonicity of spend, and Lemma 7 regroups finite sums. The difficulty is in Theorem 8. The paper's proof chains Lemmas 4, 5 and 7 through the LP L(π,ψ), whose right-hand side is computed from the numbers αj of bidders of each type under the assumption that a bidder of type j spends exactly j/k. In an actual run this identity fails: a single bid can straddle a slab boundary, and types are intervals, not points. So the chain does not compose literally, and the natural first attempt, instantiating Lemma 5 with the run's quantities, does not apply. The slab-wise inequalities that do hold, with an error of order kη, have to replace the equalities, and the comparison with an offline allocation that does not exhaust budgets has to be made through capped revenues.
Formalization scope
Bidders are Fin N and query positions Fin M, zero-based; slabs and LP coordinates keep the paper's 1-based ranges, with vectors as functions N→R read on 1≤i≤k−1. Budgets are 1 (the paper's standing simplification of §2). Bids are real and nonnegative.
A run is a predicate on the whole allocation: at position t, if some bidder is alive the query goes to an alive maximizer of bid ×ψ(slab), where spends are computed from earlier positions only; the query is unassigned only when all budgets are exhausted. Every tie-breaking rule gives a run, and the goal holds for all of them. ALG(q) is the full bid of the chosen bidder; revenue is capped at the budget.
Conventions the statements commit to:
ψk is the defining sum of Theorem 8. The closed form printed beside it, 1−(1−1/k)k−i+1, is off by one in the exponent; the sum equals 1−(1−1/k)k−i and vanishes at slab k.
"As k→∞" is ∀δ∃k0∀k≥k0; "bids small compared to budgets" is a bound η chosen after k, never depending on the instance.
The comparator is every allocation τ, not an optimum that exhausts all budgets; the paper says the proof extends without that assumption (§4, §6 item 2). Only the lower bound on the ratio is stated.
Lemma 4 quantifies over every nonnegative vector a, through which alone the instance and ψ enter D(π,ψ). Lemma 5 takes the paper's relation for βi as a hypothesis. Lemma 7 defines αi,βi as the query sums of its proof, and adds ψ(k)=0 in place of the paper's bound on the slab-k term, which rests on its exact-spend simplification.
Trivializing formalizations are ruled out: a run cannot leave a query unassigned while a bidder has budget, so the empty allocation is not a run; no hypothesis of the form "bidders of type j spend exactly j/k" or "the optimum exhausts every budget" is imposed, since either would make the goal vacuous on most instances.
All definitions are local to the namespace AdWordsMSVV.Tradeoff. Related platform items analyse a different algorithm: BJNAdAuctions.Basic.* and OnlinePrimalDual.AdAuctions.* formalize the Buchbinder–Jain–Naor primal-dual algorithm, which updates a covering variable multiplicatively and has ratio (1−1/c)(1−Rmax); they are not reused. Proofs of any milestone, and lemmas carrying the bid-size error through slab boundaries, are welcome.
Martingale Proofs of Many-Server Heavy-Traffic Limits for Markovian Queues 1: The Centered and √n-Scaled M/M/∞ Queue Converges in D to an Ornstein–Uhlenbeck ProcessResearch Paper
Motivation
Large service systems (call centers, hospital wards, cloud server pools) run with many servers, and for many of them no exact formula describes how the number of busy servers moves over time. Heavy-traffic limits replace such a system by a diffusion process that is easier to analyze. The many-server regime, in which the number of servers and the arrival rate grow together, goes back to Halfin and Whitt (1981) and is the basis of square-root staffing rules in call-center practice.
The simplest many-server model is the M/M/∞ queue. Its stationary number in system is Poisson with mean λ/μ, so the centered and n-scaled stationary count is asymptotically normal when λn=nμ. The question here is about the whole process: does the scaled number in system converge, as a random path, to a diffusion? The classical answer, the Ornstein–Uhlenbeck limit, was first established by Iglehart (1965) with Stone's theorem for birth-and-death processes, and was revisited by strong approximation (Mandelbaum, Massey and Reiman 1998) and, for general service times, by Krichagina and Puhalskii (1997).
Pang, Talreja and Whitt (2007) is a tutorial survey that proves this limit, and its finite-waiting-room extension, with martingale methods. The authors present the argument as a template for non-Markovian and network models (Reed 2009; Dai and Tezcan; Gurvich and Whitt). This mission formalizes the M/M/∞ result and the steps of the paper's proof.
Setting
Fix a service rate μ>0. For each n≥1, the n-th system has arrival rate λn=nμ. Let An and Sn be independent Poisson processes of rate 1, and let Qn(0) be a random initial number of customers, independent of An and Sn. The number in systemQn(t) is the N-valued process with right-continuous paths having left limits that satisfies, almost surely,
The departure term is a random time change: each of the Qn(s) customers in service completes service at rate μ. The diffusion-scaled process is Xn(t)=(Qn(t)−n)/n, the paper's (3). The space D consists of paths on [0,∞) that are right-continuous with left limits, and ⇒ denotes convergence in distribution.
The limit is the Ornstein–Uhlenbeck (OU) processX, driven by a standard Brownian motion B, with X(0) independent of B:
X(t)=X(0)+2μB(t)−μ∫0tX(s)ds,t≥0.(5)
The proof also uses the scaled martingales Mn,1(t)=(An(λnt)−λnt)/n and Mn,2(t)=(Sn(μ∫0tQn)−μ∫0tQn)/n, the fluid processes ΨS,n=Qn/n and ΦS,n(t)=nμ∫0tQn(s)ds, and stochastic boundedness. A sequence of real random variables is stochastically bounded if it is tight, and a sequence of processes is stochastically bounded in D if sup0≤t≤T∣Xn(t)∣ is, for every T>0.
Formalization targets
Goal: Theorem 1.1
If Xn(0)⇒X(0) in R, with an arbitrary limit law ν, then
Xn⇒Xin D as n→∞,
where X is the OU process (5) with X(0)∼ν. The goal fixes no initial distribution and assumes no moment condition on Qn(0).
Milestones, in the order of the proof
Lemma 2.1, that (12) defines Q, and Lemma 3.3, the crude bound Q(t)≤Q(0)+A(λt).
Lemmas 3.1 and 3.2, which identify ⟨M⟩ for compensated counting processes and for random time changes of a Poisson process. Then Theorem 3.4, the martingale representation Xn=Xn(0)+Mn,1−Mn,2−μ∫0⋅Xn, with ⟨Mn,1⟩(t)=μt and ⟨Mn,2⟩=ΦS,n.
Theorem 4.1(i), the continuity of the integral representation; Lemma 4.1, Gronwall's inequality; and Theorem 4.2, the Poisson FCLT.
Lemmas 5.9, 5.5, 5.8 and 6.2, the stochastic-boundedness route to the fluid limit.
Lemmas 4.3 and 4.2, the fluid limits Qn/n⇒1 and ΦS,n⇒μe; then Lemma 4.4, (Mn,1,Mn,2)⇒(μB1,μB2).
Significance
Theorem 1.1 describes the transient behavior of a large infinite-server system, not only its stationary law: fluctuations of order n around the offered load n form a Gaussian Markov process that relaxes at rate μ. It is the reference case for the Halfin–Whitt regime, whose finite-server version, Theorem 1.2 of the same paper (the M/M/n/mn+M queue), is the subject of the companion mission. The milestones are general tools reused well beyond queueing: Gronwall's inequality, the Lipschitz integral map, the Poisson FCLT, stochastic boundedness via Lenglart's inequality, and the fluid limit from stochastic boundedness.
The theorem is proved and classical; no machine-checked proof of it, or of the milestones below, is known. No formal library currently has the Poisson functional central limit theorem in D, compensators of counting processes, or random time changes of martingales. Formalizing the paper's proof would produce these, plus a template for the martingale method of heavy-traffic analysis. Alternative proofs, such as the paper's §4.3 route without martingales, are equally welcome as solutions.
Difficulty
Equation (12) is a fixed-point equation: Qn appears inside the argument of Sn. The integral map of Theorem 4.1 is continuous, so the obvious argument is to apply the continuous-mapping theorem to the martingale representation. That reduces the goal to the joint convergence of (Mn,1,Mn,2). But Mn,2 is a Poisson martingale evaluated at the random time ΦS,n(t), and its limit is identified only after the fluid limit ΦS,n⇒μe is known. The fluid limit is itself a statement about the whole sequence Qn, and it needs a separate argument, either Gronwall at fluid scale or stochastic boundedness. Lemma 3.2 requires optional stopping at the continuum of stopping times I(t), and the moment conditions (22) must be checked through the crude bound. Removing E[Qn(0)]<∞ needs a truncation of the initial conditions (§6.3).
Formalization scope
Time. Paths are functions R→R and every condition is for t≥0. Brownian motions and filtrations are indexed by R≥0.
Probability space. All systems live on one probability space. Each n has its own pair of Poisson processes; the paper's single pair is a special case, and weak convergence depends only on laws. Sequences start at n=1.
Weak convergence in D to a continuous limit is stated in coupling form (CouplingConverges): a Skorokhod representation with almost-sure uniform convergence on compact intervals. Convergence to a deterministic path is uniform convergence on compacts in probability (UocInProb). Xn(0)⇒ν is stated with bounded continuous test functions.
The OU process is the published Erlang-A diffusion with β=0 and θ=μ, whose drift is −μx. A solution has X(0)∼ν independent of B and is adapted to σ(X(0))∨σ(B(s):s≤t). The goal asserts existence and that every solution is a limit, which carries uniqueness in law. The limit space is in universe Type.
Predictable quadratic variation is a property, since Mathlib has no Doob–Meyer theorem: M is square integrable, V is adapted, continuous (the paper's "predictable", p. 208), nondecreasing and integrable, and M2−V is a martingale. Optional quadratic variations [M] are not stated.
Filtrations. The filtration of Theorem 3.4 is the generated history augmented by the measurable null sets.
Norms and suprema. The norm on Rk is ℓ1, and suprema of paths are taken in [0,∞].
Added hypotheses. The statements add three things the printed versions need: Mn(0)=0 in Lemma 5.8 (without it the lemma is false), S an F-Poisson process and I(0)=0 in Lemma 3.2, and integrability of g in Lemma 4.1.
Not formalized. Theorem 4.1(ii) (J1 continuity) and the birth-and-death clause of Lemma 2.1.
A formalization that fixes Qn(0)=n, assumes Xn(0) converges almost surely, adds E[Qn(0)]<∞ to the goal, or replaces convergence in D by convergence of finite-dimensional distributions proves a weaker theorem and does not close the goal.
Contributions are welcome at every level. The Poisson FCLT, Lenglart's inequality and the composition map are reusable library results, independent of queueing.
Selected references
G. Pang, R. Talreja, W. Whitt, Martingale Proofs of Many-Server Heavy-Traffic Limits for Markovian Queues, Probability Surveys 4 (2007) 193–267. https://arxiv.org/abs/0712.4211 (doi:10.1214/06-PS091)
Martingale Proofs of Many-Server Heavy-Traffic Limits for Markovian Queues 2: In the QED Regime the Scaled M/M/n/mₙ+M Queue Converges to a Diffusion Reflected at the Upper Barrier κResearch Paper
Motivation
Large service systems such as call centers, hospital wards and cloud server pools have many parallel servers, finite buffers and customers who leave when they wait too long. Their performance is usually analysed through heavy-traffic diffusion limits: the number of customers in the system, centred and rescaled, converges as the system grows to a diffusion process whose law is computable. The quality-and-efficiency-driven (QED) regime of Halfin and Whitt (Oper. Res. 29, 1981) is the scaling in which the number of servers n and the arrival rate grow together so that the probability of delay stays strictly between 0 and 1. Garnett, Mandelbaum and Reiman (M&SOM 4, 2002) proved the QED limit for the Erlang-A model with unlimited waiting room. Whitt (Math. Oper. Res. 30, 2005) added finite waiting rooms of size of order n, which produce a reflecting upper barrier in the limit.
Pang, Talreja and Whitt (Probab. Surveys 4, 2007) give a self-contained martingale proof of these limits. Theorem 1.2 of that paper, the target of this mission, covers the M/M/n/mn+M model with finite waiting room and abandonment. It contains the Erlang-B (loss) model (mn=0) and finite-buffer Erlang-C models (θ=0) as special cases.
Setting
Fix a service rate μ>0, an abandonment rate θ≥0, a constant β∈R and a barrier κ≥0. For n≥1, model n is an M/M/n/mn+M queue: n servers, a waiting room of mn∈{0,1,2,…} places, Poisson arrivals of rate λn, exponential services of rate μ, first-come first-served service, and an exponential patience of rate θ for each waiting customer. An arrival that finds all n+mn places occupied is blocked and lost.
The number in system Qn(t) is constructed from independent rate-1 Poisson processes A, S, R and an independent initial value Qn(0)≤n+mn by
where Un(t)=∫(0,t]1{Qn(s−)=n+mn}dA(λns) counts blocked arrivals. The QED scaling is
nnμ−λn→βμ,nmn→κ,
and the scaled process is Xn(t)=(Qn(t)−n)/n.
The limit is a reflected diffusion: a pair (X,U) of processes with right-continuous paths with left limits, X≤κ, U nondecreasing and nonnegative, a standard Brownian motion B independent of X(0), and
If Xn(0)⇒ν in R, then Xn⇒X in D, where X solves the reflected equation above with X(0)∼ν, and every solution with initial law ν has the same law:
Xn⇒Xin D[0,∞)(n→∞).
The goal fixes no rate of convergence and no stationary quantity; it asserts the process limit and its characterization by (9)–(10).
Milestones
Theorem 7.4: the martingale representation of Xn as Xn(0) plus scaled Poisson martingales Mn,i, a drift term, a Lipschitz feedback term and the scaled blocking process Vn=Un/n, with the predictable quadratic variations of the Mn,i.
(110): the limit noise B1(μt)−B2(μt)−B3(0) of three independent Brownian motions has the law of 2μB.
Theorem 7.3 (i): the deterministic reflected integral equation x=b+y+∫0⋅h(x)ds−u with barrier κ and Lipschitz h has a unique solution, depending continuously on (y,b) for uniform convergence on bounded intervals, and continuous when y is.
Significance
The theorem supplies the diffusion approximation behind square-root staffing rules for systems with finite buffers: it says that buffers of order n are visible in the limit as a barrier at κ, and that the limit for κ=0 (Erlang-B with or without abandonment) is a reflected Ornstein–Uhlenbeck-type process. Stationary blocking and delay probabilities of the limit then approximate those of the large finite system.
The result is proved in the literature (Whitt 2005; Pang, Talreja and Whitt 2007, whose proof of Theorem 1.2 is a sketch built on §7.1). It is not formalized anywhere. A formal proof would supply a checked martingale representation for a birth–death queue with blocking, a checked reflection map with state-dependent drift, and the continuous-mapping step through it. The unlimited-waiting-room case is posed separately on the platform as the Erlang-A limit of Garnett, Mandelbaum and Reiman and is not part of this mission.
Difficulty
The obvious route is the one used for the Erlang-A model: write Xn as a continuous function of the scaled Poisson noise and apply the continuous-mapping theorem. With a finite waiting room this fails as stated, because the blocking process Un is not a function of the noise alone. It depends on the path of Qn through the times the system is full. The proof must instead identify (Xn,Vn) as the image of the noise under a reflection map with a drift inside it, prove that this map is well defined and continuous, and control the martingale terms through random time changes whose limits are deterministic. The barrier in model n is mn/n, not κ, so the continuous-mapping step has to handle a moving barrier as well.
Formalization scope
Paths. Time is real; every path is a function on R of which only the values at t≥0 are used. "In D" is BellWilliams2001.ThresholdPolicy.IsCadlag. Brownian motion is ErlangA.Diffusion.IsStandardBM, indexed by R≥0; martingales are Mathlib Martingales indexed by R≥0.
Model. All systems live on one probability space with their own primitives An,Sn,Rn; Poisson processes are ManyServerQED.Scheduling.IsPoissonProcess. Qn(0) is independent of the primitives and Qn(t)≤n+mn for all t≥0. Blocked arrivals are counted with the left limit Qn(s−), correcting (114) as printed. θ=0 and κ=0 are allowed.
Weak convergence.Xn(0)⇒ν is convergence of expectations of bounded continuous functions. Xn⇒X in D is BellWilliams2001.ThresholdPolicy.CouplingConverges (Skorohod coupling with almost sure uniform convergence on compacts), equivalent to J1 weak convergence for a continuous limit. Uniform distances use supDist on R1.
Limit. The drift is ErlangA.Diffusion.drift; X(0) is independent of B; X and U are adapted to the filtration of X(0) and B; condition (10) is "the Lebesgue–Stieltjes measure of U, extended by 0 to negative times, gives zero mass to {t≥0:X(t)<κ}". Uniqueness is uniqueness in law of X. The limit space lives in Type.
Martingales. "Predictable quadratic variation V" means: V adapted with continuous, nondecreasing, nonnegative paths and M2−V a martingale. The filtration (118) is augmented by the measurable null sets, as the paper states.
Ruled out. Convergence of finite-dimensional distributions, a deterministic or almost surely convergent initial condition, a fixed barrier κ inside the prelimit model, or a solution concept that drops X≤κ or the barrier condition (10) would each make the statement weaker or vacuous; none is used.
Not in scope. The Skorohod J1 continuity in Theorem 7.3 (ii), the Erlang-A Theorem 7.1, and the non-Markovian arrivals of §7.3.
Contributions welcome: Stieltjes-integral and counting-process lemmas for Un, a reflection map with Lipschitz drift on D[0,∞), the Poisson functional central limit theorem, and martingale facts for randomly time-changed Poisson processes. The last three are reusable well beyond this mission.
S. Halfin, W. Whitt, Heavy-traffic limits for queues with many exponential servers, Operations Research 29 (1981) 567–588. https://doi.org/10.1287/opre.29.3.567
O. Garnett, A. Mandelbaum, M. Reiman, Designing a call center with impatient customers, Manufacturing & Service Operations Management 4 (2002) 208–227. https://doi.org/10.1287/msom.4.3.208.7753
A Re-Solving Heuristic with Bounded Revenue Loss for Network Revenue Management with Customer Choice: Mid-Point PAC Has Constant Revenue Loss Against the DLP, Uniformly in the Problem Size kResearch Paper
Motivation
Network revenue management decides, over a finite selling horizon, which products to offer to arriving customers when the products share limited resources: seats on flight legs, hotel room-nights, rental capacity. The exact dynamic program is intractable for realistic networks, so practice relies on heuristics built from a deterministic linear program (DLP), the fluid relaxation that replaces random demand by its mean. Its value is an upper bound on the revenue of every policy, and the quality of a heuristic is measured by its revenue loss against it.
For the fluid-based heuristics, the loss grows with the size of the system: a static policy derived from one DLP solution loses order k when capacities and demand rates are both scaled by k (Gallego and van Ryzin, 1997; Talluri and van Ryzin, 1998). Re-solving the DLP during the horizon is common practice, but for a long time it was unclear whether re-solving helps asymptotically; Cooper (2002) showed that naive re-solving can even hurt. Jasin and Kumar (Math. Oper. Res. 37(2), 2012, doi:10.1287/moor.1120.0537) proved that a re-solving heuristic with probabilistic allocation control (PAC) has a loss bounded by a constant independent of k, in a model that also covers customer choice through random resource consumption. Later work (Bumpensanti and Wang, 2020, arXiv:1802.06192) removed the nondegeneracy assumption with a different re-solving rule.
Setting
The horizon is [0,1]. Customer types q arrive as independent Poisson processes of rates λq≥0. Each of the noffersj belongs to one type q(j); Pq,j=1 iff q=q(j), and Sq={j:q(j)=q}. Presenting offer j consumes a random vector Aj≥0 of the m resources, i.i.d. across presentations, and earns revenue rj(Aj), with rj(0)=0; Aj=0 models a customer who buys nothing. Resource i starts with capacity Ci, and ξj bounds every Aij. Write Aˉ=E[A] and rˉj=E[rj(Aj)]. The DLP is
DLP[C,λ]:maxrˉ⊤xs.t.Aˉx≤C,Px≤λ,x≥0.
Assumption 2.1 requires DLP[C,λ] to be nondegenerate with a unique optimal solution Y; Assumption 2.2 requires that every optimum z of the LP without capacity constraints violates Aˉz≤C.
PAC re-solves at times 0=t0<t1<⋯<tM<1. At tℓ it solves DLP[C(tℓ),(1−tℓ)λ] with the remaining capacity, obtaining Y(tℓ); until tℓ+1 it picks offer j∈Sq for an arriving type-q customer with probability Yj(tℓ)/((1−tℓ)λq) and presents it only if the remaining capacity is at least ξj on every resource. In the k-th system capacities are kC and rates kλ; VDLPk is the DLP value and RPACk the revenue of PAC. Mid-point PAC re-solves at tl=1−2−l, l=1,…,Mk, with Mk the smallest integer such that 2−Mk≤1/k: about log2k re-solves.
Formalization targets
Goal: Theorem 5.2
There is ρ>0, independent of k, such that mid-point PAC satisfies
VDLPk−E[RPACk]≤ρfor all k≥1.
The goal fixes no constant: it asserts only that the loss is bounded uniformly in k.
Milestones
Observations B.1 and B.2: the fractional part Jy of Y is nonempty, and the augmented matrix W=[AˉB,y;PB2,y] is square and invertible.
App. B.2: the perturbed point YΔ=Y−HΔB is the unique optimum of DLP[C−Δ,λ] under explicit feasibility conditions.
Lemma C.4: the window deviation of the consumption has a sub-Gaussian exponential moment, E[erΔ~i]≤ekφ(t−s)r2 for ∣rξmax∣≤1.
Theorem 5.3, the general bound for any schedule:
VDLPk−E[RPACk]≤ρ+ρ^k∫01min{1,ρ′F(k,t)}dt.
App. C.6: for mid-point re-solving, G(k,t)≤4(1−t) before the last re-solve.
Further consequences: Theorem 5.1 (periodic PAC, loss ≤ρ+ρ^kh) and Corollary 5.1 (any schedule, loss ≤ρ+ρ^k).
Significance
The result shows that O(logk) re-solves suffice for a loss that does not grow with the size of the system, against an upper bound that is valid for every policy; so PAC is within a constant of the optimal policy, and the DLP bound, the optimal value and PAC are asymptotically equivalent to order O(1). Theorem 5.3 makes the trade-off between re-solving frequency and loss explicit for any schedule, and Corollary 5.1 guarantees that re-solving in this form never worsens the static O(k) bound.
The result is proved on paper. No part of it is formalized: the mission produces a machine-checked model of a Poisson network with random consumption and a re-solving policy, a statement of LP perturbation theory for nondegenerate programs, and compound-Poisson moment bounds, each reusable for other re-solving and fluid-approximation results in revenue management.
Difficulty
The obvious argument compares PAC with its fluid path and bounds the deviation of the remaining capacity by a martingale estimate over the whole horizon. That gives only O(k): deviations late in the horizon cannot be corrected. A constant bound needs re-solving to correct earlier deviations, which in turn needs the re-solved DLP solution to depend linearly and stably on the capacity deviation (the perturbation analysis of App. B) and a hitting-time estimate for when that linear regime fails. The capacity check and the coupling between the re-solved solutions and the random consumption make the process non-Markovian in the obvious state variables.
Formalization scope
Types are Fin NT, offers Fin n, resources Fin m. The model is a structure holding q(j), λ, C, the consumption laws Dj (measures on Rm), ξ and the revenue functions. Standing readings (IsValid): λ≥0 and C≥0; each Dj is a probability measure with 0≤Aij≤ξj almost surely (the page has ξj≥Aij on p. 317 and Aij<ξj on p. 327; the weaker one is used); revenue functions are measurable, vanish at 0, and are nonnegative and bounded by a common constant (implicit on the page). rˉj=E[rj(Aj)] is a reading fixed by App. A.1.
E[RPACk] is a backward recursion over the windows between re-solves. Each window holds a Poisson(kΛℓ) number of arrivals with i.i.d. types (superposition and marking), and the expected value is computed arrival by arrival with the capacity check on every resource. PAC is quantified over every DLP selector that returns an optimal solution and is measurable in the capacity, since the page leaves ties open after time 0. All constants are chosen after the instance and before k, the selector, the schedule, v and h. Nondegeneracy follows Bertsimas–Tsitsiklis: every basic feasible solution has exactly n active constraints.
Disclosed deviations from the page:
Theorem 5.3 adds integrability of v in t (stated in Lemma C.1) and writes v≤1/ξmax as vξmax≤1.
The C.6 bound G(k,t)≤4(1−t) is stated for t<tMk; the page's "for all t∈[0,1]" is false after the last re-solve.
Theorem 5.1's constants are chosen before h, which is what (6) requires.
The goal is stated as printed, although the printed proof uses v=1/ξmax, admissible only when ξmax≥1. Measuring every resource in a common smaller unit multiplies A, C and ξ by the same factor and changes neither VDLPk nor E[RPACk], so this assumption costs no generality.
A formalization in which PAC does not check capacity, or stops checking after a hitting time, earns exactly VDLP and would make the goal trivial; the model here applies the check at every arrival. A constant chosen after k would also be trivial, since the loss is at most k∑qλq times the revenue bound.
The source is the published Math. Oper. Res. version; printed page = PDF page + 311. Sample-path lemmas (B.2–B.4, C.1–C.3) are not stated. Contributions are welcome on the LP perturbation lemma, the compound-Poisson moment bound and the measurability of the PAC recursion, each of which stands alone.
Selected references
S. Jasin, S. Kumar, A Re-Solving Heuristic with Bounded Revenue Loss for Network Revenue Management with Customer Choice, Mathematics of Operations Research 37(2):313–345, 2012. https://doi.org/10.1287/moor.1120.0537
G. Gallego, G. van Ryzin, A Multiproduct Dynamic Pricing Problem and Its Applications to Network Yield Management, Operations Research 45(1):24–41, 1997. https://doi.org/10.1287/opre.45.1.24
K. Talluri, G. van Ryzin, An Analysis of Bid-Price Controls for Network Revenue Management, Management Science 44(11):1577–1593, 1998. https://doi.org/10.1287/mnsc.44.11.1577
P. Bumpensanti, H. Wang, A Re-Solving Heuristic with Uniformly Bounded Loss for Network Revenue Management, Management Science 66(7), 2020. https://arxiv.org/abs/1802.06192
D. Bertsimas, J. N. Tsitsiklis, Introduction to Linear Optimization, Athena Scientific, 1997.
AdWords and Generalized On-line Matching II: No Randomized Online Algorithm for b-Matching Has Competitive Ratio Better Than 1 − 1/e, for Every Budget bResearch Paper
Motivation
Search engines sell advertising slots query by query. Each advertiser states a bid per keyword and a daily budget; queries arrive one at a time, and the engine must assign each to an advertiser immediately, without knowing which queries will come later. Mehta, Saberi, Vazirani and Vazirani (J. ACM 2007) called this the adwords problem and gave a deterministic online algorithm whose competitive ratio, the worst-case ratio of its revenue to the best offline revenue, tends to 1−1/e when bids are small compared to budgets. Section 7 of the same paper shows that this ratio cannot be beaten, even by randomized algorithms and even under the small-bids assumption. That lower bound is the subject of this mission.
Timeline of the special cases:
1990. Karp, Vazirani and Vazirani (STOC 1990) proved that no randomized online algorithm for online bipartite matching (unit bids, unit budgets) has competitive ratio better than 1−1/e, and that their algorithm RANKING attains it.
2000. Kalyanasundaram and Pruhs (Theoret. Comput. Sci. 2000) studied online b-matching: budgets of b units and 0/1 bids. Their deterministic algorithm BALANCE has competitive ratio tending to 1−1/e as b→∞, and they proved that no deterministic algorithm does better. Whether randomization helps for large b was left open (Kalyanasundaram–Pruhs 1998).
2007. Mehta, Saberi, Vazirani and Vazirani (Theorem 9) closed that question: no randomized online algorithm beats 1−1/e for b-matching, for large b.
Setting
An instance of online b-matching has N bidders and a sequence of queries t=0,1,…,M−1. Every bidder has the same integer budget B≥1. Each query t comes with the set I(t) of bidders that bid 1 on it; the others bid 0.
A deterministic online algorithma processes the queries in order. When query t arrives it sees the bid sets I(0),…,I(t) and nothing later, and it either proposes a bidder or leaves the query unallocated. The proposal succeeds if the bidder bids on the query and has won fewer than B queries so far; the bidder then pays 1. The algorithm is not required to be greedy. Its revenueALGa(I) is the number of queries won. A randomized online algorithmA is a probability distribution over deterministic online algorithms, fixed before the instance is chosen; its expected revenue is EA[ALG(I)]=∑aA(a)ALGa(I).
An offline allocationτ assigns each query to a bidder or to nobody, with full knowledge of I. Its revenue is revB(I,τ)=∑rmin{B,∣{t:τ(t)=r,r∈I(t)}∣}: each bidder pays for the queries it bids on, up to its budget.
The permuted round instances of the proof are as follows. For a permutation π of the bidders, the instance Iπ consists of N rounds Q1,…,QN of B queries each, and bidders π(i),π(i+1),…,π(N) bid on the queries of round Qi. The distribution D is the uniform distribution over these N! instances, and Eπ denotes the average over it. The paper writes this instance with budget 1, bids ϵ and 1/ϵ queries per round; the Lean development uses the same instance scaled by B=1/ϵ.
Formalization targets
Goal: Theorem 9
For every δ>0 there is N0 such that for all N≥N0, all B≥1 and every randomized online algorithm A for N bidders and NB queries, there are an instance I and an allocation τ with
revB(I,τ)=NBandEA[ALG(I)]≤(1−e1+δ)NB.
The constant 1−1/e is the paper's. The slack δ is not a weakening of the paper's claim: a competitive ratio better than 1−1/e would mean a ratio 1−1/e+δ′ for some δ′>0 on every instance. The threshold N0 is independent of the budget, which is how "for large b" is rendered.
Milestones (proof of Theorem 9, p. 15)
Yao step. If every deterministic algorithm a has Eπ[ALGa(Iπ)]≤V, then every randomized A has some π with EA[ALG(Iπ)]≤V.
The optimum.revB(Iπ,τπ)=NB for the allocation τπ:Qi↦π(i), and no allocation earns more.
The display. For a deterministic a, with qij(π) the fraction of Qi won by π(j),
Eπ[qij]≤N−i+11(j≥i),Eπ[qij]=0(j<i).
Per-bidder bound.Eπ[La(π(j))/B]≤min{1,∑i=1jN−i+11}, where La(r) is the number of queries bidder r wins.
Summed bound.∑j=1Nmin{1,∑i=1jN−i+11}≤(1−1/e+δ)N for N≥N0(δ).
Average revenue.Eπ[ALGa(Iπ)]≤(1−1/e+δ)NB for N≥N0(δ), every B≥1 and every deterministic a.
Significance
The result. Theorem 9 shows that the 1−1/e ratio attained by BALANCE for large budgets, and by the paper's tradeoff algorithm for adwords with small bids, is optimal among all online algorithms, randomized or not. Since b-matching is a special case of adwords with small bids, the same bound applies to adwords. It also answers the question of Kalyanasundaram and Pruhs on whether randomization helps for b-matching. With B=1 it contains the bipartite matching lower bound of Karp, Vazirani and Vazirani.
Formalizing it. The result has been proved since 2007; to our knowledge it has no machine-checked proof. The b = 1 case is posed on the platform as KVVMatching.UpperBound.theorem_2 (Karp–Vazirani–Vazirani), with columns arriving in reverse index order and an analysis of the algorithm RANDOM; this mission poses the budget-uniform statement in its own model. A formalization yields a reusable model of online algorithms with budgets (histories that hide the future, randomized algorithms as mixtures of deterministic rules) and a formal instance of Yao's principle for online problems.
Difficulty
The bound must hold for every deterministic online algorithm, including ones that are not greedy, waste proposals, or base each decision on the entire revealed history. A tempting argument fixes the algorithm's behaviour per round and treats it as oblivious to earlier rounds; that only covers a subclass. The history of the permuted instance reveals, before round i, exactly which bidders dropped out in earlier rounds, so the information available to the algorithm grows round by round, and the bound on Eπ[qij] has to hold conditionally on everything revealed. Budgets interact across rounds: whether a proposal in round i succeeds depends on wins in earlier rounds. Finally, the printed "at most N(1−1/e)" is false at every finite N: the sum in milestone 5 exceeds N(1−1/e) by a bounded amount (about 0.316 for large N), so the analytic step is genuinely asymptotic.
Formalization scope
Representation. Bidders are Fin N and query positions Fin M, both zero-based. An instance is Fin M → Finset (Fin N). A history is Fin M → Option (Finset (Fin N)) with unrevealed entries none. A deterministic algorithm is Fin M → History N M → Option (Fin N), a randomized one is a PMF over deterministic algorithms, and expected revenue is a finite sum.
Conventions. Budgets are a common integer B and bids are 0/1; the paper's budget-1, bid-ϵ instance is the same instance scaled by B=1/ϵ. A query in position t belongs to round ⌊t/B⌋+1. Rounds i and positions j in milestones 3–4 are 1-based, as in the paper. "Bidder j" in the proof means the bidder π(j) in position j of the permutation. The j<i case of the display is an equality. The comparator in the goal is an explicit allocation of revenue NB, which is the maximum possible.
Ruled out. The algorithm sees only the revealed history, never I or π, and the randomized algorithm is chosen before the instance. An algorithm that could see the instance would trivially earn NB, and choosing the instance first would make the goal the averaging statement of milestone 6, not Theorem 9.
Infrastructure. Needed: finite sums over permutations, the exchange of the average over π and over the algorithm, invariance of a run under permutations that fix the revealed information, and estimates of harmonic sums HN−HN−j against log. The online-algorithm model and the Yao step are reusable for other online lower bounds. Contributions to any milestone are welcome; milestone 5 is pure real analysis and independent of the model.
Basic Packing of Arborescences: A Digraph with Roots Has an M-Basic Packing of Arborescences iff π Is M-Independent and D Is M-ConnectedResearch Paper
Motivation
Packing arc-disjoint arborescences is one of the basic tractable problems of combinatorial optimization. Edmonds' branching theorem (1973) says that a digraph D=(V,A) contains k arc-disjoint spanning arborescences rooted at a vertex r if and only if every non-empty vertex set X⊆V∖r is entered by at least k arcs. Its undirected counterpart is the Tutte–Nash-Williams theorem on edge-disjoint spanning trees, and Frank showed how the undirected theorem follows from the directed one through an orientation argument. Both results underlie network-design and connectivity-augmentation algorithms, and the cut condition in Edmonds' theorem is the model for many min–max theorems on packings.
Katoh and Tanigawa (2013), motivated by the rigidity of frameworks with boundaries, introduced matroid-based packings of rooted trees in undirected graphs: the roots of the trees are elements of a matroid, and every vertex must be covered by trees whose roots form a base. Durand de Gevigney, Nguyen and Szigeti (arXiv:1207.1985, 2012) gave the directed counterpart. Their Theorem 1.6 characterizes digraphs with roots that admit a matroid-based packing of arborescences, contains Edmonds' theorem as the special case of the free matroid with all roots at one vertex, and implies Katoh and Tanigawa's undirected theorem through Frank's orientation theorem. Its proof is short and purely combinatorial.
Timeline:
1961: Tutte and Nash-Williams characterize graphs with k edge-disjoint spanning trees.
1973: Edmonds characterizes digraphs with k arc-disjoint spanning arborescences rooted at r.
1980: Frank's orientation theorem for intersecting supermodular demand functions.
2011–2013: Katoh and Tanigawa, rooted-tree decompositions with matroid constraints (undirected).
2012: Durand de Gevigney, Nguyen and Szigeti, the directed theorem (this mission).
Setting
A digraphD=(V,A) has a finite vertex set V and a finite set A of arcs, each with a tail and a head; parallel arcs are allowed. For X⊆V, ϱD(X) is the set of arcs entering X (tail outside, head inside) and ρD(X)=∣ϱD(X)∣. An arborescence rooted at r is a sub-digraph that is a directed tree in which r has in-degree 0 and every other vertex has in-degree 1; the single vertex r is an arborescence.
Let S be a finite set and π:S→V a placement of its elements at vertices (several elements may sit at one vertex). The triple (D,S,π) is a digraph with roots. Write SX=π−1(X) and Sv=π−1(v). Let M be a matroid on S with rank function rM.
π is M-independent if Sv is independent in M for every vertex v.
(D,S,π) is M-connected if
ρD(X)≥rM(S)−rM(SX)for all non-empty X⊆V.(3)
An M-basic packing of arborescences is a family (Ts)s∈S of pairwise arc-disjoint arborescences of D, Ts rooted at π(s), such that for every vertex v the set {s∈S:v∈V(Ts)} is a base of M. The arborescences need not be spanning.
In Lean these are Digraph, Arborescence, MIndependent, MConnected and IsBasicPacking in the namespace BasicPackArb.Main; the proof-side notions (tight sets, domination, good and bad arcs, the parallel extension) are in a second definitions module.
Formalization targets
Goal: Theorem 1.6
∃(Ts)s∈San M-basic packing of arborescences in (D,S,π)⟺π is M-independent and (D,S,π) is M-connected.
The statement is universally quantified over the vertex, arc and root types, the digraph, the placement and the matroid. It has no constants.
Milestones
The necessity direction (§2, p. 4).
Claim 2.1: if rM(P∩Q)+rM(P∪Q)=rM(P)+rM(Q), an element spanned by P and by Q is spanned by P∩Q.
Claim 2.2 (a), (b), (c): uncrossing of tight sets, the part of a tight set reaching a vertex, and domination along good arcs.
Claim 2.3: with no bad arc, single-vertex arborescences form a basic packing.
The lifting step (p. 5): removing a bad arc uv and adding a root s′ parallel to s at v preserves independence, and a packing of the new instance lifts back.
Statement (4) and Claim 2.4: some bad arc can be split off while keeping M′-connectedness.
Significance
The result. Theorem 1.6 is a good characterization: both sides can be certified, and the condition (3) is a cut condition with a submodular right-hand side. It unifies Edmonds' branching theorem (free matroid, all roots at one vertex) with matroid-constrained packings, and through Frank's orientation theorem it yields Katoh and Tanigawa's theorem on rooted-tree decompositions, which is used in combinatorial rigidity. The same paper derives from it a description of the convex hull of basic packings and a polynomial algorithm for the minimum-cost version.
Formalizing it. The result is proved on paper; no machine-checked proof of Theorem 1.6, of Edmonds' branching theorem, or of any of the claims is known on this platform. A formal proof needs a multi-digraph library with arc deletion, arborescences as sub-digraphs, in-degree functions of vertex sets and their submodularity, and matroid rank and span arguments on top of Mathlib's Matroid. The milestones follow the paper's induction on the number of arcs.
Difficulty
The necessity direction is a counting argument. Sufficiency is the substance. The natural first attempt, building the arborescences greedily or splitting S into Edmonds instances, fails because the arborescences are not spanning and the covering condition is a base condition at every vertex, coupled through the matroid. The hard step is Claim 2.4: deleting an arc can destroy condition (3), and it must be shown that some bad arc, together with a suitable new parallel root, can be removed without doing so. Condition (3) has to be controlled for every vertex set at once, with a right-hand side that changes with the matroid. Formally, the lifting step requires gluing two arborescences with an arc and checking that the base condition survives the identification of the parallel pair.
Formalization scope
Vertices: a Fintype V with decidable equality. Arcs: an ambient type with tail, head and a finite arc set arcs, so parallel arcs and loops are allowed and D−uv deletes one arc.
Arborescence: vertex set, arc set inside A with ends in the vertex set, a root of in-degree 0, in-degree exactly 1 at other vertices, every vertex reachable from the root. Under the in-degree conditions this is equivalent to being a directed tree.
The packing is a family indexed by S, not a set of arborescences, so ∣Sv∣ equal single-vertex arborescences count separately.
Matroid: Mathlib's Matroid S with ground set all of S (a finite type); rank is Matroid.eRk with values in N∞; base is IsBase, independence is Indep.
SpanM(Q)={s:rM(Q∪{s})=rM(Q)}, defined literally.
(3) and tightness are written additively, rM(S)≤ρD(X)+rM(SX) and ρD(X)+rM(SX)=rM(S), so no truncated subtraction appears. (3) ranges over all non-empty X, including sets that contain roots.
The extension S′ is Option S with the new element none; M′ is the comap of M along o↦o.getDs, which makes none parallel to s and restricts to M on S.
Claims stated inside the sufficiency proof carry that proof's standing hypotheses explicitly (πM-independent, M-connected, and "no bad arc", "a bad arc exists" or "Claim 2.4 is false" as the page says).
A formalization in which arborescences need not lie in A, or need not be reachable from their root, or in which the packing is a set of arborescences, or the per-vertex condition is "spanning" or "independent" rather than "base", states a different theorem and is ruled out by the definitions above.
Contributions welcome: proofs of the claims in any order, general lemmas on submodularity of ρD and on tight-set uncrossing (reusable for other arborescence-packing results), and a proof of Edmonds' branching theorem as a corollary of the goal.
Selected references
O. Durand de Gevigney, V.-H. Nguyen, Z. Szigeti, Basic Packing of Arborescences, arXiv preprint, 2012. https://arxiv.org/abs/1207.1985v1 (published as Matroid-based packing of arborescences, SIAM J. Discrete Math., 2013).
J. Edmonds, Edge-disjoint branchings, in R. Rustin (ed.), Combinatorial Algorithms, Academic Press, 1973, pp. 91–96.
N. Katoh, S. Tanigawa, Rooted-tree decompositions with matroid constraints and the infinitesimal rigidity of frameworks with boundaries, SIAM J. Discrete Math., 2013.
A. Frank, On the orientation of graphs, J. Combin. Theory Ser. B 28 (1980) 251–261.
W. T. Tutte, On the problem of decomposing a graph into n connected factors, J. London Math. Soc. 36 (1961) 221–230; C. St. J. A. Nash-Williams, Edge-disjoint spanning trees of finite graphs, J. London Math. Soc. 36 (1961) 445–450.
A. Frank, Connections in Combinatorial Optimization, Oxford University Press, 2011.
The Strong Second-Order Sufficient Condition and Constraint Nondegeneracy in Nonlinear Semidefinite Programming: At a Local Minimizer They Are Equivalent to Strong Regularity of the KKT PointResearch Paper
Motivation
Nonlinear semidefinite programming asks to minimize a smooth function subject to smooth equality constraints and a constraint that a smooth matrix-valued function be positive semidefinite. It covers robust control design, structural optimization, and nonconvex matrix problems such as low-rank approximation and nearest-correlation-matrix problems. Algorithms for it (sequential quadratic programming, augmented Lagrangian and semismooth Newton methods) converge fast locally only when the Karush–Kuhn–Tucker (KKT) point they approach is stable under perturbation, and the question is which checkable conditions guarantee that stability.
For classical nonlinear programming the answer has been known since the 1980s: at a local minimizer, Robinson's strong second order sufficient condition together with linear independence of the active gradients is equivalent to strong regularity of the KKT point (Robinson 1980; Jongen et al. 1987; Kojima 1980). D. Sun extended this equivalence to nonlinear semidefinite programs, where the constraint cone is not polyhedral and second-order analysis carries an extra curvature term.
Timeline.
1980: S. M. Robinson introduces strong regularity of generalized equations and shows that for nonlinear programs the strong second order sufficient condition plus linear independence of active gradients implies it (Math. Oper. Res. 5).
1997–2000: Shapiro, and Bonnans and Shapiro, develop second-order optimality conditions for cone-constrained problems, with the "sigma term" built from second order tangent sets and C²-cone reducibility (Bonnans–Shapiro 2000).
2002: Sun and Sun prove that the projector onto the positive semidefinite cone is strongly semismooth and compute its directional derivative.
2005–2006: D. Sun proves the equivalence theorem formalized here (preprint of May 15, 2005; journal version Math. Oper. Res. 31(4), 761–776).
Setting
X is a finite-dimensional real inner-product space, ℜm is Euclidean space, and Sp is the space of real symmetric p×p matrices with the Frobenius inner product⟨A,B⟩=Tr(ATB). S+p is the cone of positive semidefinite matrices. The problem is
(NLSDP)minf(x)s.t.h(x)=0,g(x)∈S+p,
with f:X→ℜ, h:X→ℜm, g:X→Sp twice continuously differentiable. Write G=(h,g) and K={0}×S+p. The Lagrangian is L(x,ζ,Γ)=f(x)+⟨ζ,h(x)⟩+⟨Γ,g(x)⟩, and the multiplier setM(x) consists of the (ζ,Γ) with JxL(x,ζ,Γ)=0, h(x)=0 and Γ in the normal cone NS+p(g(x)) (so Γ⪯0 and ⟨Γ,g(x)⟩=0). A triple (xˉ,ζˉ,Γˉ) with (ζˉ,Γˉ)∈M(xˉ) is a KKT point.
For a closed set D, TD(y)={d:∃tk↓0,dist(y+tkd,D)=o(tk)} is the tangent cone and lin(T) its lineality space. Robinson's constraint qualification at xˉ is JxG(xˉ)X+TK(G(xˉ))=ℜm×Sp; constraint nondegeneracy replaces TK by lin(TK). The critical cone is C(xˉ)={d:JxG(xˉ)d∈TK(G(xˉ)),Jxf(xˉ)d≤0}.
For B∈Sp with Moore–Penrose pseudo-inverse B†, set ΥB(Γ,A)=2⟨Γ,AB†A⟩. Let ΠS+p be the metric projector, A=g(xˉ)+Γ, and C(A;S+p)=TS+p(A+)∩(A+−A)⊥ with A+=ΠS+p(A). Then app(ζ,Γ)={d:Jxh(xˉ)d=0,Jxg(xˉ)d∈affC(A;S+p)} and C(xˉ)=⋂(ζ,Γ)∈M(xˉ)app(ζ,Γ). The strong second order sufficient condition (SSOSC) at xˉ is
The KKT map is F(x,ζ,Γ)=(∇xL(x,ζ,Γ),−h(x),−g(x)+ΠS+p(g(x)+Γ)) on Z=X×ℜm×Sp; its zeros are the KKT points. The KKT system is also the generalized equation0∈φ(z)+ND(z) with φ=(∇xL,−h,−g) and D=X×ℜm×S−p. A solution zˉ is strongly regular if, for all small δ, the linearized equation δ∈φ(zˉ)+Jφ(zˉ)(z−zˉ)+ND(z) has a unique solution near zˉ that depends Lipschitz-continuously on δ. Clarke's generalized Jacobian ∂F is the convex hull of the B-subdifferential∂BF, the set of limits of Jacobians at nearby differentiability points. Φ(δ)=F′(zˉ;δ) is the directional derivative. The uniform second order growth condition and strong stability quantify over all C2-smooth parameterizations (f(x,u),G(x,u)) of the problem.
Formalization targets
Goal: Theorem 21
At a local minimizer xˉ satisfying Robinson's CQ, with (ζˉ,Γˉ)∈M(xˉ), the following are equivalent:
(a) SSOSC at xˉ and constraint nondegeneracy;(b) every V∈∂F(xˉ,ζˉ,Γˉ) is nonsingular;(c) (xˉ,ζˉ,Γˉ) is strongly regular;(d) uniform second order growth and nondegeneracy;(e) strong stability and nondegeneracy;(f) F is a locally Lipschitz homeomorphism near (xˉ,ζˉ,Γˉ);(h) Φ is a globally Lipschitz homeomorphism;(j) every V∈∂Φ(0) is nonsingular.
Milestones
The matrix analysis of ΠS+p: Lemma 1 (a B-subdifferential chain rule), Lemma 2, Propositions 3 and 4 (the block structure of ∂BΠS+p and ∂ΠS+p), and Proposition 7 (the inequality ⟨ΔB,ΔΓ⟩≥−ΥB(Γ,ΔB)). Second-order theory: Proposition 8 (the strict CQ gives a unique multiplier and affC(xˉ)=app), Theorem 10 (the classical second-order conditions with the sigma term) and Lemma 11 (Υ equals the sigma term on C(xˉ)). The equivalences: Remark 15 (strong regularity iff a natural map is a Lipschitz homeomorphism), Proposition 16 ((a) ⇒ (b) ⇒ (c) at any KKT point), Lemma 18 (uniform growth ⇒ SSOSC) and Lemma 20 (∂BΦ(0)=∂BF(zˉ)).
Significance
The theorem identifies the SSOSC, a condition that can be checked from the problem data, with the stability notions that local algorithms need. Strong regularity is the hypothesis under which Newton-type methods for the KKT system converge locally and solutions vary Lipschitz-continuously with the data. Nonsingularity of ∂F gives quadratic convergence of semismooth Newton methods. Uniform growth and strong stability are what sensitivity analysis uses. Without the theorem, each of these properties has to be verified separately for semidefinite programs. The theorem also shows that the classical nonlinear programming equivalence survives on a non-polyhedral cone if the curvature term Υ is added.
The result is proved in the literature but has no machine-checked proof. Formalizing it requires the B-subdifferential and Clarke Jacobian of the PSD projector, second order tangent sets of S+p, and the Robinson–Kummer characterization of strong regularity. None of these exists in Mathlib. Items (g) and (i), which use the topological degree, are not formalized.
Difficulty
The obvious route is to copy the nonlinear programming proof: write strong regularity as nonsingularity of a reduced Jacobian on the active constraints. This fails because S+p is not polyhedral. The KKT map is only semismooth, and its generalized Jacobian at a non-strictly complementary point is a whole family of operators, parametrized by ∂ΠS+∣β∣(0). Nonsingularity has to be shown for every member of that family. The curvature of the cone appears only through Υ, which links the second-order condition to the Jacobian family. The converse directions combine several external theorems (Bonnans–Shapiro's stability theory, Clarke's inverse function theorem, Kummer's characterization), each needing nonsmooth infrastructure.
Formalization scope
All objects are defined in SunNLSDP.Equiv.Setting. Sp is the subspace of symmetric vectors in EuclideanSpace ℝ (n × n) for a finite index type n, so its inner product is exactly the Frobenius product. Y and Z are WithLp 2 products, carrying the sum of the inner products. B† is computed by the continuous functional calculus. The metric projector returns its argument when no minimiser exists; it is applied only to nonempty closed convex sets. Clarke's Jacobian, ∂B, the one-sided directional derivative, the normal cone and the lineality space are the published definitions NonsmoothNewton.Shared.clarkeJac, NonsmoothNewton.Local.dirDeriv and RobinsonSR.Reduction.Setting.
Conventions committed to:
The brace systems (41), (42), (49) are read as one coupled system: every (a,B) equals (Jxh(xˉ)d,Jxg(xˉ)d+T) for a single d. Read as two independent equations they would be strictly weaker.
"sup>0" is stated as "some multiplier gives a positive value". The non-strict supremum of Theorem 10 (44) and the support function are taken in the extended reals.
Local optimality is local minimality of f on the feasible set together with feasibility of xˉ.
"Nonsingular" means bijective.
Parameter spaces in Definitions 17 and 19 range over Banach spaces in the universe of X.
Lemma 2 and Remark 15 add nonemptiness of D.
Items (g) and (i) of Theorem 21 are omitted, because Brouwer degree is unavailable; no surrogate for the index is substituted. A formalization that reads the CQs or nondegeneracy as two decoupled equations, or states SSOSC only on C(xˉ) instead of C(xˉ), proves a different theorem and is ruled out.
Reusable infrastructure: the PSD projector and its generalized Jacobians, second order tangent sets, the Moore–Penrose pseudo-inverse of symmetric matrices, and the characterization of strong regularity by Lipschitz homeomorphisms. Proofs of individual milestones are welcome, as are lemmas on ΠS+p and on strong regularity of generalized equations.
Selected references
D. Sun, The strong second order sufficient condition and constraint nondegeneracy in nonlinear semidefinite programming and their implications, preprint dated May 15, 2005; Mathematics of Operations Research 31(4), 761–776, 2006. https://doi.org/10.1287/moor.1060.0195
S. M. Robinson, Strongly regular generalized equations, Mathematics of Operations Research 5(1), 43–62, 1980. https://doi.org/10.1287/moor.5.1.43
B. Kummer, Lipschitzian inverse functions, directional derivatives, and applications in C^{1,1} optimization, Journal of Optimization Theory and Applications 70, 559–580, 1991. https://doi.org/10.1007/BF00941302
On Augmented Lagrangian Methods with General Lower-Level Constraints II: Feasible Limit Points Satisfying CPLD Are KKT PointsResearch Paper
Motivation
Augmented Lagrangian methods are among the standard ways to solve smooth nonlinear programs. They replace a constrained problem by a sequence of subproblems in which some constraints are moved into the objective through a penalty term and multiplier estimates. The method of Andreani, Birgin, Martínez and Schuverdt (SIAM J. Optim. 18(4), 2007) is the theory behind the ALGENCAN solver. It moves only the "upper-level" constraints into the objective, keeps arbitrary "lower-level" constraints in the subproblems, and requires the subproblems to be solved only approximately.
A convergence theory for such a method has to say what the limit points of the iterates are. This mission is about the second half of that theory (Theorem 4.2): a limit point that is feasible is a KKT point of the original problem, provided it satisfies a weak constraint qualification, the constant positive linear dependence condition (CPLD) of Qi and Wei (SIAM J. Optim. 10(4), 2000). Earlier global convergence results for augmented Lagrangian methods, such as Conn, Gould and Toint's, assumed linear independence of the active gradients (LICQ) at all limit points. CPLD is implied by MFCQ and by LICQ, holds automatically for linear constraints, and is required only at feasible points.
Timeline of the relevant notions:
1967: Mangasarian and Fromovitz introduce MFCQ.
2000: Qi and Wei introduce CPLD for SQP methods.
2005: Andreani, Martínez and Schuverdt show that CPLD is a genuine constraint qualification.
2007: this paper proves Theorem 4.2 for augmented Lagrangian methods with general lower-level constraints.
Algorithm 3.1 works in outer iterations k=1,2,… with a penalty parameter ρk and safeguarded multipliers λˉk, μˉk that stay in fixed boxes. At iteration k it finds xk and lower-level multipliers vk, uk≥0 that satisfy the KKT conditions of "minimize L(⋅,λˉk,μˉk,ρk) on Ω2" up to a tolerance εk→0. It then computes the first-order estimates λk+1=λˉk+ρkh1(xk) and μk+1=max{0,μˉk+ρkg1(xk)}. Finally it increases ρk by a factor γ>1 unless a feasibility-complementarity measure has decreased by the factor τ<1.
A point x satisfies CPLD if, whenever some gradients of constraints active at x have a nontrivial vanishing linear combination with nonnegative coefficients on the inequalities, those gradients remain linearly dependent at every point of a neighbourhood of x.
Formalization targets
Goal: Theorem 4.2
If x∗∈Ω1∩Ω2 is a limit point of {xk} and satisfies CPLD with respect to all constraints of (2.1), then x∗ is a KKT point of (2.1). If moreover x∗ satisfies MFCQ and {xk}k∈K→x∗, then
{∥λk+1∥,∥μk+1∥,∥vk∥,∥uk∥}k∈Kis bounded.(4.8)
Milestones
(4.9). At every outer iteration, the gradient of the Lagrangian of (2.1) at xk with multipliers (λk+1,μk+1,vk,uk) has norm at most εk.
(4.10). Along a subsequence converging to x∗, the multipliers of inequality constraints that are inactive at x∗ eventually vanish.
(4.11)–(4.15). For a general C1 program: if yk→x∗, x∗ is feasible and satisfies CPLD, and the residuals ∇F(yk)+∑ak,i∇Hi(yk)+∑bk,j∇Gj(yk) tend to zero with bk≥0 supported on the constraints active at x∗, then x∗ is a KKT point.
(4.8) under MFCQ. In the same setting with MFCQ instead of CPLD, the coefficients ak, bk are bounded.
Significance
The theorem says that the algorithm has the right limit points: a feasible limit point is stationary under a constraint qualification weaker than MFCQ and LICQ, with no assumption on the penalty parameters. Milestone 3 is a result of independent interest: an "approximate KKT" sequence converges to a KKT point under CPLD. This sequential argument was later developed into the theory of approximate KKT conditions (Andreani, Haeser & Martínez 2011), and it applies to any algorithm that produces approximate KKT points, not only to this one. Milestone 4 gives the classical fact that MFCQ bounds the multipliers of such sequences.
All results are proved in the paper. As far as is known, none has a machine-checked proof. Neither CPLD nor the augmented Lagrangian method of this paper is formalized in Mathlib or on the platform. The companion missions of this series formalize Theorem 4.1 (feasibility of limit points) and Theorem 5.4 (boundedness of the penalty parameters).
Difficulty
The obvious argument divides the approximate KKT relation by the size of the multipliers, passes to the limit and obtains a contradiction with the constraint qualification. Under CPLD this argument fails, because CPLD does not bound the multipliers: they may diverge along the sequence even though the limit is a KKT point, and the limit of the normalized relation need not contradict anything at x∗ itself. CPLD speaks about linear dependence on a whole neighbourhood of x∗, while the relation holds only at the iterates, so the information has to be transferred from x∗ to nearby points. A pointwise version of CPLD (dependence at x∗ only) is plain positive linear dependence, and with it the statement is false.
A second difficulty is complementarity (milestone 2). The safeguarded multipliers μˉk do not vanish on inactive constraints. Whether μk+1 does depends on whether the penalty parameters are bounded, which needs the update rule of Step 4.
Formalization scope
Rn is EuclideanSpace ℝ (Fin n) and ∇ is Mathlib's gradient. The problem is a structure of component functions indexed by Fin m. The standing assumption "continuous first derivatives on a sufficiently large and open domain" is read as ContDiff ℝ 1 on all of Rn.
A run of Algorithm 3.1 is a predicate on sequences (IsRun), not a computed object:
x0 is the initial point and the outer iterations are k≥1;
every outer iteration succeeds, which is the paper's standing assumption of §4;
the three tolerances εk,1,εk,2,εk,3 of Step 2 are separate, as on the page;
∇L is the true gradient of the defined function (2.2);
(3.1) uses the Euclidean norm, and (3.4) and Step 4 use the sup norm. The paper's norm is arbitrary, and only εk→0 enters.
KKT, CPLD and MFCQ are defined once for an abstract program with finite index types. The constraints of (2.1) enter as the families h1⊕h2 and g1⊕g2:
the KKT definition includes feasibility, nonnegative inequality multipliers and complementarity;
CPLD quantifies over subsets of equality indices and of active inequality indices, and requires linear dependence on a neighbourhood;
gradient families are indexed by sum types, so repeated gradients count as dependent.
"Limit point" is MapClusterPt. (4.8) is required for every strictly increasing reindexing converging to x∗, and it bounds the unsafeguarded estimates λk+1, μk+1; the safeguarded ones are bounded by construction and would make (4.8) trivial.
Trivializing formalizations are ruled out:
a run is satisfiable (a sorry-free sanity check exhibits one, with a feasible CPLD limit point);
KKT fails for a nonzero linear objective, so it is not automatic;
the gradient is never applied to a function that is not differentiable under the hypotheses;
gradient families are never collapsed into sets;
the tolerances of Step 2 are not merged into εk.
Contributions welcome: proofs of the four milestones and of the goal, and in particular a reusable conic Carathéodory lemma and a library-level "approximate KKT + CPLD ⇒ KKT" theorem (milestone 3), which is useful well beyond this paper.
Selected references
R. Andreani, E. G. Birgin, J. M. Martínez, M. L. Schuverdt, On augmented Lagrangian methods with general lower-level constraints, SIAM J. Optim. 18(4):1286–1309, 2007. https://doi.org/10.1137/060654797 (HAL preprint hal-01295437v1 used here: https://hal.science/hal-01295437)
L. Qi, Z. Wei, On the constant positive linear dependence condition and its application to SQP methods, SIAM J. Optim. 10(4):963–981, 2000. https://doi.org/10.1137/S1052623497326629
R. Andreani, J. M. Martínez, M. L. Schuverdt, On the relation between constant positive linear dependence condition and quasinormality constraint qualification, J. Optim. Theory Appl. 125(2):473–485, 2005. https://doi.org/10.1007/s10957-004-1861-9
O. L. Mangasarian, S. Fromovitz, The Fritz John necessary optimality conditions in the presence of equality and inequality constraints, J. Math. Anal. Appl. 17:37–47, 1967. https://doi.org/10.1016/0022-247X(67)90163-1
R. Andreani, G. Haeser, J. M. Martínez, On sequential optimality conditions for smooth constrained optimization, Optimization 60(5):627–641, 2011. https://doi.org/10.1080/02331930903578700
D. P. Bertsekas, Nonlinear Programming, 2nd ed., Athena Scientific, 1999 (Carathéodory's theorem for cones, p. 689).