Introduction to Stochastic Programming VI: Jensen and Edmundson-Madansky BoundsTextbook
Motivation
Two-stage stochastic programs with recourse require evaluating , the expected value of a recourse function, at every candidate first-stage decision . When is high-dimensional or continuously distributed, this expectation is a multivariate integral of a piecewise-linear, generally nondifferentiable integrand, and classical quadrature rules — built for smooth integrands in low dimension — do not apply (Birge & Louveaux, §8.1). What does apply is convexity: is convex whenever the recourse problem is a linear program in , and convexity alone is enough to sandwich between two computable discrete approximations. This chapter develops that sandwich, and it is the standard device used throughout the stochastic-programming literature to bound and iteratively refine the recourse function: the lower bound goes back to Jensen [1906]; the upper bound is due to Edmundson [1956] and Madansky [1959], with the mean-consistent LP refinement due to Madansky [1960] and Gassmann & Ziemba [1986]. Refinements of both bounds appear in Huang, Ziemba & Ben-Tal [1977], Kall & Stoyan [1982] and Frauendorfer [1988].
Setting
Fix a probability space and an integrand , where is the (convex, closed) support of a random vector and is a real vector space (in the recourse application, and is the first-stage feasible region). Write .
A partition of into measurable blocks determines, for each block, its probability and its conditional mean . Equivalently — and this is the convention this mission's Lean development uses — the blocks may be taken directly on the sample space as the pulled-back sets , with and the Bochner integral average of over the block; the two descriptions coincide.
Formalization targets
Goal — Chapter 8, Theorem 1 (Jensen lower bound), p. 346
This is the sharpest statement the chapter proves for the lower bound: it holds for every finite measurable partition, with no assumption beyond convexity of and integrability.
Chapter 8, Theorem 2 (Edmundson-Madansky upper bound), pp. 347-348
For compact, let be the extreme points of , carrying the Borel field of all its subsets. If, for every , is a probability measure on with barycenter (i.e. ) and is measurable for every , then
Together the two targets give the chapter's headline sandwich: for convex , the finite-partition Jensen value and the Edmundson-Madansky value bracket the true expectation, and refining the partition (resp. the disintegration) tightens both sides toward it.
Significance
The Jensen bound is the workhorse of discrete-distribution approximation in stochastic
programming: it is what makes a valid, refinable
lower-approximation of the true recourse function, and it underlies the partition-refinement
schemes (§8.2, following Birge & Wets [1986] and Frauendorfer & Kall [1988]) used inside the
-shaped method and separable-programming solvers described later in the chapter (§8.3). The
Edmundson-Madansky bound is its indispensable upper counterpart: without it there is no
certificate of how far a lower approximation can be from the truth, and the mean-consistent LP
refinement (eq. 2.9, not part of this mission) reduces to a moment-problem computation over
. Both bounds are, to date, unformalized: the platform holds no theorem matching either a
finite-partition conditional-Jensen inequality or an extreme-point disintegration bound (searched
GET /theorems?q=... for "Jensen", "conditional expectation", "Edmundson Madansky", "partition
convex" — no relevant hits), so this mission is a first formalization of both, not a
reformulation of existing platform content. Mathlib supplies the raw convexity substrate this
mission is built from — finite Jensen (Analysis/Convex/Jensen.lean) and, critically, the
set-average integral Jensen inequality (ConvexOn.map_set_average_le in
Analysis/Convex/Integral.lean), exactly the per-block step the book's proof of Theorem 1
performs — but no existing lemma assembles these into the partitioned, conditional-mean statement
the book actually states.
Difficulty
The obvious shortcut is to prove "convex functions lie above their tangent line" and stop — this captures no partition structure at all and is not the theorem the book states (the theorem is about , a sum over blocks, not a single linearization). The real content is bookkeeping across the partition: writing as (an exact identity, no convexity needed), then applying ordinary Jensen inside each block to replace by from below — the inequality only enters at the second step, once per block. Proving this in Lean means correctly discharging, for every block, the side conditions Mathlib's integral-Jensen lemma needs (closedness of , continuity of on , integrability on the block) and then summing the per-block inequalities against weights that themselves depend on the partition — an easy step to get wrong by, e.g., letting be an arbitrary point of rather than exactly its conditional mean, which understates what Jensen actually forces. Theorem 2 additionally requires setting up the disintegration correctly: is a probability measure defined as an integral of the kernel-like family against , and both the barycenter condition on and the measurability of are load-bearing — dropping either makes ill-defined or the bound's proof inapplicable.
Formalization scope
for a complete real normed vector space (NormedAddCommGroup E,
NormedSpace ℝ E, CompleteSpace E); no finite-dimensionality is assumed since neither theorem's
proof needs it. The parameter ranges over an arbitrary type with ,
and is left as a bare function α → E → ℝ, matching the book's level of abstraction (the
recourse LP's own data is never used in either proof).
The partition is formalized directly on the sample space (a Partition structure:
pairwise-disjoint measurable blocks covering , each of positive measure) rather than on
, per the equivalence noted under Setting; is defined as the Bochner-integral
average , so it is forced to be the conditional mean and cannot be
weakened to an arbitrary sample point of the block — the change the chunk brief flags as the main
faithfulness trap for this chapter.
Two explicit hypotheses are added beyond the book's own statement of Theorem 1, both needed by
Mathlib's integral-Jensen lemma rather than narrowings of the mathematical content:
ContinuousOn (g x) Ξ (finite-dimensional convex functions are automatically continuous on the
interior of their domain, which is what the book implicitly relies on; stated explicitly since
is not assumed finite-dimensional) and integrability of and of
(needed for and each to be well-defined). For Theorem 2, the
disintegrating family is E → Measure Ext for an abstract type Ext (standing for
) with the discrete MeasurableSpace (every subset measurable, matching the
book's "Borel field ... the collection of all subsets"), mapped into by an embedding toE
whose range is exactly (convexHull ℝ Ξ).extremePoints ℝ; the measure (named μExt in
the Lean code, since λ is a reserved keyword) is a hypothesis satisfying its defining equation
(2.6) rather than constructed, since constructing a measure from a set function is a separate,
book-external piece of measure theory the chapter's own proof does not perform either — it simply
asserts is the probability measure with that value on every set.
A trivializing formalization is ruled out explicitly: a version that lets range over an arbitrary point of , or that proves only the ordinary (unconditional) Jensen inequality without ever introducing the partition, states something strictly weaker than the book and is not what is formalized here.
Both draft theorems end in := by sorry; a full Lean proof of Theorem 1 combines Mathlib's
ConvexOn.map_set_average_le applied per block with the exact decomposition of into
over the partition's disjoint, covering blocks. Reusable beyond this mission:
the Partition structure and its weight/condMean accessors generalize to any chapter needing
a finite measurable partition with conditional means (this book's later approximation schemes,
§8.2-8.5 and Chapter 10, all build on the same device). Contributions solving either theorem, or
formalizing the partition-refinement monotonicity (eq. 2.3, not part of this mission's milestone list since it is not itself a
numbered theorem) as a follow-up, are welcome.
Selected references
- J.R. Birge, F. Louveaux, Introduction to Stochastic Programming, 2nd ed., Springer Series in Operations Research and Financial Engineering, Springer, 2011. https://doi.org/10.1007/978-1-4614-0237-4
- J.L.W.V. Jensen, Sur les fonctions convexes et les inégalités entre les valeurs moyennes, Acta Mathematica 30 (1906), 175-193. https://doi.org/10.1007/BF02418571
- H.P. Edmundson, Bounds on the expectation of a convex function of a random variable, The RAND Corporation, Paper 982, 1956.
- A. Madansky, Bounds on the expectation of a convex function of a multivariate random variable, Annals of Mathematical Statistics 30 (1959), 743-746. https://doi.org/10.1214/aoms/1177706207
- A. Madansky, Inequalities for stochastic linear programming problems, Management Science 6 (1960), 197-204. https://doi.org/10.1287/mnsc.6.2.197
- H.I. Gassmann, W.T. Ziemba, A tight upper bound for the expectation of a convex function of a multivariate random variable, Mathematical Programming Study 27 (1986), 39-53. https://doi.org/10.1007/BFb0121114
- J.R. Birge, R.J-B. Wets, Designing approximation schemes for stochastic optimization problems, in particular for stochastic programs with recourse, Mathematical Programming Study 27 (1986), 54-102. https://doi.org/10.1007/BFb0121122