Motivation
Multi-stage stochastic optimization models a decision maker who acts at times 0,1,…,T−1 while a random scenario unfolds, and who may use at each time only the information revealed so far. This nonanticipativity constraint is what separates a genuine multi-stage problem from a collection of deterministic ones. A standard way of measuring its cost, the expected value of perfect information of decision analysis and stochastic programming (Birge & Louveaux 2011, Ch. 4), is to compare the decision maker's optimal value with that of a clairvoyant who sees the whole scenario before deciding.
Pflug and Römisch (Modeling, Measuring and Managing Risk, World Scientific 2007, §5.2) carry out this comparison not only at the root of a scenario tree but at every node, with the expectation replaced by a general acceptability functional A. This produces three stochastic processes on the tree: the optimality process, the clairvoyant process, and their difference, the value-of-information process. The book shows that, for functionals that behave linearly under mixing of distributions, the value of information is a supermartingale: the expected remaining value of perfect information decreases as the scenario is revealed, and vanishes at the horizon.
Setting
Let (Ω,F,P) be a probability space and T≥0. A tree process is a process (νt)t=0,…,T, νt taking values in a finite set Nt of nodes, with σ(νt)=σ(νs:s≤t) for every t: the current node determines the whole path that led to it. The root stage N0 consists of one node. The standard filtration is F=(F0,…,FT) with Ft=σ(νt), and the clairvoyant's filtration is FT=(FT,…,FT).
Scenario variables are ξt=ft(νt), t=1,…,T. A profit function H(x0,ξ1,x1,…,xT−1,ξT), written H(x,ξ), depends on a decision sequence x=(x0,…,xT−1) lying in a decision space X. A decision rule x is a random sequence; it is non-anticipative, x⊲F, if each xt is Ft-measurable, and clairvoyant, x⊲FT, if each xt is FT-measurable.
A version-independent probability functional R assigns a real number to each distribution in its domain D of distributions on R. For a Markov kernel K(⋅∣v) on R and a distribution G on R, the compound distribution is K∘G=∫K(⋅∣v)dG(v). R is compound linear, compound convex or compound concave if
R{K∘G} =, ≤, ≥ ∫R{K(⋅∣v)}dG(v)
respectively, for all K, G with K(⋅∣v)∈D for G-almost every v and K∘G∈D, for which the right-hand integral exists ("compound linear on D"; the book's Example 2.13 uses exactly this domain-relative form for expected utility).
Fix such a functional A (an acceptability functional; larger is better), whose domain contains the law of every feasible profit H(x,ξ) under the conditional probabilities below. For a node v of νt with P{νt=v}>0 let P{νt=v}=P(⋅∣νt=v) and let AP{νt=v}[Y] be A applied to the law of Y under it. The conditional problems are
At(v)=max{AP{νt=v}[H(x,ξ)]:x⊲F, x∈X},Ct(v)=max{AP{νt=v}[H(x,ξ)]:x⊲FT, x∈X}.
At the root these are the multi-stage problem A0 and the clairvoyant's problem C0. The optimality process is At=At(νt), the clairvoyant process Ct=Ct(νt), and the value-of-information process Dt=Ct−At.
Formalization targets
Goal: Corollary 5.3
If A is compound linear on its domain, then
Dt=Ct(νt)−At(νt),t=0,…,T,
is a supermartingale under P with respect to (Ft).
Milestones
- Proposition 2.12. For a sub-σ-algebra F1 and R(Y∣F1) the functional applied to the conditional distribution of Y given F1: compound linearity gives R(Y)=E[R(Y∣F1)], compound convexity ≤, compound concavity ≥.
- Lemma 5.1. If A is compound convex, (Ct) is a submartingale; if compound linear, a martingale.
- Lemma 5.2. If A is compound convex, (At) is a submartingale.
The goal is the weakest statement of the chain: it fixes no constants and asserts only the direction of drift of Dt.
Significance
D0=C0−A0 is the value of perfect information of the multi-stage problem, which the book interprets as a multi-period deviation-type risk functional (the multi-period average value-at-risk deviation of its Chapter 3 is an instance). The supermartingale property gives this risk a dynamic meaning: as the scenario is revealed, the remaining value of information decreases in conditional mean, and it is zero at the horizon. The two lemmas separate the effect of information into its two sources: the clairvoyant's value is a fair game for compound linear functionals, while the non-anticipative decision maker's value can only improve in conditional mean, because a decision fixed at time t remains feasible after more is revealed.
The results are proved in the book. No formal version is known: the platform has no item on value-of-information processes, clairvoyant problems or compounding properties of functionals; the closest related items are a complete-information bound in partially observed Markov decision processes and a submartingale property of stable multi-period risk processes, both in other settings. A formalization adds a precise setting (finite scenario trees, conditioning on nodes, attained maxima) in which the chain from Definition 2.11 to Corollary 5.3 is checked.
Difficulty
The supermartingale inequality is a statement about conditional expectations on a tree, while compound convexity is a statement about functionals of mixtures of distributions; the work is to identify the law of the profit under P{νt=v} as a compound distribution of the laws under the children's conditional probabilities, with the children encoded as a real mixing parameter. The book's proof of Lemma 5.1 interchanges the maximum and the functional, a step it justifies elsewhere only for monotone functionals, which Lemma 5.1 does not assume; its proof of Lemma 5.2 applies an inequality stated for nonrandom decisions to random ones. A solver should not rely on either step as printed. The martingale half of Lemma 5.1 needs the reverse inequality, for which the optimizers of the child problems must be combined into one feasible clairvoyant decision; the same combination is not available for non-anticipative decisions, which is why the optimality process is only a submartingale. Proposition 2.12 additionally needs regular conditional distributions.
Formalization scope
Lean 4 with Mathlib. Time is Fin (T + 1), stage 0 being the single root node ([Unique (N 0)]), so F0 is trivial. Node types are finite with measurable singletons; this is what makes P(⋅∣νt=v) meaningful at every node of positive probability (Mathlib's ProbabilityTheory.cond) and every process integrable. The filtration is a Mathlib Filtration assumed equal to σ(νt) at each stage, and sub-, super- and martingales are Mathlib's Submartingale, Supermartingale, Martingale. Decisions take values in a measurable space with measurable singletons, x∈X holds for every ω, and H is jointly measurable. The functional is 𝒜 : Measure ℝ → ℝ, version-independent by construction, evaluated only at probability measures; it is real-valued (the book allows R) with a domain 𝒟 : Set (Measure ℝ), and each compounding (in)equality is required only when the mixed and the mixing distributions lie in D and v↦R{K(⋅∣v)} is integrable. The tree theorems assume that D contains the law of every feasible profit under every conditional probability of a positive-probability node; Proposition 2.12 assumes Y∈domR and that the conditional distributions are in D almost surely. Mixing is over Markov kernels from R to R (K ∘ₘ G). Proposition 2.12 uses Mathlib's condExpKernel on a standard Borel space and assumes E[R(Y∣F1)] exists.
The maxima At(v), Ct(v) are not defined through sSup: the theorems take them as given numbers and assume each is the greatest element of its value set at every node of positive probability. This rules out the trivializing formalization in which a junk supremum of an empty or unbounded set makes the processes constant and the claim empty. The book's remark "in particular if A is the expectation" is covered as an instance and not stated separately: the expectation is compound linear on the distributions with a finite mean, and on a finite tree every feasible profit has finitely many values. Taking D to be all distributions instead would exclude the expectation, because Lean's Bochner integral of a non-integrable function is 0.
Needed infrastructure: finite partitions and conditional expectation on atoms, mixtures of conditional laws, measurable selection of child optimizers on a finite tree, and the disintegration property of condExpKernel. The definitions CompoundLinear/CompoundConvex/CompoundConcave, IsTreeProcess, and the decision-problem sets are reusable for other results of the book on conditional acceptability and multi-stage problems. Proofs of any milestone, and sorry-free instances showing the hypotheses are satisfiable (e.g. a bounded expected utility on a two-stage tree), are welcome.
Selected references
- G. Ch. Pflug, W. Römisch, Modeling, Measuring and Managing Risk, World Scientific, 2007, §2.1.2 and §5.2. https://doi.org/10.1142/6478
- J. R. Birge, F. Louveaux, Introduction to Stochastic Programming, 2nd ed., Springer, 2011 (value of perfect information and of the stochastic solution). https://doi.org/10.1007/978-1-4614-0237-4