Convex Polytopes V: Recognition from projections (GRU-M05-PROJECTION-RECOGNITION)Textbook
Recognizing a convex set from its projections
A convex set can be studied through its images in spaces of smaller dimension. Each image records part of the geometry, while losing the information along the directions that are collapsed. A finite convex hull always has finite convex hulls as its affine images. The converse asks whether sufficiently rich projection data can force the original set to have a finite description by points. This mission concerns the recognition theorem attributed to Klee in Grünbaum's Convex Polytopes, §5.1, Theorem 8, printed page 74.
The question concerns all projections into a suitable dimension, rather than an individual view of a set. A single image may conceal directions in which the original set has additional structure. The theorem identifies a condition on the entire family of images that characterizes polytopes among bounded convex sets.
Sets, convex hulls, and affine projections
Fix an integer d≥3. Real coordinate space Rd consists of vectors with d real coordinates. A set K⊆Rd is convex if it contains the line segment joining any two of its points. It is bounded if its points remain within some finite distance of the origin. Neither condition requires K to fill the ambient space.
The convex hull of a set V, written conv(V), is the smallest convex set containing V. A polytope is the convex hull of a finite set. The generating set need not be a minimal set of vertices. Grünbaum gives this characterization in §3.1, printed page 31. The empty generating set is permitted, as are generating sets contained in a proper affine subspace.
An affine map preserves affine combinations. A surjective affine map f:Rd→Rj has a j-dimensional target and reaches every point of that target. When j<d, such a map loses dimensions. This represents the singular affine images called projections in §5.1, printed page 71, with coordinates chosen on the target affine space. Translation of the target is allowed.
The recognition target
For every bounded convex set K⊆Rd, the goal is the equivalence
K is a polytope⟺∃j∈N,2≤j<d,∀f:Rd↠Rj affine,f(K) is a polytope.
The dimension j may depend on K, but it is chosen before testing the affine maps. Every surjective affine map with that target dimension is tested. For each such map, the finite set generating the image can be different. No common set of projected vertices or uniform bound on the number of generators is required.
This is one recognition theorem, containing both implications. The selected source grouping does not introduce separate supporting theorem targets.
What the criterion establishes
The theorem characterizes a global finite convex-hull property through lower-dimensional images. In particular, the conclusion concerns the original set itself; it does not merely assert that its closure has a finite generating set. This distinction matters because boundedness and convexity alone do not assert closedness.
The result is a known mathematical theorem in the source. The formalization target is its complete equivalence with the stated domain and quantifier order. A proof of only the preservation of polytopes under affine maps would leave the recognition implication unresolved.
Why the converse requires more than one image
Every tested image can have its own finite generating set. Finiteness of each image does not directly supply a finite generating set that works in the original ambient space. The recognition implication must connect the universal family of images to the geometry of the whole set. Replacing that family by a convenient fixed projection would change the question.
Mathematical conventions
Real d-space is represented by functions from Fin d to the real numbers. Boundedness and convexity use the ordinary Mathlib predicates, and being a polytope is expressed directly by existence of a finite set with the specified convex hull. No full-dimensional polytope structure is imposed on K.
The hypothesis d≥3 makes explicit the admissible ambient dimension needed for 2≤j<d. In dimension three, the only available target dimension is two. No assertion of the displayed existential criterion is made in dimensions zero, one, or two. Empty sets, singleton sets, and other lower-dimensional subsets remain within the domain in every admissible ambient dimension.
Affine maps are required to be surjective onto the selected coordinate space. Thus their rank is exactly the selected target dimension, rather than an accidentally smaller rank. Closedness, nonemptiness, rational coordinates, and a predetermined number of vertices are not additional hypotheses. The mathematical ingredients are real convex hulls, finite sets, bounded sets, and affine images.
Selected references
Branko Grünbaum, Convex Polytopes, second edition, Springer, 2003. Theorem 5.1.8, printed page 74 (source.pdf page 100); projection convention, printed page 71 (PDF97); polytope convention, printed page 31 (PDF51). The source pages are included in this package's evidence directory.
Lawson Criterion for Net Fusion EnergyResearch Paper
Motivation
A fusion reactor only makes sense if the plasma gives back more energy than it loses. In 1955 J. D. Lawson turned that sentence into an inequality: for a hot, thermalized fuel, the product of the particle density n and the energy confinement timeτE must exceed a temperature-dependent threshold before the fusion products alone can keep the plasma hot. The criterion was published in 1957 (Lawson, Some Criteria for a Power Producing Thermonuclear Reactor, Proc. Phys. Soc. B 70 (1957) 6–10) and has been the standard figure of merit for magnetic and inertial confinement ever since: machines are compared by their nτE and by the triple productnTτE.
Timeline, as far as this mission's material traces it:
1955 — Lawson derives the criterion in a classified AERE report, balancing the volumetric fusion rate against bremsstrahlung radiation losses and ignoring conduction losses.
1957 — the report is declassified and published.
2004 — the textbook derivation in the form used here, together with the reactivity fit ⟨σv⟩≈1.1⋅10−24T2m3/s valid near T=14 keV (J. Wesson, Tokamaks, 3rd ed., Oxford, 2004).
Consider a steady-state, fully ionized plasma of deuterium and tritium. All quantities are real numbers and strictly positive, and the temperature T is measured in energy units (electronvolts), so Boltzmann's constant does not appear: the article's kBT is our T.
n — the particle (electron) density. Under the standing assumptions of the derivation — all species at the same temperature, no ions other than fuel ions (no impurities, no helium ash), and deuterium and tritium in the optimal 50-50 mixture — the ion density equals the electron density and nd=nt=n/2.
W=3nT — the energy density of electrons and ions together, by the ideal gas law.
⟨σv⟩ — the fusion cross section times relative velocity, averaged over the Maxwellian velocity distribution at temperature T.
f=ndnt⟨σv⟩ — the volume rate of fusion reactions (reactions per volume per time), which for the 50-50 mixture equals 41n2⟨σv⟩.
Ech — the energy carried by the charged fusion products, the only part that can heat the plasma; Ech=3.5 MeV for D-T, the neutron's 14.1 MeV being lost.
Ploss — the power loss density, and τE=W/Ploss — the energy confinement time.
The plasma is self-heating when fusion heating exceeds the losses:
fEch≥Ploss.
Target
The goal theorem is the Lawson criterion itself — equation (1) of the source — obtained by substituting the model quantities into the self-heating condition:
nτE≥L≡Ech⟨σv⟩12T.
The milestones are the surrounding statements of the same derivation, in the order a reader meets them:
f=41n2⟨σv⟩,Ploss=τE3nT,41n2⟨σv⟩Ech≥τE3nT,
the triple-product form and its numerical D-T value,
the inertial-confinement form obtained from τE≈Rmi/T,
nR≥Ech⟨σv⟩mi12T3/2,
and the empirical tokamak scaling: if τE=cn1/3/P2/3 and P=an2T2, then nTτE=ca−2/3T−1/3, independent of the density.
Significance
The result itself. The criterion is what makes different confinement concepts comparable at all: it converts "does this machine work?" into a single number that can be measured and plotted, and its triple-product form is the quantity reported by tokamaks and by inertial-confinement shots alike. The last milestone explains why the triple product, rather than nτE, is the quantity of record for tokamaks: under the empirical energy-confinement scaling it does not depend on the density and depends on temperature only as T−1/3.
Formalizing it. Nothing here is an open problem: every statement is a known consequence of the stated model, and the mathematical content is algebra and monotonicity over the positive reals. What the mission produces is a machine-checked, reusable encoding of the energy-balance model of a D-T plasma, with every degenerate case (zero density, zero confinement time, vanishing reactivity) explicitly excluded, and with the chain from the model assumptions to each published form of the criterion verified end to end. The value is in the faithfulness of the model layer, not in the difficulty of the deductions.
Difficulty
The deductive content is elementary; the difficulty is representational. Three places where a careless encoding silently changes the theorem:
Division.τE=W/Ploss and 12T/(Ech⟨σv⟩) are total functions in Lean and return 0 on zero denominators. Without strict positivity of n, T, ⟨σv⟩, Ech, τE and Ploss, several of these statements become false or empty rather than merely degenerate.
Direction of the inequality. The self-heating hypothesis and the conclusion point the same way only because one multiplies by the positive quantity τE/(nEch⟨σv⟩); the factor 12=4⋅3 comes from the 41 of the 50-50 mixture and the 3 of W=3nT, and either one dropped leaves a statement that still compiles.
Fractional powers. The inertial-confinement and tokamak milestones involve T3/2, n1/3, P2/3; these are Real.rpow, whose rules require positive bases, which is why the positivity hypotheses appear again there.
Formalization scope
The model is a Lean structure LawsonCriterion.DTPlasma bundling n, T, ⟨σv⟩, Ech, τE, Ploss, all of type ℝ, with a strict-positivity field for each and one defining equation, tauE = energyDensity n T / Ploss where energyDensity n T = 3 * n * T. The 50-50 reaction rate is DTPlasma.rate, the heating rate is DTPlasma.fusionHeating = rate * Ech, and DTPlasma.SelfHeating is the proposition fusionHeating ≥ Ploss. Conventions this commits to:
temperature in energy units, so TiskBT; the numerical milestone additionally fixes keV for T and Ech, m³/s for sigmav, and so keV·s·m⁻³ for the triple product;
only the 50-50 D-T mixture and the charged-product energy enter; bremsstrahlung, conduction and impurities are not modelled separately — they are whatever Ploss is;
Real.rpow for the fractional exponents, Real.sqrt for the thermal speed.
The statements are not vacuous: the definition file also publishes a witness, LawsonCriterion.unitDTPlasma, so the structure is inhabited and every hypothesis set here is satisfiable. Conversely, no statement is trivially true — each is an inequality between quantities that genuinely vary with the plasma parameters.
Contributions welcome beyond the listed milestones: a version that separates radiation from conduction losses, the D-D and D-³He variants, and the statement that T↦T/⟨σv⟩ attains a minimum for a realistic reactivity model — the step where the source passes from the inequality to its "absolute lower limit", which this mission does not formalize.
Selected references
J. D. Lawson, Some Criteria for a Power Producing Thermonuclear Reactor, Proceedings of the Physical Society, Section B 70 (1957) 6–10. doi:10.1088/0370-1301/70/1/303
J. Wesson, Tokamaks, Oxford Engineering Science Series 48, 3rd ed., Clarendon Press, 2004.
H. Abu-Shawareb et al., Lawson Criterion for Ignition Exceeded in an Inertial Fusion Experiment, Physical Review Letters 129, 075001 (2022). doi:10.1103/PhysRevLett.129.075001
Lawson criterion, Wikipedia, revision 1367242125 — the source text this mission formalizes. link
Hubble's Law: The Kinematics of a Uniformly Expanding UniverseTextbook
Motivation
Hubble's law — officially the Hubble–Lemaître law — is the observation that galaxies
recede from us at a speed proportional to their distance, v=H0D. It is the first
observational basis for the expansion of the universe and one of the standard pieces of
evidence cited for the Big Bang model. Georges Lemaître derived the proportionality from
relativistic cosmology in 1927; Edwin Hubble published the observational relation in 1929,
building on Vesto Slipher's redshifts and Henrietta Swan Leavitt's Cepheid distance scale.
Alexander Friedmann had already shown in 1922 that the Einstein field equations admit
expanding solutions, with an expansion rate governed by what is now called the scale factor.
Behind the astronomy sits a piece of elementary mathematics that is rarely written out in
full: in a spatially homogeneous expansion, the linear velocity–distance relation is forced,
it holds with the same constant for every observer, and the Hubble "constant" is in fact a
function of time whose evolution is fixed by a single dimensionless parameter. This mission
formalizes that kinematic core: the statements are about the scale factor and its
derivatives, and involve no Einstein equations.
Setting
A scale factor is a function a:R→R of cosmic time t. A
comoving point is labelled by a fixed coordinate x∈R3 (with the
Euclidean norm), and its proper position at time t is
Xx(t)=a(t)x.
The proper distance between the comoving points x and y is
Dx,y(t)=∥a(t)x−a(t)y∥.
The Hubble parameter and the dimensionless deceleration parameter are
H(t)=a(t)a˙(t),q(t)=−a˙(t)2a¨(t)a(t).
H0 denotes the present-day value of H; the name "Hubble constant" refers to the fact
that H is constant in space at a fixed time, not in time.
Target
The goal theorem is the idealized Hubble law, stated in the source as a theorem of
Euclidean geometry: any two points moving away from the origin, each along a straight line
and with speed proportional to its distance from the origin, move away from each other with
a speed proportional to their distance apart. Formally, for H≥0, a time t and curves
p,q:R→R3 with
The relative velocity is parallel to the separation vector and its magnitude is H times
the separation, with the sameH for every pair — so no comoving observer occupies a
distinguished centre of the expansion.
The milestones supply the cosmological content that surrounds this geometric fact:
proper distances scale as D(t)=(a(t)/a(t0))D(t0);
a comoving point has velocity H(t) times its proper position vector;
Hubble's law itself, D˙(t)=H(t)D(t);
the evolution law H˙=−(1+q)H2;
the zero-deceleration case: if q≡0 then H(t)=1/t, with t the time since the
Big Bang, so the Hubble time 1/H is exactly the age;
a constant Hubble parameter forces exponential growth a(t)=a(t0)eH0(t−t0);
the small-redshift limit: with 1+z=a(t0)/a(te), the ratio
z/(t0−te) tends to H(t0) as te→t0, which is the
z≈H0D/c form of the law used observationally.
Significance
The result itself is elementary but load-bearing: it is what licenses reading a linear
redshift–distance diagram as evidence for uniform expansion rather than for a privileged
position in space, and items 4–6 are the statements through which cosmological observations
(the sign of q, the approach of q to −1 in ΛCDM) are turned into claims about
the past and future behaviour of H and a.
Formalizing it produces a small, reusable Lean layer for expansion kinematics: the scale
factor, the Hubble and deceleration parameters, proper position and proper distance, with the
differentiation lemmas that connect them. The platform already carries Friedmann-equation
missions that fix the dynamics of a; this mission is the kinematic complement, and its
Hubble parameter is the same function a˙/a that those developments use. Nothing here is
an open research problem: every statement is a known textbook fact, and the work is the
formalization.
Difficulty
The mathematical content is a few lines of calculus, so the difficulty is entirely in the
encoding. Three places are easy to get wrong. First, proper distance is defined through a
norm, so the identity ∥a(t)v∥=a(t)∥v∥ needs positivity of a, and
differentiating it needs positivity on a neighbourhood, not just at the point. Second, q is
defined by a quotient with a˙2 in the denominator: in Lean division by zero returns
zero, so a statement about q that forgets a˙(t)=0 silently changes meaning.
Third, milestone 5 propagates a hypothesis stated on (0,∞) down to the endpoint t=0,
where the Big Bang condition a(0)=0 lives; the continuity argument at the endpoint is the
only step with any technical content.
Formalization scope
Time is R and space is EuclideanSpace ℝ (Fin 3); derivatives are Mathlib's
deriv / HasDerivAt, so "velocity" is always a derivative at a point rather than a
difference quotient. Smoothness is assumed exactly where it is used: differentiability at a
single time for the first-order statements, ContDiff ℝ 2 for the statements involving
a¨. Positivity of the scale factor is stated explicitly wherever it is needed, as is
a˙(t)=0 in the statements mentioning q.
Degenerate readings are excluded: the goal's hypotheses are satisfiable (any pair of
comoving points in an expanding universe satisfies them, as milestone 2 shows), and the
milestones are non-vacuous for concrete scale factors such as a(t)=t and
a(t)=eH0t. The goal theorem's second clause is a norm identity that is true for
every H≥0; it carries the "speed proportional to distance" half of the source's
statement, while the first clause carries the "moving away from each other along the
separation" half.
The definition layer is a single self-contained file (scale factor derived quantities,
proper position, proper distance); it is reusable by any mission about expansion kinematics.
Contributions of the milestone proofs, and of variants such as the redshift relation
1+z=a(t0)/a(te) derived from null geodesics rather than assumed, are welcome.
Selected references
Wikipedia, "Hubble's law" (Hubble–Lemaître law), https://en.wikipedia.org/wiki/Hubble%27s_law
— the source text for this mission, in particular the sections "Recessional velocity",
"Time-dependence of Hubble parameter", "Idealized Hubble's law" and "Ultimate fate and age
of the universe".
E. Hubble, "A relation between distance and radial velocity among extra-galactic nebulae",
PNAS 15 (1929) 168–173, https://doi.org/10.1073/pnas.15.3.168.
G. Lemaître, "Un univers homogène de masse constante et de rayon croissant rendant compte
de la vitesse radiale des nébuleuses extra-galactiques", Annales de la Société
Scientifique de Bruxelles A47 (1927) 49–59.
Resource Allocation and Cross-Layer Control in Wireless Networks III: Lyapunov Optimization for Utility and FairnessTextbook
Motivation
Chapters 3-4 of Georgiadis, Neely & Tassiulas's survey Resource Allocation and Cross-Layer
Control in Wireless Networks (Foundations and Trends in Networking, 2006) answer "can the
network stay stable?" — the backpressure algorithm's throughput optimality (Theorem 4.5) says
yes, for any arrival rate inside the capacity region. But networks are usually operated with
plenty of unused capacity precisely so that they can also serve a second goal: maximizing some
concave utility (throughput, fairness, revenue) of the rates actually delivered. Answering "how
close to utility-optimal can a stable policy get, and at what congestion cost?" needs a single
theorem that treats stability and utility optimization in one drift analysis. Theorem 5.4, adapted
from Neely, Modiano & Li [108], Georgiadis, Neely & Tassiulas [115] and Neely [116], is that
theorem, and it is the technique — "Lyapunov optimization" or "drift-plus-penalty" — behind a
large fraction of the cross-layer control literature that followed this book.
Setting
A network of N queues has backlog vector U(t)=(U1(t),…,UN(t)), and a K-dimensional
control process R(t)=(R1(t),…,RK(t)) influencing the system's dynamics (e.g. admitted
data rates). For any nonnegative function L of the backlog vector, the one-step Lyapunov
drift is Δ(U(t)):=E{L(U(t+1))−L(U(t))∣U(t)}, the expected one-slot change
in L conditioned on the current backlog. Given any scalar-valued concave utility functiong of a K-dimensional rate vector and an arbitrary target valueg∗, the goal is to
stabilize U(t) while making the time-average utility of R(t) close to g∗. The time-average
rate vector is r(t):=t1∑τ=0t−1E{R(τ)} (5.18), and the achieved
long-run utility is gˉ:=limsupt→∞t1∑τ=0t−1E{g(R(τ))}.
This is the weakest, most general level — a drift-minus-utility condition, checked against an
arbitrary target g∗, with no reference to any specific control policy.
Significance
Theorem 5.4 is the abstract engine that every concrete utility-maximizing algorithm in the rest of
the chapter (the CLC1 joint flow-control/routing/scheduling algorithm of Theorem 5.1, and its
robustness variant under approximate scheduling, Corollary 5.2) instantiates by exhibiting a
control rule whose per-slot decision satisfies (5.19) for some V,ε,B — the drift
condition does the work of turning a per-slot optimization rule into a global performance
guarantee. Its [O(1/V),O(V)] tradeoff (utility gap shrinks like 1/V, congestion grows like V)
is the quantitative signature of every "Lyapunov optimization"/"drift-plus-penalty" algorithm in
the cross-layer control literature that followed this book, making Theorem 5.4 the single result
a reader needs to understand that entire family of algorithms at once, independent of which
specific control problem it is applied to.
Formalizing it. No result in this mission has a machine-checked proof anywhere; nothing
adjacent exists on the platform (searched for Lyapunov optimization, drift-plus-penalty, utility
fairness, concave utility — no hits at all, not even an adjacent object). This mission is the
first formalization of the book's utility-optimization engine.
Difficulty
The central subtlety, flagged explicitly by the book's own notation, is that (5.20) and (5.21)
compare two different kinds of quantity that are easy to conflate: gˉ is a limsup of an
expectation of utility, E{g(R(τ))}, while g(r(t)) in (5.21) is the utility
evaluated at the time-averaged expected rate. Jensen's inequality (using g's concavity) is
exactly what would relate g(E{R(t)}) to E{g(R(t))} — and it is not proved
or needed by this theorem's own statement, only by later results that connect the two more
tightly. A formalization that silently merges these into one "utility" quantity would be proving
something the book does not claim. The second trap is the target g∗: it is a free parameter of
the hypothesis, not the true optimal utility — the theorem's strength is exactly that it says
nothing special about how g∗ was chosen, so a formalization must not add a hidden side
condition forcing g∗ to equal a genuine optimum.
Formalization scope
∆(U(t)) is restated locally in this chunk's own sub-namespace (drafts cannot import chunk
04-backpressure's copy), via Mathlib's condExp on the σ-algebra generated by the current
backlog vector, exactly as in Chapter 4. Explicit Measurable/Integrable guards on U, R,
g∘R and every drift term prevent condExp/∫ from silently defaulting to 0 (a trivializing
formalization this mission rules out: without these guards, a non-integrable process would satisfy
the hypotheses vacuously and "prove" a stability/utility conclusion for a process that is not
actually controlled). r(t) and \bar g are written inline as their defining Cesàro averages
rather than as separate named definitions, since each is used exactly once. Out of scope for
this mission: Theorem 5.1 (the CLC1 algorithm's concrete instantiation), Corollary 5.2 (the
robustness-to-suboptimal-scheduling variant), and Lemma 5.5 (continuity of near-optimal solutions,
which needs the capacity region Λ as a hypothesis object). All three need substantially more
setup (a named algorithm, or the capacity-region machinery of Chapter 3) than this session's time
budget allowed without approximating either — left for a future mission rather than approximated.
Selected references
Georgiadis, Neely & Tassiulas, Resource Allocation and Cross-Layer Control in Wireless
Networks, Foundations and Trends in Networking, Vol. 1, No. 1 (2006), pp. 1-144.
https://doi.org/10.1561/1300000001
Neely, Modiano & Li, "Fairness and optimal stochastic control for heterogeneous networks",
IEEE/ACM Transactions on Networking, 16(2), 2008. https://doi.org/10.1109/TNET.2007.900405
Neely, "Energy optimal control for time-varying wireless networks", IEEE Transactions on
Information Theory, 52(7), 2006. https://doi.org/10.1109/TIT.2006.876219
Resource Allocation and Cross-Layer Control in Wireless Networks II: The Dynamic Backpressure AlgorithmTextbook
Motivation
Every stability result in Georgiadis, Neely & Tassiulas's survey Resource Allocation and
Cross-Layer Control in Wireless Networks (Foundations and Trends in Networking, 2006) — the
throughput optimality of the dynamic backpressure algorithm (Theorem 4.5), the utility-optimal
Lyapunov drift bound of Chapter 5, the energy-constrained control algorithm of Chapter 6 — is
proved the same way: exhibit a drift condition on a quadratic Lyapunov function of the queue
backlog vector, then invoke one fixed abstract lemma to conclude stability and an explicit
congestion bound. That fixed lemma, Lyapunov drift stability (Lemma 4.1, adapted from Kingman
[67], Loynes [87] and Neely, Modiano & Li [110]), is the engine this mission formalizes — the
single result the rest of the book's algorithm-specific theorems are instances of.
Setting
A network of L queues has backlog vector process U(t)=(U1(t),…,UL(t)) on slots
t=0,1,2,…, on a common probability space (Ω,P). The quadratic Lyapunov function
is L(U(t)):=∑i=1LUi(t)2. A single queue's backlog sequence
U:N→R (read as E{U(t)}) is strongly stable if
limsupt→∞t1∑τ=0t−1E{U(τ)}<∞; a network is strongly
stable if every one of its L queues is. The conditional drift of L given the current
backlog vector, E{L(U(t+1))−L(U(t))∣U(t)}, measures how the aggregate squared
backlog is expected to change over one slot, conditioned on where the network currently is —
formalized via Mathlib's conditional expectation on the σ-algebra generated by U(t).
Formalization targets
Goal — Lemma 4.1 (Lyapunov Stability)
if ∃B>0,ε>0,∀t,E{L(U(t+1))−L(U(t))∣U(t)}≤B−εi=1∑LUi(t),then the network is strongly stable and t→∞limsupt1τ=0∑t−1i=1∑LE{Ui(τ)}≤B/ε.
This is the weakest, most general level: a bounded-outside-a-compact-region drift condition
implies both a qualitative stability conclusion and a quantitative congestion bound, with no
mention of any particular algorithm, arrival distribution, or network topology.
Milestones
Lemma 4.3 (elementary inequality): V≤max[U−μ,0]+A⇒V2≤U2+μ2+A2−2U(μ−A) for nonnegative reals — the per-slot squared-backlog bound the
standard proof of Lemma 4.1 instantiates on the queueing recursion.
Lemma 4.2 (T-slot Lyapunov drift): the same conclusion as the goal, with the drift measured
over a block of T slots rather than one — needed whenever a single slot's expected drift can
be positive, and the tool the book itself uses (§4.4.1) to re-derive Chapter 3's single-queue
admissibility-based stability condition (Lemma 3.6) as a worked demonstration of the method.
Significance
Lyapunov drift stability is the one lemma every later result in this book's method reduces to:
Chapter 4's own Theorem 4.5 (backpressure throughput optimality) applies it directly to the
dynamic backpressure algorithm's per-slot optimality property; the book explicitly notes ("This
drift inequality is in the exact form for application of the Lyapunov drift lemma... proving the
result", p. 57) that once a drift bound of this shape is established, the stability conclusion is
free. The T-slot version (Lemma 4.2) extends the reach of the method to settings — Markov-modulated
channels, non-i.i.d. arrivals — where no single slot need have negative drift.
Formalizing it. No result in this mission has a machine-checked proof anywhere; nothing
adjacent exists on the platform (searched for Lyapunov drift, max-weight, differential backlog,
backpressure — the one Lyapunov-drift hit, a Foster-Lyapunov hitting-time bound for a finite-state
MDP with an absorbing target state, is a different mathematical object from a vector queue backlog
with no absorbing state, and is not reused). This mission is the first formalization of the
book's stability engine.
Difficulty
The obvious first idea is to bound E{Ui(t)} directly via the one-step queueing
recursion and telescope. This fails for the same reason it fails in Chapter 3: expectation does
not commute with max(⋅,0). Lemma 4.1's actual content is a genuine Foster–Lyapunov drift
argument on the aggregate quadratic quantity L(U(t)), not a per-queue linear one — the
quadratic form is what turns a one-sided drift condition into a bound on ∑iUi(t) itself
(via the elementary inequality of Lemma 4.3, which converts the linear queueing recursion into a
quadratic one that the drift condition directly controls). A second trap is conditioning: the
drift bound is conditioned on the current backlog vectorU(t), not on the full history — a
weaker, memoryless form of conditioning that is exactly what makes the lemma apply uniformly to
i.i.d., Markov-modulated, and adversarial channel processes alike, provided the algorithm itself
is memoryless in the state.
Formalization scope
The Lyapunov-drift hypothesis conditions on the σ-algebra generated by the current backlog vector,
MeasurableSpace.comap (U t) inferInstance, via Mathlib's condExp; explicit Measurable/
Integrable guards on U t and on the drift term prevent condExp/∫ from silently defaulting
to 0 for a non-measurable or non-integrable process (a trivializing formalization this mission
rules out: without those guards, an arbitrary non-integrable backlog process would satisfy the
drift hypothesis vacuously and "prove" the theorem for a process that manifestly is not stable).
The limsup ≤ B/ε conclusion is stated as ∀ t, (Cesàro average at t) ≤ B/ε rather than via
Mathlib's Filter.limsup, matching the standard telescoping proof (which bounds the average for
every t, not merely eventually) and avoiding Filter.limsup's junk value on an unbounded
sequence in the non-complete lattice ℝ. Out of scope for this mission: the algorithm-specific
Theorem 4.5 (dynamic backpressure throughput optimality) and Lemma 4.4 (the single-queue corollary
via admissible processes) — the former needs the book's named algorithm plus Chapter 3's capacity
region restated as a local hypothesis and the explicit constant B of Eq. (4.12); the latter needs
this chunk's own restatement of Chapter 3's admissibility structures. Both are left for a future
mission with a larger time budget rather than approximated.
Selected references
Georgiadis, Neely & Tassiulas, Resource Allocation and Cross-Layer Control in Wireless
Networks, Foundations and Trends in Networking, Vol. 1, No. 1 (2006), pp. 1-144.
https://doi.org/10.1561/1300000001
Neely, Modiano & Li, "Fairness and optimal stochastic control for heterogeneous networks",
IEEE/ACM Transactions on Networking, 16(2), 2008. https://doi.org/10.1109/TNET.2007.900405
Loynes, "The stability of a queue with non-independent inter-arrival and service times",
Mathematical Proceedings of the Cambridge Philosophical Society, 58(3), 1962.
https://doi.org/10.1017/S0305004100036781
The Design of Competitive Online Algorithms via a Primal-Dual Approach VIII: The Bounded Allocation ProblemTextbook
Motivation
The classical online allocation (AdWords) problem has a tight 1 - 1/e competitive ratio in
general, achieved by the water-level algorithm and matched by a lower bound in which the number
of buyers interested in each item can be as large as the total number of buyers. Buchbinder and
Naor's Chapter 13 observes that in many realistic settings each item's interested-buyer set is
much smaller than the total buyer population, and shows this structural fact — an explicit bound
d on interested buyers per item — provably beats 1 - 1/e for every finite d, via a
deliberately non-water-level algorithm. This mission formalizes that algorithm's competitive
ratio and its matching lower bound.
Setting
A seller offers items to n buyers one at a time; buyer i has budget B(i) > 0. Each item j
has a fixed price b(j) > 0 and a set S(j) of interested buyers with |S(j)| ≤ d. The
fractional LP relaxation (Fig. 13.1) allocates y(i,j) ∈ [0,1] of item j to buyer i, subject
to each item being sold at most once in total and each buyer's spending never exceeding budget;
the seller's objective is to maximize total revenue ∑_j ∑_{i∈S(j)} b(j)y(i,j). Buyers are
partitioned into d+1levels by the fraction of budget spent so far (level k = spent between
k/d and (k+1)/d); on each new item, the allocation algorithm splits it equally among the
interested buyers in the lowest non-empty level, moving to the next level once that level's
buyers are exhausted or saturated — deliberately not the naive "water-level" rule of splitting
among the least-spent buyers, which the book shows cannot beat 1-1/e even for small d. The
analysis tracks a piecewise-linear trade-off potential functionf_d, built from a geometric
sequence, that relates each buyer's level to their contribution to a feasible primal (covering)
solution.
Formalization targets
Theorem 13.1 (the goal, p. 240): the allocation algorithm is C(d)-competitive, with the
book's own explicit closed form C(d) = 1 - (d-1)/(d(1+1/(d-1))^{d-1}) — strictly better than
1 - 1/e for every finite d, approaching it as d → ∞ (Table 13.1). Formalized via the
survey's standard weak-duality pattern (as in 04-framework's Theorem 4.3): given the algorithm's
per-item primal/dual cost changes satisfying the book's core inequality
ΔX(j) ≤ (1/C(d))ΔY(j) (established there by a potential-function case analysis, not reproduced
here), the algorithm's realized profit is C(d)-competitive against any feasible comparison
allocation.
Lemma 13.2 (milestone, p. 244): a matching lower bound,
C(d) ≤ 1 - (k - kH(d) + ∑_{i=1}^k H(d-i))/d, where H is the harmonic number and k is the
largest value with H(d) - H(d-k) ≤ 1.
Significance
This chapter is the survey's demonstration that a structural restriction invisible to the
classical 1-1/e lower bound — a bound on demand concentration, not on budgets or prices — can be
exploited algorithmically, and the exploiting algorithm is not the naive generalization of the
water-level rule but a genuinely different level-based, "who's-behind" allocation rule. No formal
development of the bounded allocation problem was found on the platform as of 2026-09-20; this
mission is the first.
Difficulty
The chapter's own proof of Theorem 13.1 (p. 241-244) is a page-and-a-half case analysis on how an
item's fractional allocation crosses level boundaries, bookkeeping the change in both the primal
potential-function value and the dual profit through several sub-cases (an item fully absorbed by
one level; an item that empties a level and continues into the next; a level exhausting every
interested buyer's budget). This mission formalizes the resulting per-item inequality
ΔX(j) ≤ (1/C(d))ΔY(j) as a hypothesis (the theorem's own headline claim, not a case-by-case
re-derivation) rather than modeling the stateful, order-dependent level-allocation process itself
— the same scope choice this series makes for Chapter 11's randomized rounding process, where the
book similarly omits (there, entirely; here, gives but does not ask this mission to reproduce) the
underlying case analysis. The potential function f_d and its connection to the algorithm's
primal variable (allocX) are formalized precisely, since they are what the goal's proof and
Lemma 13.2 both depend on structurally, even though the case analysis linking them to ΔX/ΔY
is left as the theorem's sorry.
Formalization scope
AllocationInstance I J bundles the LP data of Fig. 13.1 (S, B, b, d ≥ 2,
∀j, |S(j)|≤d) — restated locally per this series' rule that concurrent drafts cannot import each
other, even though the problem is a special case of Chapter 10's ad-auctions model (the two
chapters' algorithms differ: Chapter 10's is proportional-to-remaining-budget, this chapter's is
level-based). geomSeq/potential transcribe the geometric sequence a_t and the potential
function f_d at its level grid points exactly (not extended to non-grid-point reals, since
Theorem 13.1's and Lemma 13.2's own statements only need the grid values). allocX connects the
potential function to the algorithm's primal variable via each buyer's final level t(i).
packingFeasible/packingValue transcribe Fig. 13.1's dual/packing LP with a genuine two-index
allocation y : I → J → ℝ (not collapsed to a single per-item variable, unlike Chapter 4's
simpler 0/1-coefficient framework). harmonicNum is the ordinary harmonic number. The level-based
algorithm's literal stateful per-item update rule (which buyers move between which levels, in
what order, within a single item's allocation) is not modeled directly — a documented scope
reduction (STATUS.md), not a substitution of the "water-level" algorithm the book explicitly
warns against (this mission's theorem13_1 commits to neither algorithm's literal rule, only to
the resulting invariant the book's own proof establishes for the level-based one). Welcome
contributions: completing the two sorrys, and modeling the level-allocation process explicitly
enough to derive hinvariant from first principles.
Selected references
N. Buchbinder, J. Naor. The Design of Competitive Online Algorithms via a Primal-Dual
Approach. Foundations and Trends in Theoretical Computer Science, 3(2-3):93-263, 2009.
https://doi.org/10.1561/0400000024
B. Kalyanasundaram, K. Pruhs. An optimal deterministic algorithm for online b-matching.
Theoretical Computer Science, 233(1-2):319-325, 2000 (cited as [73], the 1-1/e lower bound).
The Design of Competitive Online Algorithms via a Primal-Dual Approach VI: Maximizing Ad-Auctions RevenueTextbook
Motivation
Search-engine ad-auctions sell items (ad slots) to buyers who arrive with per-item bids and a
fixed daily budget, online: each item must be allocated the moment it appears, with no ability to
revisit past allocations, and no buyer may ever be charged more than its budget. Buchbinder and
Naor's survey [1] models this as a generalization of online bipartite matching and derives an
allocation algorithm through the same online primal-dual recipe formalized elsewhere in this
series (Chapter 4's framework), applied to a genuinely different LP shape — a maximization
(revenue) problem whose "packing" role and "covering" role are the reverse of Chapters 4, 5 and 7 —
and to a different constraint structure (budget caps on a per-buyer accumulated sum, not a
per-constraint 0/1 covering requirement). This mission covers Section 10.1, "The Basic Algorithm":
the single-slot allocation algorithm and its (1−1/c)(1−Rmax)-competitive analysis (Theorem
10.1). Sections 10.2-10.3 (multiple ad-slots via strong duality; stochastic per-buyer spending
guarantees) are out of scope — see Formalization scope.
Setting
Fix a finite set I of buyers, each with budget Bi>0, and a finite set M of items; buyer
i bids bij≥0 for item j, revealed one item at a time in the order enumerated by M.
Let Rmax:=maxi,jbij/Bi, carried as an explicit positive parameter. The Allocation
algorithm (p. 212), upon each item j's arrival, allocates it to the buyer i maximizing
bij(1−xi) (where xi∈[0,1] is buyer i's current primal value); if xi≥1 already,
nothing happens (the buyer is "full"). Otherwise it charges buyer i the minimum of bij and
its remaining budget, sets the dual allocation variable yij←1, sets
zj←bij(1−xi), and updates
xi←xi(1+bij/Bi)+bij/((c−1)Bi) for a constant c fixed by the analysis.
The revenue actually collected from buyer i is min(∑jbijyij,Bi) — the
buyer is never charged more than its budget. Unlike Chapters 4/7, this LP's dual (the ad-auctions
revenue objective, Fig. 10.1) is the maximization problem being solved online; the "primal"
covering LP (xi, zj variables) exists only as a duality certificate.
Formalization targets
Theorem 10.1 (the goal, p. 212), given the milestone's dual near-feasibility bound and the
fact that each buyer's total accrued bids exceed its budget by at most a factor of Rmax
(Claim (3)'s consequence):
∀(x′′,z′′) feasible for Fig. 10.1’s covering LP,∑iactualCharge(i)≥(1−c1)(1−Rmax)(∑iBixi′′+∑jzj′′),
with c=(1+Rmax)1/Rmax taken verbatim from the theorem's own statement — the exact
formula, not an O(⋅) instantiation. Inequality (10.1) (p. 213), the milestone, is the
book's own induction-proved lower bound on a buyer's primal value in terms of its accrued bids:
xi≥c−11(c(∑jbijyij)/Bi−1).
Significance
Theorem 10.1 is the entry point to a short but influential sub-line of the online primal-dual
method — Section 10.2 extends it to multiple ad-slots via strong duality for maximum-weight
matching (rather than the weak duality this framework otherwise relies on throughout), and Section
10.3 incorporates stochastic per-buyer spending guarantees, both reusing this section's constant
c=(1+Rmax)1/Rmax and its limit c→e as Rmax→0 (recovering the classic
(1−1/e)-competitive ratio for the unweighted, unbudgeted case). It is also the first mission in
this series to apply the online primal-dual method to a genuine revenue-maximization problem
rather than a covering/packing pair with matching roles. No formal development of ad-auctions,
budgeted online matching, or this constant was found on the platform as of 2026-09-20 (searches
below); this mission is the first.
Difficulty
As with 04-framework's Algorithm 3 and 07-generalized-caching's Fractional Caching algorithm,
the central obstacle is characterizing an online process by its own final output. Unlike those
two chapters, however, step (3)'s update increment varies per allocation (bd, the specific bid
of the item just won), so no closed-form solution of the recurrence exists in general; buyerX is
instead defined as an explicit List.foldl realizing the exact per-step update, over the
(temporally ordered) list of bids a buyer actually won — a faithful, if less immediately readable,
transcription of "the algorithm's output as a function of its own trajectory," in the same spirit
as this series' other closed-form definitions. A second difficulty specific to this chapter: the
book's derivation of inequality (10.1) is itself an induction on iterations (not a single algebraic
step, unlike Eq. (7.2) in 07-generalized-caching), and the theorem's final bound further combines
it with a separate "at most one undercharged iteration" argument (Claim (3)'s conclusion,
p. 214-215) turning the raw accrued-bid bound into one about the actually collected (budget-capped)
revenue — both are stated here as explicit hypotheses (the milestone, and
h_at_most_one_undercharge) rather than derived, since the goal is a faithful statement, not a
proof; both sorrys are documented, not silently discharged.
Formalization scope
AdAuctionsInstance I M bundles b : I → M → ℝ, B : I → ℝ (hB_pos), and Rmax : ℝ with
hRmax_pos : 0 < Rmax and hRmax_bound : ∀ i j, b i j ≤ Rmax * B i — the last two as explicit
hypotheses, never derived via Finset.sup, matching 04-framework's d and
07-generalized-caching's k. cParam inst := (1+Rmax)^(1/Rmax) uses Real.rpow (ℝ^ℝ).
buyerX inst i bids folds step (3)'s update over a list of won bids; revenue/actualCharge
realize ∑jbijyij and its budget-capped charge. Reals throughout. Explicitly out of
scope: Section 10.2's multiple-slot generalization (Theorem 10.2), which requires strong duality
for maximum-weight bipartite matching as an explicit premise (the book: "our analysis... crucially
relies on strong duality") — a substantially different LP structure (an integral matching LP, not
this section's per-buyer budget LP) that this mission's AdAuctionsInstance does not model, and
whose applicability of PrimalDualOnline.LP.strong_duality_adapter (this book's own Theorem 2.2)
was not verified in the time available. Section 10.3's stochastic guarantee (Theorem 10.3) is
likewise out of scope, and its own BRIEF.md-flagged ambiguity (whether its scalar g is
minigi or another aggregate of the per-buyer vector gi) was not resolved. Both are natural
follow-on missions, not attempted here. Welcome contributions: completing the two sorrys, and the
Section 10.2-10.3 follow-on mission(s).
Selected references
N. Buchbinder, J. Naor. The Design of Competitive Online Algorithms via a Primal-Dual
Approach. Foundations and Trends in Theoretical Computer Science, 3(2-3):93-263, 2009.
https://doi.org/10.1561/0400000024
The Design of Competitive Online Algorithms via a Primal-Dual Approach IV: Generalized CachingTextbook
Motivation
Caching is a two-level memory-management problem — the fast level (cache) can hold only k
items, and the algorithm must decide, online, which item to evict whenever the current request
misses — that is normally analyzed through the competitive ratio of ad hoc marking or LRU-style
rules. Buchbinder and Naor's survey [1] instead recasts weighted caching (non-uniform fetching
costs) as an instance of the covering/packing linear program, and derives a fractional online
algorithm through the same primal-dual recipe formalized in this series' 04-framework mission
(Chapter 4), but for a genuinely different LP shape: the caching LP's right-hand side varies from
constraint to constraint, unlike Chapter 4's uniform b(j)=1. This mission covers Sections
7.1-7.2 of Chapter 7, "Generalized Caching": the fractional weighted-caching algorithm and its
2(1+lnk)-competitive analysis. Sections 7.3-7.4, which further generalize to non-uniform page
sizes (not just costs), are out of scope — a natural follow-on mission, not attempted here (see
Formalization scope).
Setting
Fix a finite set V of primal variables x(p,j) — one per page p and each of its eviction
intervals between its j-th and (j+1)-th request — with fetching cost c(p,j)=cp≥1
(the book's standing weighted-caching assumption), and a finite set Time of online
constraints, one per request time t, revealed in the order enumerated by Time. The
eviction-charged LP formulation (the book charges for evicting pages rather than fetching them,
an equivalent reformulation up to an additive constant independent of the request sequence)
constrains, at each time t: ∑v∈S(t)xv≥rhs(t), where S(t) is the set
of currently-active eviction variables for pages present until t (excluding the page just
requested) and rhs(t)=∣B(t)∣−k is the amount of cache space those pages must
collectively vacate. The Lagrangian dual has a variable y(t) per request time and a variable
z(p,j) per eviction interval, with dual constraint
(∑t∣v∈S(t)y(t))−zv≤cv. As in Chapter 4, primal variables may only
increase and the algorithm sees each constraint only upon its arrival.
The Fractional Caching algorithm (p. 153-154) sets each x(p,j) to jump from 0 to 1/k the
first time its dual constraint tightens, then increases continuously according to an exponential
function of the accumulated dual sum until it saturates at 1 (at which point z(p,j) begins
absorbing further dual increase at the same rate, freezing x(p,j)). This is a genuinely
different LP shape from Chapter 4's framework (non-uniform, time-varying right-hand side) reusing
the same complementary-slackness design pattern as that chapter's Algorithm 3.
Formalization targets
Theorem 7.1 (the goal, p. 154), given the algorithm's final dual values y≥0, z≥0
and primal feasibility:
i.e. the algorithm is 2(1+lnk)-competitive, with the constant taken verbatim from the book's
own theorem statement (no O(⋅) instantiation needed here, unlike most goals in this series).
The antecedent is itself Eq. (7.2) (p. 155), formalized as the milestone
dual_near_feasible: the algorithm's dual solution, scaled down by 1+lnk, is feasible — the
book's own intermediate step, derived from the fact that every cachingX value is capped at 1.
Significance
Chapter 7 is the first chapter in this survey to apply the online primal-dual method to an LP
whose right-hand side is not uniformly 1 (unlike Chapters 4 and 5), demonstrating the method's
reach beyond the "simplified" 0/1-coefficient covering LP that 04-framework formalizes. The
2(1+lnk) fractional guarantee is also the analytical core of the chapter's randomized rounding
result (Theorem 7.3, not part of this mission — see Formalization scope), which converts it into
an actual O(logk)-competitive randomized algorithm against an adaptive adversary, and of the
chapter's further generalization to non-uniform page sizes (Theorem 7.5, Sections 7.3-7.4). No
formal development of weighted or generalized caching was found on the platform as of 2026-09-20
(searches below); the existing KServer.* namespace formalizes a different, unweighted, uniform
k-server model and shares no substrate with this mission. This mission is the first.
Difficulty
As with 04-framework's Algorithm 3, the central obstacle is characterizing an online process
by its final output alone: cachingX is defined as the algorithm's own closed-form update rule
(threshold-then-exponential, capped once x(p,j)=1), evaluated at the run's final accumulated
dual values, rather than as an independently-constrained free variable — the latter would let
x and y be chosen to satisfy the conclusion's inequalities directly, trivializing the claim
that a specific online algorithm achieves this ratio. Establishing that the capped closed form
is faithful (not merely an invented convention) requires the same monotonicity argument
04-framework's alg3X uses, adapted to this chapter's extra z(p,j) term inside the exponent
(present here; absent from Chapter 4's Algorithm 3). The proof's own structure — splitting the
primal cost into a 0→1/k contribution (C1) bounded via complementary slackness and a
1/k→1 contribution (C2) bounded via a derivative/telescoping argument over the continuous
accumulation process (Eqs. (7.6)-(7.10), p. 155-157) — is, as in Chapter 4, a genuinely dynamic
fact about the trajectory, not encoded as a hypothesis; the mission states the theorem faithfully
and leaves the sorry for that argument, per this series' documented-simplification convention.
Formalization scope
CachingInstance V Time bundles S : Time → Finset V, rhs : Time → ℝ (unlike
04-framework's CoveringInstance, whose right-hand side is fixed at 1 throughout), c : V → ℝ with hc_pos : ∀v, 1 ≤ c v (the book's own literal cp ≥ 1, not a strengthening), and k : ℕ
with hk_pos : 0 < k. dualSum inst y v := ∑_{t \mid v \in S(t)} y_t, matching 04-framework's
pattern. cachingX inst y z v is a noncomputable def: 0 before activation, otherwise
min 1 ((1/k) exp((dualSum - z - c v)/c v)), so "the algorithm's output" is genuinely a function
of its dual trajectory. Reals throughout; Real.log for the book's natural log ln. Explicitly
out of scope: Section 7.3's rounding apparatus (Theorem 7.3, the map from fractional to
randomized-integral cache states) and Section 7.4's non-uniform-page-size generalization
(Theorem 7.5) — both are natural follow-on missions building on this one's CachingInstance and
cachingX, not attempted here per this chunk's own BRIEF.md, which flags Theorem 7.1 alone as
"a complete, self-contained mission goal" when the rounding apparatus proves too heavy for a
single pass. Welcome contributions: completing the two sorrys, and the Section 7.3-7.4 follow-on
mission.
Selected references
N. Buchbinder, J. Naor. The Design of Competitive Online Algorithms via a Primal-Dual
Approach. Foundations and Trends in Theoretical Computer Science, 3(2-3):93-263, 2009.
https://doi.org/10.1561/0400000024
Convex Polytopes X: Recognition from projectionsTextbook
Motivation
A convex set can be studied through its images in lower-dimensional spaces. Each image retains part of the geometry while discarding information along the directions that are collapsed. Finite convex hulls behave well under affine maps: the image of a convex hull of finitely many points is again the convex hull of finitely many points. The converse is subtler. It asks whether sufficiently comprehensive lower-dimensional image data forces the original bounded convex set itself to have a finite description by points.
This mission formalizes the projection-recognition criterion attributed to Klee in Branko Grünbaum's Convex Polytopes, second edition, §5.1, Theorem 5.1.8, printed page 74 (PDF page 100 of the supplied source). The criterion concerns every projection into one suitable intermediate dimension, not a chosen coordinate view. It therefore characterizes a global property of the original set by an entire family of dimension-reducing images.
Setting
Fix a natural number d≥3. Real coordinate space Rd is represented in Lean by functions from Fin d to the real numbers. A subset K⊆Rd is convex when it contains every line segment joining two of its points, and it is bounded when all of its points lie within some finite metric ball. Neither condition requires K to be nonempty, closed, or full-dimensional.
For a set V, its convex hullconv(V) is the smallest convex set containing V. In the convention used by Grünbaum in §3.1, printed page 31 (PDF page 51), a polytope is equivalently the convex hull of a finite set. The generating set need not be a minimal vertex set, and the formal statement permits the finite set to be empty or contained in a proper affine subspace.
An affine map preserves affine combinations. A surjective affine map
f:Rd⟶Rj
has image dimension exactly j. When j<d, it is singular. Grünbaum defines a projection at the opening of §5.1, printed page 71 (PDF page 97), as an image under a singular affine map. Using a surjective affine map to coordinate j-space represents a projection to a j-dimensional affine space followed by an affine choice of coordinates. Whether a set is a finite convex hull is unchanged by that coordinate identification.
Formalization target
For every bounded convex set K⊆Rd, the target is the equivalence
K is a polytope⟺∃j∈N,2≤j<d,∀f:Rd↠Rj affine,f(K) is a polytope.
The dimension j may depend on K, but it is selected before the universal quantifier over affine maps. Every surjective affine map with that target dimension is tested. For each map, the finite set whose convex hull is f(K) may be different; no common projected generator set and no uniform bound on its size is asserted. This is one theorem with both directions, so there are no separate milestone statements in the package.
Significance
The forward implication records the stability of finite convex hulls under affine images. The recognition implication is the substantive part: under boundedness and convexity, polytopality of every projection in one eligible intermediate dimension forces K itself to be a polytope. The conclusion concerns K rather than merely its closure and does not add a hidden closedness assumption.
The theorem is established mathematics in the cited textbook. The present artifact is a compiled formal statement, not a completed machine-checked proof: its theorem body is by sorry. Completing it would connect Mathlib's finite convex-hull and affine-map infrastructure to the classical projection-recognition argument while preserving the source's quantifier order and lower-dimensional boundary cases.
Difficulty
Each projected set may have its own unrelated finite generating set. Those separate witnesses do not directly assemble into a finite generating set in the original ambient space, because every projection has discarded a kernel direction. Checking one convenient projection is inadequate: that image can conceal structure occurring precisely in the collapsed directions. The challenge is therefore to use the universal family of projections at the selected dimension without replacing it by a fixed axis projection or adding compactness, full dimensionality, or nonempty interior.
Formalization scope
The Lean declaration is Grunbaum2003.polytope_iff_polytope_projections, in the book-wide namespace Grunbaum2003. It takes Bornology.IsBounded K and Convex ℝ K as the exact domain hypotheses. Polytopality is written directly as existence of a finite set with convex hull equal to the set; no stronger book-local full-dimensional polytope predicate is used. Projections are all surjective real affine maps from Fin d → ℝ to Fin j → ℝ.
The explicit premise 3≤d records the admissible ambient range required by 2≤j<d. In dimension three, the only possible target dimension is two. No displayed existential claim is made for dimensions zero, one, or two, where no such j exists. Within every admissible dimension, empty sets, singletons, and other lower-dimensional bounded convex sets remain in scope. Surjectivity prevents a map from having rank below j, and the strict inequality j<d ensures dimension loss. There are no expression-essential book-local definitions or supporting theorems; the only dependencies are Mathlib modules for convex hulls, boundedness, finite-dimensional coordinate spaces, and affine maps.
Selected references
Branko Grünbaum, Convex Polytopes, 2nd ed., Graduate Texts in Mathematics 221, Springer, 2003, §3.1 and §5.1, especially Theorem 5.1.8 on printed page 74. Springer book record and DOI.
Feynman Diagrams I: Wick's Theorem for Gaussian MomentsTextbook
Motivation
Perturbative quantum field theory computes correlation functions of a field by expanding
around a Gaussian (free) theory. Every term of that expansion is a Feynman diagram, and the
rule that turns a diagram into a number is Wick's theorem: the expectation of a product of
Gaussian field modes is the sum, over all ways of pairing the modes up, of the product of the
two-point functions of the pairs. The same identity is known in probability and statistics as the
Isserlis theorem (L. Isserlis, 1918) and is the standard tool for computing moments of
Gaussian vectors; in random-matrix theory the counting of pairings it produces is the origin of
the Catalan-number asymptotics of Wigner's semicircle law.
The uploaded source is the Wikipedia article Feynman diagram, which states Wick's theorem for
the free scalar field and then, in the section Higher Gaussian moments — completing Wick's
theorem, verifies the one-variable case by direct Gaussian integration. This mission formalizes
that content: the combinatorics of pairings, the one-dimensional Gaussian moment formulas, and
the multivariate identity itself.
Setting
Fix d,n∈N and work on Rd with coordinates x1,…,xd. Let μ
be a centered Gaussian measure on Rd: a Gaussian probability measure all of whose
coordinate means vanish, ∫xidμ(x)=0 for every i. Its covariance (in the
physics reading, the propagator) is
Gij=∫xixjdμ(x).
A pairing of the labels {0,1,…,2n−1} is a partition of these 2n labels into n
unordered pairs; equivalently, a permutation σ of the labels with σ∘σ=id and σ(i)=i for all i (a fixed-point-free involution). The set of
pairings is written Pn. For a weight Wab indexed by labels, the Wick sum is
Wick(W)=σ∈Pn∑i:i<σ(i)∏Wiσ(i),
the inner product ranging over the n pairs of σ, each counted once through its smaller
element.
In the article's field-theory notation the labels are momenta k1,…,k2n, the coordinates
are the field modes ϕ(kj), and the two-point function carries the momentum-conserving delta
function, ⟨ϕ(k)ϕ(k′)⟩=δ(k−k′)/k2. This mission works with the
finite-dimensional Gaussian vector rather than the field, so the delta functions are absorbed into
the covariance matrix G.
Formalization targets
Goal — Wick's theorem (Isserlis' theorem)
For a centered Gaussian measure μ on Rd and any labels k1,…,k2n∈{1,…,d},
No hypothesis is imposed on the covariance: it may be singular and the labels kj may repeat,
which is exactly the situation the article's "completing Wick's theorem" section addresses.
Supporting targets (milestones)
∫Re−ax2/2dx=2π/a for a>0.
∫Rx2ne−ax2/2dx=an(2n−1)!!2π/a for a>0.
∫x2ndN(0,v)=(2n−1)!!vn for a real Gaussian law of variance v≥0.
#Pn=(2n−1)!!.
Correlation functions of odd order vanish: ∫∏j=12n+1xkjdμ=0.
The four-point function: ⟨xk1xk2xk3xk4⟩ equals the sum of the
three products Gk1k2Gk3k4+Gk1k3Gk2k4+Gk1k4Gk2k3.
Targets 1–3 are the article's displayed Gaussian integrals, target 4 is its pairing count, targets
5–6 are the two explicit consequences it records for the field correlators.
Significance
Wick's theorem is the computational content of every Feynman-diagram expansion: once it is
available, a perturbative term is a finite sum over diagrams, and the symmetry factors of
diagrams are bookkeeping on the pairing set Pn. On the probabilistic side it gives all moments
of a Gaussian vector in closed form, which is the entry point to Gaussian chaos expansions,
Wiener–Itô integrals, and moment methods for random matrices.
Mathlib (revision 0df444a) has real Gaussian measures gaussianReal, the general class
IsGaussian of Gaussian measures on a topological vector space, the Gaussian integral
∫e−bx2=π/b, and the double factorial Nat.doubleFactorial, but no
higher-moment formula for Gaussian measures and no Isserlis/Wick statement. The mission therefore
produces new library-level content, not a re-derivation of existing formal results; the result
itself has been classical since 1918 (Isserlis) and 1950 (Wick).
Difficulty
The obvious route — expand the characteristic function exp(−21tTGt) and
differentiate 2n times at t=0 — requires differentiating under an integral sign 2n times
and identifying the resulting combinatorial sum with a sum over pairings; both steps are where
the formal work lies. Integrability is not automatic from the statement and has to be established
(Gaussian measures have moments of all orders, but the product ∏jxkj must be shown
integrable before any manipulation). The naive attempt to reduce to the independent case by
diagonalizing G meets a second difficulty: the change of variables must be tracked through the
pairing sum, and G may be singular, so no invertible whitening transform exists in general.
The one-variable case (milestone 3) is not a special case to be waved through either: it is the
statement the article singles out, because a naive "each mode pairs with a distinct partner"
argument fails when all labels coincide.
Formalization scope
The ambient space is EuclideanSpace ℝ (Fin d); measures are Mathlib Measures and Gaussianity
is the Mathlib class IsGaussian, which is defined by every continuous linear functional pushing
forward to a real Gaussian law. Centering is stated as an explicit hypothesis on the coordinate
means, so the measure is not assumed standard and the covariance is unconstrained (in particular
degenerate covariances, and repeated labels ki=kj, are included). Integrals are Bochner
integrals, which return 0 for non-integrable functions; the statements are nonetheless
non-vacuous because Gaussian measures integrate all polynomials.
Pairings are formalized as fixed-point-free involutions of Fin (2 * n) and the pair product
ranges over {i:i<σ(i)}, so each pair contributes once. The case n=0 is included:
the empty product is 1, the unique pairing of the empty label set is the identity, and both
sides of the goal equal 1. The double factorial is Mathlib's Nat.doubleFactorial, evaluated at
2 * n - 1 in truncated natural subtraction, so the n=0 value is 0!!=1.
Contributions welcome: the Gaussian moment lemmas (milestones 1–3) as standalone Mathlib-style
results, the pairing count (milestone 4) as pure combinatorics independent of the analysis, and
any reduction of the goal to the independent-coordinate case.
Selected references
L. Isserlis, On a formula for the product-moment coefficient of any order of a normal frequency distribution in any number of variables, Biometrika 12 (1918), 134–139. DOI: 10.1093/biomet/12.1-2.134
G. C. Wick, The evaluation of the collision matrix, Physical Review 80 (1950), 268–272. DOI: 10.1103/PhysRev.80.268
CODATA 2022: exactly known constants of the revised SI and the least-squares adjustmentResearch Paper
Motivation
Since the 2019 revision of the SI, seven constants of nature have fixed, exact numerical
values: the caesium hyperfine frequency ΔνCs, the speed of light c,
the Planck constant h, the elementary charge e, the Boltzmann constant k, the Avogadro
constant NA and the luminous efficacy Kcd. Every other constant is either
measured, and then carries an uncertainty, or is a closed-form expression in the seven, and
is then known exactly. The CODATA 2022 adjustment (Mohr, Newell, Taylor and Tiesinga,
Rev. Mod. Phys.97, 025002, 2025) is the authoritative statement of which constants fall
on which side of that line, and of the statistical procedure that produces the recommended
values of the measured ones.
The exactly known side of the line is pure mathematics: the tabulated value of the
Stefan-Boltzmann constant, of the radiation constants, of the molar gas constant and of the
Faraday constant are theorems about π, an integral, and rational arithmetic - not
measurements. The measured side rests on one statistical object, the weighted linear
least-squares fit of N=133 input data to M=79 adjusted constants, together with the
diagnostics (χ2, the Birge ratio, normalized residuals, expansion factors) the task
group uses to decide that the fit is acceptable. This mission formalizes both.
Setting
Write h, c, k, e, NA for the numerical values of the defining constants in
coherent SI units, and ℏ=h/2π. The spectral radiance of a blackbody at
thermodynamic temperature T, per unit frequency, is Planck's function
Bν(T,ν)=c22hν3ehν/kT−11,
and per unit wavelength
Bλ(T,λ)=λ52hc2ehc/(λkT)−11.
The derived constants named in Tables XXXII and XXXIII of the paper are
σ=(π2/60)k4/ℏ3c2 (Stefan-Boltzmann), c1=2πhc2 and c2=hc/k
(radiation constants), R=NAk (molar gas), F=NAe (Faraday), KJ=2e/h (Josephson)
and RK=h/e2 (von Klitzing).
For the adjustment, let A∈RN×M be the design matrix of the linearized
observational equations, z∈RN the input data and W∈RN×N
the weight matrix - the inverse of the covariance matrix of the data, symmetric and positive
definite. The fit minimizes
χ2(x)=(z−Ax)TW(z−Ax),x∈RM,
with ν=N−M degrees of freedom, Birge ratio RB=(χ2/ν)1/2 and normalized
residuals ri=(Xi−⟨Xi⟩)/u(Xi).
Formalization targets
Goal
∫0∞πBν(T,ν)dν=σT4(T>0),σ=60π2ℏ3c2k4.
The goal fixes no digits: it asserts that the constant appearing in the tabulated closed form
is exactly the one produced by integrating Planck's law over the spectrum and over a
Lambertian hemisphere. The numerical enclosure of σ is a separate, weaker milestone,
so that the goal survives any change of tabulated digits.
Supporting targets
∫0∞ex−1x3dx=15π4,σ=15h3c22π5k4,R=NAk,F=NAe,
together with the numerical enclosures of σ, of Wien's displacement constants
b=c2/x5 and b′=x3k/h (where x5, x3 solve x=5(1−e−x) and
x=3(1−e−x)), and the identity KJ2RK=4/h.
the equivalence of minimality with the normal equations, the closed form
x^=(ATWA)−1ATWz when ATWA is invertible, and the
behaviour of χ2, RB and ri under an expansion factorf applied to the
uncertainties.
Significance
The exact-constant statements are what makes the tabulated values checkable rather than
authoritative: a reader who accepts the SI definitions can, in principle, re-derive
R=8.31446261815324Jmol−1K−1 and
F=96485.3321233100184Cmol−1 by arithmetic, and
σ=5.670374419…×10−8Wm−2K−4 from Planck's law and
ζ(4). Formalizing them turns "in principle" into a machine-checked derivation from the
seven fixed numbers.
The least-squares statements make precise what the adjustment is, independently of the
133 data of this particular round: that the recommended values are the unique minimizer of a
quadratic form, that the normal equations characterize it, and that multiplying a group of
uncertainties by an expansion factor f - the device used in 2022 with f=1.7, 2.5 and
3.9 - rescales χ2 by f−2, the Birge ratio by f−1 and the residuals by
f−1, without moving the fitted values. None of these statements is new mathematics; none
of them, as far as the catalog shows, is currently available as a machine-checked statement
about the CODATA quantities.
Difficulty
Two hard points. First, ∫0∞x3/(ex−1)dx=π4/15: the obvious route
expands 1/(ex−1) as a geometric series and integrates term by term, which needs a dominated
convergence or monotone convergence argument plus the value ζ(4)=π4/90; interchanging
the sum and the integral is the step that must be justified, not assumed. The goal then needs
this together with a change of variables x=hν/kT on (0,∞) and an integrability
argument for the original integrand.
Second, the numerical enclosures. 5.670374419×10−8<σ requires certified
rational bounds on π5; the Wien constants require certified bounds on a transcendental
root, obtained from interval evaluation of e−x at rational points plus monotonicity of
x−n(1−e−x). Floating-point evaluation proves nothing here.
The least-squares milestones are routine linear algebra, with one subtlety: the decomposition
identity needs symmetry of W, and the characterization of minimizers needs positive
definiteness, so both hypotheses are carried explicitly.
Formalization scope
All physical quantities are plain real numbers: each constant is the numerical value of the
quantity in the coherent SI unit named in its docstring, and the code carries no units. The
defining constants are given by the exact decimal literals of Table XXXII, so they are exact
rationals; ℏ is defined as h/2π and is therefore irrational.
Planck's function is a total function of two real arguments. Outside the physical regime it
returns junk rather than failing - at T=0 the exponent is 0, the denominator
e0−1=0, and Lean's division returns 0 - so every statement about it carries
0<T and a positivity hypothesis on the spectral variable. The goal's integral is the
Bochner integral over (0,∞) with respect to Lebesgue measure; it is not trivially
true by non-integrability, since the integrand is integrable for T>0.
The adjustment is formalized over FinN and FinM with an arbitrary
design matrix A and an arbitrary weight matrix W, hypotheses on W (Hermitian, positive
definite) stated where they are used rather than baked into the definition; ν=N−M is an
integer, not a truncated natural number.
Contributions welcome: the ζ(4) integral and the interval-arithmetic enclosures are
reusable well beyond this mission, as are the least-squares statements.
Selected references
P. J. Mohr, D. B. Newell, B. N. Taylor, E. Tiesinga, CODATA recommended values of the
fundamental physical constants: 2022, Rev. Mod. Phys. 97, 025002 (2025).
https://doi.org/10.1103/RevModPhys.97.025002
Métodos Numéricos (Freitas) III: Sistemas Lineares e a Convergência de Gauss-SeidelTextbook
Motivation
Linear systems are the inner loop of scientific computing: discretized differential equations, least-squares fitting, network flow balances and equilibrium models all end in Ax=b. Direct elimination solves the system exactly in O(n3) operations, but for the large sparse systems produced by discretization the cost and the round-off growth make iterative methods preferable: start from an arbitrary vector and apply a cheap update until the residual is small. The question such a method raises is when the iteration converges, and to that the chapter gives a clean sufficient answer: diagonal dominance.
This mission is the third in a series formalizing the lecture notes Métodos Numéricos by Sergio Roberto de Freitas (UFMS, 2000). It covers the iterative part of Chapter 5, Solução de Sistemas Lineares.
Setting
Let A=(aij) be a real ntimesn matrix and binmathbbRn. Assume aiineq0 for all i.
The Jacobi method computes every coordinate of the new iterate from the old one:
Both are instances of an affine iterationx(k+1)=Bx(k)+d associated with an equivalent rewriting Ax=biffx=Bx+d.
The matrix A is diagonally dominant when each diagonal entry dominates its row:
∣aii∣>sumjneqi∣aij∣qquad(i=1,dots,n).
Target
The goal theorem is Proposição 5.10.1: if A is diagonally dominant and x^\\star solves Ax^\\star = b, then the Gauss-Seidel iterates converge to x^\\star from any starting vector.
The milestones are the general facts the source uses to get there: that the limit of a convergent affine iteration is a fixed point of it and hence a solution of the system (Proposição 5.5.1), that a contraction condition lVertBvrVertleclVertvrVert with c<1 forces convergence to the solution (Proposição 5.5.3), and that the Jacobi sweep has exactly the solutions of Ax=b as its fixed points (Proposição 5.5.2).
Significance
Diagonal dominance is the hypothesis a practitioner can check by inspection, and it is satisfied by the matrices that come from standard finite-difference stencils, from strictly diagonally dominant collocation systems and from many equilibrium models. The theorem says that for those systems Gauss-Seidel needs no spectral analysis and no preconditioner to be safe: convergence holds from any starting vector. The supporting milestones isolate the two halves of the argument — a fixed-point identification and a contraction estimate — in a form reusable for other splittings (Jacobi, SOR, block variants).
Mathlib has Banach's fixed point theorem and the theory of matrix norms, but not the Gauss-Seidel sweep, the notion of diagonal dominance as used here, or the convergence statement, which is what this mission adds.
Difficulty
Gauss-Seidel is not a plain affine map applied coordinatewise: within one sweep the coordinates are updated sequentially, so the new value of coordinate i depends on the new values of coordinates j<i. Formalizing the sweep therefore requires a recursion over the coordinate index before the recursion over the iteration counter, and the contraction estimate has to be propagated along that inner recursion. The classical proof compares \\max_i |x_i^{(k+1)} - x_i^\\star| with \\max_i |x_i^{(k)} - x_i^\\star| and needs, for each i, a bound that already uses the improved bounds for j<i; getting that induction right is the substance of the mission.
Formalization scope
Vectors are functions from a finite index type with n elements to mathbbR, and convergence is convergence in that finite product space (equivalently, coordinatewise). The Gauss-Seidel sweep is defined through an auxiliary partial sweep: after k inner steps the first k coordinates carry their new values and the remaining ones their old values, and the full sweep is the partial sweep after n steps. The Jacobi sweep is defined directly. Diagonal dominance is the strict inequality above, with the sum taken over the row with the diagonal index removed; for n=0 every statement is vacuous, and the goal theorem is then trivially true because the space has a single point. Division by the diagonal entry is total division, so the definitions make sense even when aii=0; diagonal dominance rules that out, because the right-hand side of the dominance inequality is nonnegative. The goal theorem assumes a solution x^\\star is given rather than asserting its existence, and it asserts convergence for every starting vector, generalizing the source's choice x(0)=0. The contraction milestone states the consistency of the norms as the hypothesis lVertBvrVertleclVertvrVert in the supremum norm rather than fixing a particular matrix norm.
Selected references
S. R. Freitas, Métodos Numéricos, Departamento de Computação e Estatística, Universidade Federal de Mato Grosso do Sul, 2000. Chapter 5, Solução de Sistemas Lineares, pp. 85–118. (Course notes supplied with this mission.)
Métodos Numéricos (Freitas) I: Zeros de Funções e Convergência do Método de NewtonTextbook
Motivation
Most equations that arise in applications cannot be solved in closed form: the age of the Moon from a radioactive-decay balance, the deflection of a clamped beam, the equilibrium of a catenary, all reduce to solving f(x)=0 for a function f with no algebraic inverse. A first course in numerical methods therefore opens with root finding: constructive procedures that produce a sequence of approximations x0,x1,x2,dots together with a theorem saying that the sequence converges to a root and how fast.
This mission is the first in a series formalizing the lecture notes Métodos Numéricos by Sergio Roberto de Freitas (Departamento de Computação e Estatística, UFMS, 2000). It covers Chapter 3, Zeros de Funções, whose capstone is the local convergence of Newton's method.
Setting
Let f:mathbbRtomathbbR and let barx be a zero of f, i.e. f(barx)=0. The chapter studies three constructions.
Bisection. Starting from an interval (a0,b0) with f(a0)<0<f(b0), put xk+1=(ak+bk)/2 and keep the half of (ak,bk) on whose endpoints f still changes sign. The width of the bracketing interval is halved at every step.
Linear iteration (MIL). Rewrite f(x)=0 as a fixed-point equation x=g(x) and iterate xn+1=g(xn) from an arbitrary x0.
Newton's method. Take the particular iteration function
obtained by truncating the Taylor expansion of f at xn after the linear term.
A sequence xntoalpha has order of convergencep when ∣en+1∣/∣en∣p tends to a finite constant, where en=xn−alpha; p=1 is linear and p=2 quadratic convergence.
Target
The goal theorem is the local convergence of Newton's method at a simple zero. If f is twice differentiable on an open interval (a,b) containing barx, its second derivative is continuous there, and f′ never vanishes on (a,b), then there is h>0 such that
x0in[barx−h,barx+h]impliesxntobarx,
where xn is the Newton sequence started at x0. This is the formal content of the chapter's statement that Newton's method converges provided the initial guess is chosen close enough to the root.
The milestones are the supporting results of the chapter: the error bound and convergence of bisection, the convergence of the linear iterative method under a derivative bound ∣g′∣leL<1, the a posteriori estimate ∣barx−xn∣lefracL1−L∣xn−xn−1∣, and the quadratic order of Newton's method at a simple zero.
Significance
Bisection, fixed-point iteration and Newton's method are the three root finders every numerical-analysis course starts with, and the three convergence theorems above are what justifies using them. The a posteriori estimate is what turns the iteration into an algorithm with a stopping criterion: it bounds the distance to the root by a quantity the program can measure. The quadratic order statement explains the observed doubling of correct digits per step at a simple zero and its loss at a multiple zero.
On the formalization side, Mathlib already has a fixed-point theorem for contractions on complete spaces and the mean value theorem, but not the statements in the form used in numerical analysis: bisection with its explicit 2−n bracket, the fracL1−L a posteriori bound, or Newton's local convergence and quadratic rate stated for the concrete iteration sequence. This mission asks for those.
Difficulty
The delicate point in all three theorems is that the iterates must be known to stay in the region where the hypotheses hold; the informal proofs assume this silently. For the linear iterative method the mission therefore states the invariance hypothesis explicitly (g maps the closed interval into itself). For Newton's method, no such hypothesis is given: the existence of a neighbourhood of barx that the iteration preserves is part of what must be proved, and it comes from the continuity of g′ together with g′(barx)=0. The quadratic-order milestone also has to handle the degenerate possibility xn=barx, which would put a zero in the denominator; it is excluded by hypothesis.
Formalization scope
Everything is over the real numbers. The iterations are given as explicit recursive sequences: the bisection construction returns the bracketing pair (an,bn) and its midpoint, and there are separate sequences for the fixed-point and Newton iterations. Newton's method takes the derivative as a separate function argument f′, tied to f by a hypothesis of the form "f has derivative f′(x) at every x of the interval"; this avoids relying on any junk value of a derivative operator where f fails to be differentiable. Division is total, so a step at a point where f′ vanishes would leave the iterate unchanged; the hypotheses exclude this inside the interval.
Two deliberate deviations from the source are worth flagging for the auditor. First, Proposição 3.5.1 assumes f′(x)neq0 only for xneqbarx, but its proof divides by f′(barx)2; the formal statement assumes f′neq0 on the whole interval, so barx is a simple zero. Second, the convergence statement for the linear iterative method adds the hypothesis that g maps the closed interval into itself, without which the iterates may leave the region where the derivative bound is assumed.
Selected references
S. R. Freitas, Métodos Numéricos, Departamento de Computação e Estatística, Centro de Ciências Exatas e Tecnologia, Universidade Federal de Mato Grosso do Sul, 2000. Chapter 3, Zeros de Funções, pp. 33–70. (Course notes supplied with this mission.)
Métodos Numéricos (Freitas) V: Interpolação Polinomial e o Erro da Fórmula de LagrangeTextbook
Motivation
A table of values is all one has of many functions: measurements, tabulated physical constants, the output of an expensive simulation. Interpolation reconstructs a function between tabulated points by passing a polynomial through them, and it underlies much of the rest of numerical analysis — quadrature rules, finite-difference formulas and predictor-corrector schemes for differential equations are all obtained by integrating or differentiating an interpolating polynomial. What makes the reconstruction trustworthy is a formula for the error committed away from the nodes.
This mission is the fifth in a series formalizing the lecture notes Métodos Numéricos by Sergio Roberto de Freitas (UFMS, 2000). It covers Chapter 7, Interpolação.
Setting
Let x0<x1<dots<xn be distinct nodes and fi=f(xi) the tabulated values of a function f. The Lagrange form of the interpolating polynomial is
so that Pn(xi)=fi for every i, and Pn is the unique polynomial of degree at most n with this property.
The interpolation error at a point x that is not a node is the difference f(x)−Pn(x).
Target
The goal theorem is Proposição 7.3.1: if f is n+1 times differentiable on (a,b) and all nodes lie in (a,b), then for every xin(a,b) different from all nodes there exists xiin(a,b) with
The milestones are the other results of the chapter needed to make sense of it: the existence and uniqueness of the interpolating polynomial of degree at most n through n+1 points with distinct abscissas (Proposição 7.2.1), the fact that the Lagrange formula does interpolate the data, and the practical error bound of Proposição 7.3.2, ∣f(x)−Pn(x)∣lefracM(n+1)!prodk∣x−xk∣ when ∣f(n+1)∣leM.
Significance
The error formula is the reason interpolation is a numerical method and not just a curve-drawing device: it shows that the error is governed by two independent factors, the smoothness of f through f(n+1) and the geometry of the nodes through the product prodk(x−xk). Everything downstream follows from it — the h2 and h4 error terms of the trapezoidal and Simpson rules in the next mission are obtained by integrating exactly this expression, and the choice of Chebyshev nodes is the attempt to make the product factor small.
Difficulty
The standard proof introduces the auxiliary function F(t)=f(t)−Pn(t)−Kprodk(t−xk) with K chosen so that F(x)=0, and then applies Rolle's theorem n+1 times to conclude that F(n+1) vanishes somewhere. Formalizing the repeated application of Rolle's theorem, keeping track of the n+2 distinct zeros and the nested intervals they generate, is the substance of the work; it is an induction that has to be organized carefully rather than a computation.
Formalization scope
The nodes are given as a strictly increasing family x0<dots<xn of n+1 reals lying in the open interval (a,b), and the interpolating polynomial is the explicit Lagrange sum rather than an abstract polynomial: at a node it is defined by the same formula, whose factors then include 0/0 contributions unless the nodes are distinct, which is why the distinctness hypothesis appears in the interpolation milestone. Smoothness is expressed as continuous differentiability of order n+1 on the open interval (a,b), and the derivative appearing in the error term is the iterated derivative computed within that set; since the set is open this agrees with the ordinary (n+1)-st derivative. The evaluation point x is assumed to lie in (a,b) and to differ from every node; the point xi is asserted to exist in (a,b), with no claim of uniqueness or of any relation to x beyond membership in the interval. The uniqueness milestone is stated with Mathlib's polynomial type and the degree bound deglen, which includes the zero polynomial.
Selected references
S. R. Freitas, Métodos Numéricos, Departamento de Computação e Estatística, Universidade Federal de Mato Grosso do Sul, 2000. Chapter 7, Interpolação, pp. 133–161. (Course notes supplied with this mission.)
Foundations of Machine Learning XIV: Finite Markov Decision Processes and Bellman's EquationsTextbook
Motivation
Reinforcement learning formalizes a scenario supervised learning cannot: an agent that
actively interacts with an environment, choosing actions that change both the state it
observes next and the reward it receives, rather than passively receiving an i.i.d. labeled
sample. Every practical treatment of this scenario — from classical dynamic programming to
modern deep reinforcement learning — is built on the Markov decision process (MDP), a model
in which the effect of an action depends only on the current state, not on the full history
that led to it. Two questions define the theory this mission covers: given a fixed way of
acting (a policy), what value does it obtain, and how is that value actually computed rather
than merely characterized as the solution of a fixed-point equation? Mohri, Rostamizadeh and
Talwalkar's chapter 17 answers both for the stationary, infinite-horizon discounted case, and
this mission targets its two central results: that a fixed policy's value is not just
characterized but uniquely determined by a linear system with an explicit closed-form
solution (Theorem 17.10), and that the optimal value function — obtained instead by choosing
the best action at every state — can be computed by an iterative algorithm guaranteed to
converge regardless of where it starts (Theorem 17.11).
Setting
A (finite) Markov decision process consists of a finite set of states S, a finite set of
actions A, a transition kernel P[s′∣s,a] giving the distribution over the next state
s′ after taking action a at state s, and an expected reward E[r(s,a)] for that
transition. A (stationary) policyπ:S→Δ(A) assigns each state a distribution over
actions — possibly, but not necessarily, a point mass on a single action. Fixing π turns the
MDP into an ordinary Markov chain on S: at each step the agent is at some state s, draws
a∼π(s), receives (expected) reward E[r(s,a)], and moves to a state drawn from
P[⋅∣s,a]. For a discount factor γ∈[0,1), the value of π at s is the
expected discounted sum of future rewards starting from s,
Vπ(s)=Eat∼π(st)[t=0∑+∞γtr(st,at)s0=s],
and the state-action value functionQπ(s,a) is the analogous quantity for taking a
at s and then following π. Marginalizing the raw kernel and reward over the mixed action
π(s) gives the induced transition matrix Ps,s′=P[s′∣s,π(s)]=∑aπ(s)(a)P[s′∣s,a] and induced reward vector Rs=E[r(s,π(s))]=∑aπ(s)(a)E[r(s,a)] — the objects that turn π's value into a genuinely linear-algebraic quantity. A
policy π∗ is optimal if Vπ∗(s)≥Vπ(s) for every policy π and every
state s; write V∗ for its value function.
Formalization targets
Theorem 17.10 (goal). For a finite MDP and a fixed policy π, the matrix I−γP
(with P the policy-induced transition matrix) is invertible, and π's value function is the
unique solution of the Bellman equations, given in closed form by
Vπ=(I−γP)−1R.
Proposition 17.9 (milestone). The value function itself satisfies the linear system that
Theorem 17.10 solves:
Theorem 17.7 (milestone). A policy π is optimal if and only if it places probability
only on Qπ-maximizing actions: for every (s,a) with π(s)(a)>0, a∈argmaxa′Qπ(s,a′).
Theorem 17.11 (milestone). The Bellman optimality operator Φ, [Φ(V)](s)=maxa{E[r(s,a)]+γ∑s′P[s′∣s,a]V(s′)}, is a γ-contraction for
∥⋅∥∞; consequently, for any starting vector V0, the value-iteration
sequence Vn+1=Φ(Vn) converges to a fixed point of Φ.
Significance
Theorem 17.10 is what makes policy evaluation on a finite MDP an exact, finite computation
rather than an infinite limit: instead of summing an infinite discounted series or solving an
implicit fixed-point equation numerically, a single ∣S∣×∣S∣ matrix inversion gives the
policy's value at every state simultaneously. It is also the base case every planning algorithm
in the chapter builds on: policy iteration alternates optimizing a policy with exactly this
evaluation step. Theorem 17.11 gives the complementary guarantee for the harder problem of
finding the optimal value function directly, without fixing a policy first: value iteration
converges from any starting point, with a convergence rate (O(log(1/ϵ)) iterations for
ϵ-accuracy) that follows from the same contraction argument. Together, the two results
are the mathematical content behind why dynamic-programming planning for finite MDPs is
tractable at all — the discount factor γ<1, not any structural assumption on rewards or
transitions, is what buys both the uniqueness in Theorem 17.10 and the convergence in Theorem
17.11. Formalizing them requires reproducing this linear-algebraic and metric content precisely,
not just asserting the conclusions: an invertibility claim asserted without the operator-norm
argument, or a convergence claim without the contraction property, would state something true
by fiat rather than the book's actual result. No faithful prior art exists on the platform for
this exact model (see Formalization scope).
Difficulty
The obvious shortcut for Theorem 17.10 is to assert I−γP is invertible without proof —
true, but not what the book does, and not informative about why it holds. The genuine content
is that P, being row-stochastic (every row of P sums to exactly 1, since π(s) and
P[⋅∣s,a] are both proper distributions), has operator norm ∥P∥∞=1
exactly, so ∥γP∥∞=γ<1 strictly; this rules out 1 as an eigenvalue
of γP, which is exactly what invertibility of I−γP requires. The same
γ<1 fact, applied differently, drives Theorem 17.11: showing Φ is γ-Lipschitz
requires bounding Φ(V)(s)−Φ(U)(s) by comparing the maximizing action for V against
the same action's value under U (not U's own maximizer), since the two suprema need not be
attained at the same action — a step easy to state incorrectly as a direct comparison of two
maxima. Both theorems fail if γ=1 is allowed: the discounted setting's central asset, a
strict contraction, disappears exactly at that boundary.
Formalization scope
States and actions are modeled as finite types (Fintype S, Fintype A); the raw kernel and
reward P : S → A → S → ℝ, Er : S → A → ℝ are unconstrained functions, with IsTransitionKernel
asserting the required distribution property explicitly rather than assuming it silently. A
policy is π : S → A → ℝ with IsPolicy π asserting π s is a distribution over A for every
s — deliberately not π : S → A or a PMF-valued function, since Theorem 17.7's own
quantifier ("for any pair (s,a) with π(s)(a) > 0") requires treating π(s) as a genuine
mixture. PolicyValue is defined as the actual infinite discounted expectation (via an explicit
state-occupation-distribution recursion), not as the Bellman fixed point — so that Proposition
17.9 (the value function satisfies the linear system) and Theorem 17.10 (that system has a
unique, invertible-matrix solution) are both non-vacuous claims about the same object, rather
than one being definitionally true of the other. The trivializing formalization this rules out
is asserting IsUnit (1 - γ • P) as a bare hypothesis, or defining V_πas(1-γP)⁻¹R and
calling the resulting identity a theorem; both would erase the mission's actual content.
Two platform modules model related MDPs (BertsekasSSPModel, a stochastic-shortest-path model
with a termination-probability deficit rather than exact row-stochasticity, and
FoundationsRL.RLBasics, a finite-horizon episodic model indexed by layer) — neither
specializes exactly to this chapter's stationary, always-continuing, infinite-horizon discounted
convention, so every definition here is drafted fresh rather than imported. This chunk covers
§17.2–17.4.2 (the MDP model, policy value, Bellman's equations, value and policy iteration);
§17.4.3 (the linear-programming formulation) and §17.5 (stochastic-approximation learning
algorithms — TD(0), Q-learning, SARSA) are out of scope, since they require a
stochastic-approximation convergence substrate this mission does not build.
Selected references
Mohri, M., Rostamizadeh, A., and Talwalkar, A. Foundations of Machine Learning, 2nd ed.,
chapter 17. MIT Press, 2018.
Bellman, R. Dynamic Programming. Princeton University Press, 1957.
Puterman, M. L. Markov Decision Processes: Discrete Stochastic Dynamic Programming. Wiley,
1994.
Stability and Symmetry Breaking in the General Two-Higgs-Doublet ModelResearch Paper
Motivation
In the Standard Model the scalar sector consists of a single complex SU(2)L doublet. The general Two-Higgs-Doublet Model (THDM) replaces it by two complex doublets φ1,φ2 of the same weak hypercharge y=1/2. This is the minimal extension of the scalar sector that is still renormalisable and gauge invariant, and it is forced on any supersymmetric completion: the Minimal Supersymmetric Standard Model has exactly two Higgs doublets. Before any phenomenology can be done with such a model, two questions have to be answered for the given parameter point: is the scalar potential stable, i.e. bounded from below, and does its global minimum break SU(2)L×U(1)Y down to the electromagnetic U(1)em?
The general THDM potential has 14 real parameters, and answering these questions directly in field space — eight real scalar degrees of freedom, of which three are gauge — is unwieldy. Maniatis, von Manteuffel, Nachtmann and Nagel (2006) proposed a reformulation in terms of gauge-invariant bilinears, in which the gauge orbits of the Higgs fields are parametrised by a Minkowski-type four-vector confined to the closed forward light cone, and the potential becomes a quadratic polynomial on that cone. In these variables the stability question reduces to a one-variable problem: the sign of an explicit rational function f(u) on a finite set I of at most ten real numbers. This mission formalizes that analysis: the gauge-orbit parametrisation (their Theorem 4), the classification of the stationary points of the potential (their Theorem 2), and the stability criterion itself (their Theorem 1).
Setting
Write the two doublets as rows of a 2×2 complex matrix,
ϕ=(φ1+φ2+φ10φ20),
and form the hermitian matrix of gauge-invariant scalar products Kij=φj†φi, i.e. K=ϕϕ†. Decomposing K in the Pauli basis gives four real functions
K0=trK,Ka=tr(Kσa),a=1,2,3.
Positive semi-definiteness of K is equivalent to K0≥0 and K02−∣K∣2≥0: the four-vector (K0,K) lies on or inside the forward light cone. A gauge transformation acts as ϕ↦ϕUT with U∈U(2), and leaves K invariant.
The most general gauge-invariant renormalisable potential is
V=V2ξ0K0+ξTK+V4η00K02+2K0ηTK+KTEK,
with real parameters ξ0,η00∈R, ξ,η∈R3 and a real symmetric 3×3 matrix E. For K0>0 one sets k=K/K0, so that ∣k∣≤1, and
where u is a Lagrange multiplier for the constraint ∣k∣=1. The finite set I collects: every regular u with f′(u)=0; the point u=0 when f′(0)>0; and every eigenvalue μ of E at which f stays finite and f′(μ)≥0. It has at most ten elements, and {f(u):u∈I} is exactly the set of stationary values of J4.
For the stationary points of the full potential one uses four-vector notation K~=(K0,K), ξ~=(ξ0,ξ), E~=(η00ηηTE) and the metric g~=diag(1,−1,−1,−1), so that V=K~Tξ~+K~TE~K~ on the domain K~Tg~K~≥0, K0≥0, with f~(u)=−41ξ~T(E~−ug~)−1ξ~.
Formalization targets
Goal — Theorem 1 (stability criterion)
For V4≡0 the potential is stable for ξ0>∣ξ∣, marginal for ξ0=∣ξ∣ and unstable for ξ0<∣ξ∣. For V4≡0,
f(ui)>0∀ui∈I⟹J4>0 on ∣k∣≤1(stability in the strong sense),∃ui∈I:f(ui)<0⟹V unbounded below,
and if f≥0 on I with equality somewhere, the sign of g(ui) — replaced by g(ui)−∣ξ⊥(ui)∣f′(ui) when ui is an eigenvalue of E — decides between stability in the weak sense and instability.
Milestones
Theorem 4 (gauge orbits); the four stability cases (a), (b.2), (b.3), (b.4) of Section 4 including the criterion J22≤CJ4 for the marginal case; equation (4.39) identifying the stationary values of J4 with {f(u):u∈I}; equations (4.42)–(4.44) giving J2 at those stationary points; and Theorem 2, the classification of the stationary points of V.
Significance
The criterion is a decision procedure: given the 14 parameters of a THDM, stability is settled by evaluating one rational function at the roots of another, without any search in field space. The authors use it to re-derive the known stability conditions for the MSSM potential and to settle the stability and symmetry-breaking properties of the THDM potential of Gunion et al., for which λ1+λ3>0, λ2+λ3>0 and λ4,κ>−2λ3−2(λ1+λ3)(λ2+λ3) come out as the strong-stability conditions. Theorem 4 is what makes the whole approach legitimate: it says that nothing is lost in passing from fields to the invariants (K0,K), because the fibres of that map are exactly the gauge orbits.
The results are established in the published literature; what this mission adds is machine-checked proofs. The statements are not present in Mathlib in any form, and the note added in version 3 of the paper — a condition for the marginal case that was missing in the original version — is a concrete reminder that the case analysis here is easy to get subtly wrong.
Difficulty
The obvious route to stability is to minimise V directly; it fails because the domain is a cone with a boundary, and the minimisation over the boundary ∣k∣=1 introduces a Lagrange multiplier whose admissible values are the roots of f′, including the degenerate "exceptional" solutions where E−u is singular. Those exceptional solutions are not a technicality: they are where the eigenvalue clauses of I, the ξ⊥ correction in (4.43), and the junk-value behaviour of matrix inverses all live. The marginal case (J4 and J2 vanishing simultaneously somewhere) is not decided by the signs alone and needs the quantitative bound J22≤CJ4.
Formalization scope
Vectors in R3 are plain functions Fin 3 → ℝ with an explicitly defined dot product; E is a Matrix (Fin 3) (Fin 3) ℝ and its symmetry is carried as a hypothesis. Four-vectors are indexed by Unit ⊕ Fin 3 so that E~ and g~ are block matrices, with the first component being K0. Higgs configurations are 2×2 complex matrices and K=ϕϕ†; a gauge transformation is ϕ↦ϕUT with U†U=1.
Stability is formalized as the honest statement that V(K0,k) is bounded from below on the physical domain K0≥0, ∣k∣≤1 — not as any of the sign conditions that the theorem derives — so none of the implications is true by definition. Matrix inversion in Lean returns the zero matrix at a singular argument; every occurrence of (E−u)−1 is therefore guarded by a regularity hypothesis, and the values of f,f′,g at an eigenvalue of E are defined as limits, with the existence of those limits part of the membership condition for I. The projection ξ⊥(μ) is characterised by its defining property (it lies in the eigenspace and ξ−ξ⊥ is orthogonal to it) rather than by a choice of eigenbasis.
A complete development needs linear algebra over R (resolvents, symmetric matrices, eigenspaces), U(2) and the spectral decomposition of positive semi-definite 2×2 complex matrices for Theorem 4, and elementary real analysis (compactness of the ball, limits of rational functions) for Section 4. The gauge-orbit statement and the light-cone parametrisation are reusable for any multi-doublet scalar sector; contributions of the n-doublet generalisation (Appendix B, Theorem 5) are welcome as follow-ups.
Selected references
M. Maniatis, A. von Manteuffel, O. Nachtmann, F. Nagel, Stability and symmetry breaking in the general two-Higgs-doublet model, Eur. Phys. J. C 48 (2006) 805–823. https://arxiv.org/abs/hep-ph/0605184
J. F. Gunion, H. E. Haber, G. L. Kane, S. Dawson, The Higgs Hunter's Guide, Addison-Wesley, 1990.
First-Order and Stochastic Optimization Methods for Machine Learning I: The Separation Theorem, Strong Duality and the KKT ConditionsTextbook
Motivation
Every convex optimization algorithm in machine learning — from projected gradient descent to
support vector machines to the mirror-descent methods of later chapters of this book — is
justified by a small set of optimality certificates: a checkable condition on a candidate
solution that guarantees it actually solves the problem, without searching the whole feasible
set. The most widely used such certificate is the Karush–Kuhn–Tucker (KKT) system: a set of
gradient and complementary-slackness equations that a solution of a convex program with
differentiable data must satisfy, and that (under a mild constraint qualification) is also
sufficient. It is the tool a practitioner reaches for to check optimality of a numerical solver's
output, and the tool a theorist reaches for to derive an algorithm (dual ascent, augmented
Lagrangian, interior point methods) in the first place. Every convex machine learning model
introduced in Chapter 1 of this book — regularized least squares, support vector machines,
logistic regression with constraints — is an instance of the general convex program these
milestones analyze.
The result traces back to Kuhn and Tucker's 1951 paper Nonlinear Programming, with Karush's
1939 unpublished thesis establishing the same conditions independently and earlier; Slater's 1950
unpublished note is the source of the constraint qualification that bears his name and that makes
the necessity direction possible. Lan's Chapter 2 gives a compact, modern, purely
finite-dimensional derivation of the whole chain — separation, duality, saddle points, KKT — from
first principles, self-contained in about twenty pages, aimed squarely at the convex programs
that appear in machine learning.
Setting
Fix n,m,p∈N and work in Rn with its standard inner product ⟨⋅,⋅⟩. A convex program (2.3.16) is
where X⊆Rn is a nonempty closed convex set, f,g1,…,gm:X→R are convex, and h1,…,hp are affine. A point x∈X is feasible if it
satisfies every gi(x)≤0 and hj(x)=0; x∗ is optimal if it is feasible and
f(x∗)≤f(x) for every feasible x.
The normal cone of X at x is NX(x):={w∈Rn:⟨w,y−x⟩≤0∀y∈X} — the set of directions that make an obtuse angle with every direction into
X from x; it is {0} when X=Rn, recovering unconstrained first-order
optimality. The Lagrangian is L(x,λ,y):=f(x)+∑iλigi(x)+∑jyjhj(x) for multipliers λ≥0, y∈Rp; the Lagrange dual value is
φ(λ,y):=minx∈XL(x,λ,y), and the Lagrange dual problem is
φ∗:=maxλ≥0,yφ(λ,y). Weak duality, φ∗≤f∗, holds
unconditionally by construction. Slater's condition asks for xˉ∈intX with g(xˉ)<0, h(xˉ)=0; the restricted Slater condition weakens the interior
requirement to the relative interior rintX while keeping strict inequality for
every (here: every) nonlinear constraint.
Formalization targets
Goal — Theorem 2.8(b), KKT necessity
x∗ optimal (with a restricted-Slater point)⟹∃λ∗≥0,y∗:∇f(x∗)+i∑λi∗∇gi(x∗)+j∑yj∗∇hj(x∗)∈NX(x∗),λi∗gi(x∗)=0∀i.
Companion — Theorem 2.8(a), KKT sufficiency
∃λ∗≥0,y∗ satisfying stationarity and complementary slackness at a feasible, differentiable x∗⟹x∗ optimal.
Supporting milestones, in attack order
Theorem 2.1 (separation): a point outside a closed convex set is strictly separated from it
by a hyperplane.
Proposition 2.9 (Convex Theorem on Alternative): insolvability of a strict-inequality
system, plus a Slater point, forces solvability of a dual multiplier system.
Theorem 2.6 (strong duality): under Slater's condition, φ∗=f∗ and the dual is
solvable.
Theorem 2.7(a)/(b) (saddle points): x∗ is optimal iff it extends to a saddle point of
L (the "only if" needs Slater's condition; the "if" needs nothing beyond the saddle
inequalities).
Each of these five is stated the way the book states it — no constant is hard-coded, no O(·) is
involved, and every hypothesis (closedness, convexity, Slater/restricted-Slater) is exactly the
one the corresponding proof uses.
Significance
The KKT system is the interface between convex optimization theory and every algorithm that
exploits it: primal-dual methods track approximate KKT residuals as a stopping criterion, and the
derivation of the Lagrange dual (used throughout the book's later treatment of composite and
constrained problems) rests on strong duality, milestone strong_duality here. The saddle-point
characterization (saddle_point_sufficient/saddle_point_necessary) is the standard route to
designing an algorithm: a method that provably drives a pair (xk,λk) to a saddle point
of L is provably convergent to an optimal x∗, without ever needing to verify optimality
directly against the primal problem.
None of the six substantive results here has a machine-checked proof on Prove2Me. The platform
holds a genuinely weaker unconstrained-in-K condition (OnlineConvexOpt.ConvexBasics. kkt_optimality, Hazan's Theorem 2.2: ⟨∇f(x∗),y−x∗⟩≥0 for y∈K,
with no inequality/equality constraints or multipliers at all) and a structurally different,
strictly more general cone-based Lagrange-duality development (VectorSpaceOpt.lagrange_duality
and VectorSpaceOpt.lagrangian_saddle_sufficient_pointed, from Luenberger, which bundle all
constraints into a single map into a convex cone in a general normed space, rather than Lan's
explicit Rm inequality / Rp equality split). Formalizing this mission
produces the finite-dimensional convex-program version of KKT in exactly the shape it is used and
taught: separate multiplier vectors for inequality and equality constraints, an explicit normal
cone rather than a cone-map abstraction, and both directions of the necessity/sufficiency split.
Difficulty
The separation theorem (Theorem 2.1) itself is routine once the projection onto a closed convex
set is available. The real difficulty is entirely in the direction of the Convex Theorem on
Alternative that Proposition 2.9 states: the naive idea — "insolvability of (I) should give a
separating hyperplane between {x:f(x)<c} and {x:g(x)≤0} directly" — fails, because
these are sets in Rn and separating them there does not produce a sign-definite
multiplier vector. Lan's proof instead lifts to Rm+1 and separates the epigraph-like
set T={u:∃x∈X,f(x)≤u0,g(x)≤u1:m} from the open orthant-like set S={u:u0<c,u1:m≤0}; only in this lifted space does the separating normal's sign
constraint (forced by S's unboundedness in the positive directions) translate into λ≥0. Getting the sign of the 0-th coordinate strictly positive — needed to normalize and divide
— is itself a small separate argument using the Slater subsystem's solution. The KKT necessity
direction (the goal) then chains three of these already-nontrivial results (separation →
CTA → strong duality → saddle necessity) before translating the saddle-point condition on L
into the gradient/normal-cone form via differentiability of f,g at x∗.
Formalization scope
All milestones are stated over EuclideanSpace ℝ (Fin n) with Convex/ConvexOn from Mathlib.
Affine equality constraints hj are represented by explicit witnesses wj∈Rn,bj∈R with hj(x)=⟨wj,x⟩+bj, so that ∇hj=wj is
available without a separate affine-differentiability lemma. The normal cone NX∗(x) is Lan's
own primal-space object (normalCone); the restricted Slater condition uses Mathlib's
intrinsicInterior ℝ X for rintX, distinct from the plain interior X used by
the un-restricted Slater condition of Theorems 2.6/2.7(b). Primal optimal values and Lagrange dual
values are stated via IsGLB/pointwise-inequality forms rather than raw sInf, so that no
hypothesis is silently made true by an empty or unbounded set defaulting sInf to a junk value —
in every milestone here the relevant set is guaranteed nonempty by the Slater-point hypothesis
already present.
A trivializing formalization this mission rules out: stating kkt_necessary/kkt_sufficient
with X=Rn (no set constraint) and empty g,h (no functional constraints) would
collapse the normal-cone condition to ∇f(x∗)=0 and make the whole KKT apparatus vacuous
of any duality content; the milestones here keep X, g and h as genuine free parameters (the
theorems are stated for arbitrary m, p : ℕ, including but not restricted to the degenerate case)
so that the constrained content of Lan's theorem is what gets proved.
Reusable beyond this mission: normalCone and lagrangian are generic enough that any later
chapter of this book needing Lagrangian duality or normal-cone stationarity (none of the current
first-wave chapters 03/06 needs them directly) could import them once published rather than
redeclaring. Contributions most welcome on the two hardest milestones,
cta_solvable_of_insolvable and kkt_necessary, since they carry the mission's real difficulty;
separation_point_closed can likely be discharged quickly via Mathlib's
geometric_hahn_banach_point_closed.
Selected references
G. Lan, First-Order and Stochastic Optimization Methods for Machine Learning, Springer Series
in the Data Sciences, Springer 2020, Chapter 2. https://doi.org/10.1007/978-3-030-39568-1
H. W. Kuhn and A. W. Tucker, "Nonlinear Programming," Proceedings of the Second Berkeley
Symposium on Mathematical Statistics and Probability, 1951, pp. 481–492.
W. Karush, "Minima of Functions of Several Variables with Inequalities as Side Constraints,"
M.Sc. thesis, University of Chicago, 1939.
R. T. Rockafellar, Convex Analysis, Princeton University Press, 1970 (standard modern
reference for the separation theorem and Lagrangian duality used throughout).
Support Vector Machines V: Bernstein's Inequality for Independent Hilbert-Space-Valued Random VariablesTextbook
Motivation
Every statistical guarantee for a learning algorithm ultimately rests on a concentration
inequality: a bound on how far an empirical average can stray from its expectation. For
real-valued averages, Bernstein's inequality (1924, refined through the 20th century) is the
classical tool — sharper than Hoeffding's inequality whenever the summands' variance is small
compared to their range. Modern learning theory, however, frequently needs to control averages
of objects that are not real numbers but elements of a Hilbert space: feature vectors
Φ(xi)yi, gradients of a loss, or the values a kernel machine's empirical risk functional
takes. Steinwart & Christmann, Support Vector Machines (Springer 2008, Information Science and
Statistics), Chapter 6, develop exactly the vector-valued extension needed for the book's own SVM
consistency proofs: Theorem 6.14, Bernstein's inequality for independent random variables taking
values in a separable Hilbert space, and its corollaries.
Setting
Fix a probability space (Ω,A,P) and a separable real Hilbert space H. Random
variables ξ1,…,ξn:Ω→H are independent if the family is mutually
independent (not merely pairwise), and ξi has essential supremum boundB,
∥ξi∥∞≤B, if ∥ξi(ω)∥H≤B for P-almost every ω. Writing
E for EP, the quantities of interest are the mean Eξi∈H
(a Bochner integral) and the variance boundσ2, an upper bound on
E∥ξi∥H2.
The classical scalar case (Theorem 6.12, itself a refinement of Hoeffding's inequality, Theorem
6.10) bounds P(n1∑iξi≥ε) for real-valued, mean-zero,
range- and variance-bounded ξi. The tool behind both the scalar and the vector-valued case is
a general exponential-moment inequality (Theorem 6.13) valid for independent, integrable random
variables taking values in any separable Banach space E:
Goal: Theorem 6.14 (Bernstein's inequality in Hilbert spaces)
P(n1i=1∑nξiH≥n2σ2τ+nσ2+3n2Bτ)≤e−τ,τ>0,
for independent, mean-zero ξ1,…,ξn:Ω→H with ∥ξi∥∞≤B and
E∥ξi∥H2≤σ2. This is the weakest stable form of the claim: it is stated
for a general separable Hilbert space (not a fixed finite dimension), with the tail written as a
sum of three explicit terms rather than folded into an unspecified constant, so it survives
specialization to any concrete H without modification.
Supporting facts
Theorem 6.13 (above) is the direct tool Theorem 6.14's own proof invokes ("we will prove the
assertion by applying Theorem 6.13"); Theorem 6.12 is the scalar analogue Theorem 6.14
generalizes, included to make the generalization's exact form (three terms, not two) checkable
against its source; Corollary 6.15, Hoeffding's inequality in Hilbert spaces, is the immediate
mean-free-of-a-variance-bound consequence of Theorem 6.14 obtained by centering, reused directly
in the book's own oracle-inequality proof (§6.4).
Significance
Theorem 6.14 is the concentration inequality behind the book's later empirical-process arguments
for SVMs: whenever an SVM's analysis needs to bound the deviation of an empirical average of
Hilbert-space-valued quantities (feature-map evaluations, loss gradients) from its mean, this is
the tool invoked, via Corollary 6.15 in the book's own oracle-inequality derivation. Its distinct
contribution over simply applying the scalar Theorem 6.12 coordinate-by-coordinate (which is not
available without a fixed, finite orthonormal basis, and even then would produce dimension-
dependent bounds) is that the bound here is entirely dimension-free: it depends on H only
through the variance bound σ2 and the range bound B, not through dimH.
The scalar Bernstein inequality is classical (Bernstein 1924, refined by Bennett 1962 and others
to the sharper multiplicative form used here); its Banach- and Hilbert-space generalizations
(via the martingale-difference / Yurinskii-type argument Theorem 6.13's proof uses) are standard
in the empirical-process-theory literature by the time of this book (see, e.g., Pinelis 1994 for
closely related Banach-space martingale inequalities). No machine-checked Lean proof of the
Hilbert-space form is known to exist on the platform at the time of writing (the platform's own
HighDimProb.Concentration.bernstein_unweighted, from the Vershynin series, is a different,
sub-exponential-norm scalar statement — see Formalization scope); this mission asks for the
book's own bounded-summand, explicit-constant Hilbert-space form.
Difficulty
The natural first attempt generalizes the scalar proof's Markov-inequality argument directly:
bound Eet∥∑iξi∥ using independence. This breaks immediately because
∥⋅∥H is not linear, so et∥∑iξi∥ does not factor over i the way
et∑iξi does in the scalar case — there is no vector-valued analogue of the moment
generating function that tensorizes under independence directly. Theorem 6.13's proof resolves
this with a martingale-difference decomposition (writing the deviation as a telescoping sum of
conditional-expectation differences Xk across the filtration generated by ξ1,…,ξk)
rather than a direct product-of-moment-generating-functions argument, at the cost of needing E
separable (for the conditional expectations and the resulting sums to be well-defined and
measurable). Deriving Theorem 6.14 from Theorem 6.13 then requires controlling the two extra
terms Theorem 6.13 introduces (the mean-norm term and the per-summand correction) using only the
Hilbert-space-specific facts E⟨ξi,ξj⟩=0 for i=j (from
independence and mean-zero) and the scalar bound on E∥ξi∥2 — which is exactly
where the tail's extra σ2/n term originates, and is not obtainable by naively
reusing the scalar Theorem 6.12's two-term optimization over t unchanged.
Formalization scope
H (and, for Theorem 6.13, E) is an arbitrary separable real (Hilbert, resp. Banach) space —
not fixed to a Euclidean space of any dimension — matching the book's own generality, which is
essential since the theorem's dimension-independence is part of its content. ∥ξi∥∞≤B is formalized as the almost-sure bound ∀ᵐ ω ∂P, ‖ξ i ω‖ ≤ B, matching the book's
L∞(P) convention rather than requiring the bound to hold for literally every ω.
Independence is the mutual independence of the whole family (Mathlib's iIndepFun), matching
Theorem 6.13's proof, which uses independence of ξk from ∑i=kξi for every k
simultaneously, not merely pairwise independence.
A trivializing formalization would state the conclusion in terms of the scalar random variable
∥ξi∥H rather than the vector-valued average's norm n1∑iξiH —
this would collapse the theorem to an easier scalar statement about a nonnegative random variable
and lose the whole point of the vector-valued generalization; it is ruled out here by writing the
norm of the sum (not a sum of norms) inside the probability. Likewise, dropping the
σ2/n middle term of the tail bound (present here, absent from the scalar Theorem
6.12) would silently understate the genuine dimension-independent cost of vector-valued
concentration; all three terms are kept.
Theorem 6.13's general Banach-space statement, and the scalar Theorem 6.12, are reusable beyond
this mission (Theorem 6.13 is the tool any future Banach-space-valued concentration mission in
this series would reach for first). The platform's existing HighDimProb.Concentration. bernstein_unweighted/hoeffding_rademacher (Vershynin series) are not reused as kind: reference items here: they use a sub-Gaussian/sub-exponential-Orlicz-norm parameterization and a
universal (unspecified) constant, a genuinely different hypothesis structure from this chapter's
explicit L∞-bounded, exact-constant form — reusing them would misrepresent this chapter's
own, sharper statement. Completing the four sorrys (Theorems 6.12-6.14, Corollary 6.15) is
welcome; the martingale-difference argument behind Theorem 6.13 is the natural starting point,
since the other three all reduce to it directly.
Selected references
I. Steinwart & A. Christmann, Support Vector Machines, Springer, Information Science and
Statistics, 2008. https://doi.org/10.1007/978-0-387-77242-4 (Chapter 6, §6.2, pp. 210-217).
S. Bernstein, "On a modification of Chebyshev's inequality and of the error formula of
Laplace," Ann. Sci. Inst. Sav. Ukraine, Sect. Math. 1(4), 1924 (original scalar inequality).
G. Bennett, "Probability inequalities for the sum of independent random variables," Journal
of the American Statistical Association 57(297), 1962, pp. 33-45.
https://doi.org/10.1080/01621459.1962.10482149
I. Pinelis, "Optimum bounds for the distributions of martingales in Banach spaces," Annals of
Probability 22(4), 1994, pp. 1679-1706. https://doi.org/10.1214/aop/1176988477
Lectures on Quantum Field Theory I: The One-Particle Hilbert Spaces of a Boson and an ElectronTextbook
Motivation
Quantum field theory begins, mathematically, with a question that has a completely precise answer:
what is the state space of a single relativistic particle? Non-relativistic quantum mechanics
answers L2(R3) and moves on. Relativity does not allow that answer, because the state
space must carry an action of the symmetry group of Minkowski spacetime — the Poincaré group — and
the choice of Hilbert space is dictated by which such action one wants. The construction that
results is the foundation on which Fock space, creation and annihilation operators, free fields
and eventually interacting theories are built, and it is where the objects that reappear
everywhere in the subject are introduced: the mass shell, the Lorentz-invariant measure on
it, and the double cover SL(2,C)→SO↑(1,3) that is responsible for spin.
This mission formalizes that construction as it is presented in S. Chatterjee's Lectures on
Quantum Field Theory (Stanford, 2018–19), Lectures 9–11 and Lecture 25: the one-particle space of
a massive scalar boson, the one-particle space of an electron, and the statement that both
carry inner products invariant under the Poincaré action.
Setting
Minkowski spacetime is R1,3 with the bilinear form
(x,y)=x0y0−(x1y1+x2y2+x3y3),x2:=(x,x).
A Lorentz transformation is a linear map L with (Lx,Ly)=(x,y); the restricted Lorentz
groupSO↑(1,3) consists of those with detL=1 and L00>0. The Poincaré
group is P=R1,3⋊SO↑(1,3) with the group law
(a,A)(b,B)=(a+Ab,AB).
For a mass m>0, the four-momentum of a particle satisfies p2=m2 and p0≥0, so it
lies on the mass shell
Xm={p∈R1,3:p2=m2,p0≥0},
a three-dimensional manifold parametrised by the spatial momentum q∈R3 through
q↦(ωq,q) with ωq=m2+∣q∣2. On Xm there is, up to a
multiplicative constant, exactly one measure invariant under SO↑(1,3); with the
normalisation used in the lectures it is the measure λm determined by
∫Xmfdλm=∫R3(2π)32ωqd3qf(ωq,q).
The state space of a massive scalar boson is H=L2(Xm,dλm), acted on by
(U(a,L)ψ)(p)=ei(a,p)ψ(L−1p).
For an electron the wave function takes values in C2 and the group acts through the
double cover. To each four-vector x one attaches the Hermitian matrix
M(x)=(x0+x3x1+ix2x1−ix2x0−x3),detM(x)=(x,x),
and for A∈SL(2,C) the transformation κ(A) of R1,3 is defined by
M(κ(A)x)=AM(x)A†; the map κ is a surjective two-to-one homomorphism onto
SO↑(1,3). Writing p∗=(m,0,0,0), each p∈Xm is reached from p∗ by a unique
positive-definite Vp∈SL(2,C), the pure boost, and the electron inner product is
the Vp−2-weighted one,
(ψ,φ)=∫Xmdλm(p)ψ(p)†Vp−2φ(p),
with the group acting by (U(a,A)ψ)(p)=ei(a,p)Aψ(κ(A)−1p).
Formalization targets
Goal — both one-particle inner products are Poincaré invariant
for ψ,φ in the weighted L2 space of C2-valued functions. The goal fixes
no constants beyond the normalisation of λm, and it is the statement that the spaces
defined in the mission really are the one-particle spaces of the theory: a Hilbert space together
with a Poincaré action by isometries.
Supporting targets
The milestone list follows the lectures: the parametrisation of Xm; invariance of Xm under
SO↑(1,3); the integration formula for λm (eq. (10.1)); invariance of
λm; uniqueness of the invariant measure up to a constant; the composition law and
unitarity of the scalar representation; detM(x)=(x,x) and bijectivity of M onto Hermitian
matrices; κ as a multiplicative map into SO↑(1,3); surjectivity of κ with
fibres {±A}; existence and uniqueness of the pure boost Vp; Lemma 25.1; and the
identification of the weighted electron space with the plain C2-valued L2 space via
ψ↦V⋅−1ψ.
Significance
The objects here are used unchanged for the rest of a QFT course: the bosonic and fermionic Fock
spaces are built on these one-particle spaces, and the free scalar and Dirac fields are
operator-valued distributions written as integrals against dλm on Xm. Formalizing them
fixes, once and for all, the conventions later work must match — the normalisation of λm,
the sign convention of the metric, which of the two elements ±A of SL(2,C) acts,
and the weight in the electron inner product.
What this mission adds beyond the lectures is a machine-checked development of material usually
treated as routine but rarely written out: the uniqueness of the invariant measure, the covering
map and its fibres, and the existence-uniqueness of the pure boost are all stated in the source
either without proof or as exercises. Mathlib has the general theory of L2 spaces, push-forward
measures, Hermitian and positive-definite matrices, and SL2, but it has no mass shell, no
invariant measure on it, and no covering map onto the restricted Lorentz group; all of that is
constructed here and is reusable by any later mission on free fields or Fock spaces.
Difficulty
The obvious route to the invariant measure — "restrict Lebesgue measure to the submanifold Xm"
— does not work: the induced Riemannian volume of the hyperboloid in the Euclidean metric is not
Lorentz invariant. The lectures instead take a scaling limit of Lebesgue measure on the invariant
annuli {m2<p2<(m+ε)2}; the formalization takes the resulting formula (10.1)
as the definition and must then prove invariance, which amounts to a change-of-variables
computation whose Jacobian is exactly ωq-dependent. Uniqueness is harder: it is a
statement about invariant measures on a homogeneous space of a non-compact group, with no
finiteness available.
On the spinor side, the central difficulty is that the weight Vp−2 is unbounded on Xm, so
the electron space is not the naive C2-valued L2(Xm,dλm) — the two spaces
consist of different functions, and are related only through the measurable field of isomorphisms
ψ↦Vp−1ψ. A formalization that silently uses the unweighted space would prove a
different, and false, unitarity statement.
Formalization scope
Four-vectors are functions R1,3=(four-element index)→R, with the
metric signature (+,−,−,−); Lorentz transformations are real 4×4 matrices, and
membership in SO↑(1,3) is the predicate (det=1, L00>0, form preserved).
λm is a Borel measure on all of R1,3 carried by Xm, defined as the
push-forward of (2π)−3(2ωq)−1d3q; the boson space is the library L2 space of
that measure. The pure boost is given by the closed formula
Vp=(M(p)/m+I)/2+2p0/m — the positive-definite square root of M(p)/m — rather
than by a choice function, and a milestone certifies that it is the unique positive-definite
element of SL(2,C) carrying p∗ to p. The electron space is the set of
C2-valued measurable functions of finite weighted norm, with the weighted pairing given
explicitly; the milestone identifying it with the plain L2 space via the inverse boost is what
supplies its Hilbert-space structure.
The unitarity statements are formalized as equalities of integrals over pairs of wave functions
rather than as statements about abstract operators, so that no trivializing reading is available:
in particular the electron clause is stated for the weighted pairing, which is not the standard
L2 inner product, and the hypotheses (m>0, detA=1, ψ,φ in the respective
spaces) are satisfiable, so no clause holds vacuously. Total-function conventions of the library
(inverse of a singular matrix is 0; integral of a non-integrable function is 0) are visible in
the statements and are recorded in each item's read-back.
Contributions of any of the milestones are welcome; the measure-theoretic milestones (invariance
and uniqueness) and the SL(2,C) covering milestones are independent of each other and
can be attacked in parallel.
Stochastic Orders III: The Convex Order and Strassen's Martingale CouplingTextbook
Comparing variability, not just location
Chapter I's usual stochastic order compares "how large" two random variables tend to be. A
different, equally common question in operations research is "how spread out" a random variable
is: two portfolios with the same expected loss can differ sharply in how much that loss varies,
and a risk-averse decision maker or a convex cost function cares about exactly that difference.
Shaked and Shanthikumar's Stochastic Orders (Springer, 2007) formalizes this comparison as the
convex order, the book's mean-preserving-spread order (known outside OR and probability
circles as the Rothschild–Stiglitz order from economics). This mission formalizes the order and
its central structural result: Strassen's martingale-coupling characterization.
The convex order
Let X be a real-valued random variable on a probability space (Ω,μ), and let Y be a
real-valued random variable on a (possibly different) probability space (Ω′,ν). X is
smaller than Y in the convex order, written X≤cxY, if
E[φ(X)]≤E[φ(Y)]for every convex φ:R→R for which the two expectations exist.
Convex functions take their relatively largest values on the "extreme" regions outside some
interval, so X≤cxY says Y is more likely than X to take extreme values: Y is "more
variable" than X. Unlike the usual stochastic order, X≤cxY forces the two means to
agree (E[X]=E[Y], taking φ(x)=±x, both convex) — the convex order compares spread
holding location fixed, exactly the mean-preserving-spread reading. Two equivalent forms make it
tractable: comparing tail integrals of the survival/distribution functions (Theorem 3.A.1), and
comparing mean absolute deviations E∣X−a∣ from every point a (Theorem 3.A.2).
X≤cxY⟺∃(Ω′′,ρ),X^,Y^:Ω′′→R with X^=stX,Y^=stY,E[Y^∣X^]=X^ a.s.
Furthermore, X^,Y^ can be chosen so that the conditional law [Y^∣X^=x]
stochastically increases with x (in ≤st). This is the convex-order analogue of Chapter
I's Theorem 1.A.1: instead of one variable dominating the other pathwise, Y's copy is a fair
(martingale) randomization of X's copy whose spread only grows in the conditioning value. The
book itself calls the constructive direction "not easy to prove"; this mission states the theorem
faithfully, including the "Furthermore" strengthening, without attempting a proof.
Supporting milestones
Theorem 3.A.1, the tail-integral characterizations: for X,Y with E[X]=E[Y], X≤cxY
iff ∫x∞Fˉ(u)du≤∫x∞Gˉ(u)du for all x, and iff
∫−∞xF(u)du≤∫−∞xG(u)du for all x — the two integrated forms
the book's own sketch of Theorem 3.A.4 uses.
Theorem 3.A.2, the absolute-deviation characterization: for X,Y with E[X]=E[Y],
X≤cxY iff E∣X−a∣≤E∣Y−a∣ for every real a.
Theorem 3.A.12(d), closure under convolution: independent Xi≤cxYi for
i=1,…,m gives ∑iXi≤cx∑iYi — the convex-order analogue of Chapter I's
Theorem 1.A.3(b).
Significance
The convex order is the standard way operations research and actuarial science formalize "more
variable, same average": comparing the riskiness of two portfolios with matched expected return,
the effect of aggregation or diversification on total claim size, or the value of information in
a stochastic program (where a random variable degenerates to its mean exactly when the decision
maker learns everything, the two extremes of a convex-order chain). Strassen's characterization is
what turns "compare against every convex function" — an intractable universal quantifier — into a
single explicit construction: exhibit one martingale coupling and the comparison is settled for
every convex function at once, by Jensen's inequality. This is the technique behind bounding the
effect of information or risk aggregation without checking convexity function by function, and the
"Furthermore" monotonicity clause is what makes the coupling itself informative about how the
spread grows with the conditioning variable, not merely that some fair coupling exists.
Formalizing this theorem fixes, for the whole book series, the exact shape every later coupling
theorem for a variability-type order (the increasing convex/concave orders of Chapter IV via a
submartingale, the multivariate convex order of Chapter VII) is expected to restate. No proof is
attempted; the book's own remark that the constructive direction is "not easy" marks it as a
genuine target for a future proof-bearing pass, not a formality.
Difficulty
The definitional trap mirrors Chapter I's: "for every convex φ" must be a genuine
universal quantifier over Mathlib's own convexity predicate, with the existence of both
expectations stated as an explicit integrability hypothesis inside the quantifier, not assumed
globally or dropped. The coupling theorem doubles the difficulty of Theorem 1.A.1's: the
conditional-expectation condition E[Y^∣X^]=X^ a.s. is with respect to the
σ-algebra generated by X^, not an informal "expected value given X^", and must
use the martingale API's own convention (Mathlib's condExp) precisely. The "Furthermore" clause
compounds this: it is a claim about the regular conditional distribution of Y^ given
X^=x for every point x, not merely the conditional expectation, and dropping it silently
(as a "remark" rather than part of the theorem) would understate what Theorem 3.A.4 actually
claims — the chapter brief flags this explicitly as a trap, and it is kept as a conjunct of the
same existential witness here.
Formalization scope
Random variables are again measurable functions into R from arbitrary measurable
spaces, ConvexOrder μ ν X Y taking X on (Ω,μ) and Y on a separate (Ω′,ν),
matching Chapter I's convention and this series' own pattern. Convexity is Mathlib's ConvexOn ℝ Set.univ φ; "equality in law" is again ProbabilityTheory.IdentDistrib. The martingale condition
uses Mathlib's conditional-expectation notation ρ[Ŷ | m] =ᵐ[ρ] X̂ with m the σ-algebra
MeasurableSpace.comap X̂ inferInstance generated by X̂ — the martingale API's own convention,
not a hand-rolled gloss. The "Furthermore" clause uses Mathlib's ProbabilityTheory.condDistrib,
the regular conditional distribution kernel of Ŷ given X̂ (available since ℝ is a standard
Borel space), and states "increasing in x in ≤st" via the kernel's survival function being
monotone in x at every threshold — restating, locally to this chapter's namespace, the same
tail-probability shape Chapter I's UsualOrder uses (drafts cannot import another mission's
definitions, per this series' convention). A trivializing formalization is ruled out explicitly:
the martingale and monotonicity conjuncts are both kept as genuine content of the existential
witness in the goal theorem, not weakened to a bare coupling or dropped as an optional remark.
This mission draws on no platform prior art (searches for "convex order", "Strassen",
"martingale", "Jensen" returned only unrelated geometry/algorithm/physics results as of
2026-09-18); Mathlib's Probability/Martingale/* supplies the conditional-expectation and kernel
machinery the coupling condition and its "Furthermore" clause are built from, but no platform
theorem states the convex order or its coupling characterization itself. Reusable beyond this
mission: the condExp/condDistrib-based martingale-coupling pattern is the shape Chapter IV's
analogous submartingale coupling (Theorem 4.A.5) and Chapter VII's multivariate convex order
(Theorem 7.A.1) are each expected to restate independently.
Stochastic Orders II: The Mean Residual Life OrderTextbook
Motivation
A device's mean residual life at age t — its conditional expected remaining lifetime given
that it has survived to t — is one of the oldest and most interpretable summaries in
reliability and survival analysis: it is what an insurer, a maintenance planner, or a hospital
outcomes researcher actually wants to know about a unit still in service. Comparing two mean
residual life functions pointwise gives the mean residual life order≤mrl, a natural
"the survivor of X is worn less, on average, than the survivor of Y" comparison that is
weaker than the usual stochastic order but not directly comparable to it (the book states plainly
that neither implies the other in general). This mission formalizes the order's definition and
its precise relationship to the stronger hazard rate order≤hr: under an extra
monotone-ratio condition the two orders coincide, and one direction of that coincidence always
holds. A third milestone gives one of the chapter's closure properties, showing that "decreasing
mean residual life" (DMRL) — an aging notion used throughout reliability theory to describe units
that wear out, rather than improve, with age — is preserved under adding independent noise.
Setting
Fix a probability space (Ω,μ) and a real-valued random variable X with survival
function Fˉ(x)=P{X>x} and finite mean. The mean residual life function of X at t
is
For a second random variable Y on (Ω′,ν) with mrl function l, X is smaller than
Y in the mean residual life order, X≤mrlY, if m(t)≤l(t) for every t. The
hazard rate order, restated in this mission's own namespace (Chapter 1's version cannot be
imported — see Formalization scope), is the general, absolute-continuity-free comparison
Fˉ(x)Gˉ(y)≥Fˉ(y)Gˉ(x) for all x≤y, where Gˉ is Y's survival
function. A random variable X is DMRL (decreasing mean residual life) if its mrl function
m is decreasing in t.
Formalization targets
Goal — Theorem 2.A.2
(l(t)m(t) increases in t)andX≤mrlY⟹X≤hrY.
Combined with the companion milestone below, this is a genuine conditional equivalence: under
the monotone-ratio hypothesis, ≤mrl and ≤hr coincide, and in particular
X≤mrlY⟹X≤stY under that condition. Without the hypothesis, the book
states explicitly (the paragraph immediately preceding Theorem 2.A.1) that neither ≤st
nor ≤mrl implies the other.
Milestones, in attack order
Theorem 2.A.1.X≤hrY⟹X≤mrlY — the one-directional link that
motivates the goal theorem: the hazard rate order, strictly stronger in general, always implies
the mean residual life order.
Theorem 2.A.11. If X is DMRL and Z is a nonnegative random variable independent of X,
then X≤mrlX+Z — one of the chapter's closure properties (§2.A.3): adding independent
nonnegative noise to a DMRL random variable can only increase it in the mean residual life
order.
Each milestone is stated exactly as the book states it: no constant is hard-coded, no
O(⋅) or asymptotic approximation is involved, and the goal's monotone-ratio hypothesis is
the genuine ratio m(t)/l(t), not two separately-monotone functions (a different, unrelated
condition the book itself does not state).
Significance
The mean residual life order sits at a specific point in the book's own hierarchy of orders:
strictly implied by the hazard rate order (Theorem 2.A.1), and — the goal theorem — reversible
into the hazard rate order under one extra monotonicity hypothesis on the ratio of the two mrl
functions. This "sandwich" structure is exactly the kind of comparison-of-orders result that
makes Chapter 1's usual and hazard rate orders (already formalized in Chunk 01 of this series,
restated locally here since drafts cannot import each other) into a genuinely connected theory
rather than a list of unrelated definitions. The DMRL closure property (Theorem 2.A.11) is
separately significant: DMRL is one of the book's standard "aging" notions, used in reliability
engineering to model components that wear out over time, and its preservation under adding
independent noise is a basic tool for building compound reliability models (e.g. a component with
an added, uncorrelated failure mode) from simpler DMRL parts.
No prior art exists on the platform for either order: GET /theorems?q=mean+residual+life
returns zero hits, and GET /theorems?q=hazard+rate returns exactly one hit
(DQJSQ.theorem2_ifr), an unrelated queueing-theory IFR (increasing failure rate) lemma about
patience densities in a fluid queueing model, not this order — it names a different object under
a coincidentally similar keyword and is not reused. This mission is a foundational island for the
mean residual life order.
Difficulty
The mrl function is a genuinely two-case object: a real conditional expectation on
{t:Fˉ(t)>0}, and a hard 0 outside that region. The goal theorem's proof (not
formalized here; only the statement is a milestone) differentiates m and l, uses the identity
r(t)=m′(t)/m(t)+1/m(t) relating the mrl function to the hazard rate, and compares the two
resulting hazard-rate expressions using the ratio's monotonicity — a genuinely analytic argument,
not a routine unfolding of definitions. The chief formalization difficulty is keeping the shape
of ≤mrl (a pointwise comparison of a derived function) visibly distinct from the
function-class shape of ≤st used in Chapter 1, since the book explicitly warns that
conflating the two orders is a live error (neither implies the other in general) — see
Formalization scope below for how each shape is kept separate.
Formalization scope
All three random variables in this mission's milestones are real-valued measurable functions on
a MeasureTheory.Measure space, matching this series' Chapter 1 convention (Chunk 01). The mrl
function mrl μ X t is defined as if 0 < P{X>t} then (∫ ω in {X>t}, (X ω - t) ∂μ) / P{X>t} else 0, formalizing the case split on t<t∗ directly via positivity of the survival probability
(its defining equivalent under the survival function's monotonicity) rather than through the
derived quantity t∗ itself. MrlOrder μ ν X Y is ∀ t : ℝ, mrl μ X t ≤ mrl ν Y t — a direct
pointwise comparison of two functions, deliberately kept a different shape from Chapter 1's
UsualOrder (a ∀ φ ∈ 𝒞, E[φ∘X] ≤ E[φ∘Y] function-class quantifier), since the book's own
warning that ≤st and ≤mrl neither implies the other is a warning against treating
them as interchangeable comparison shapes.
The hazard rate order is restated locally in this chapter's own namespace
(StochasticOrders.MeanResidualLife.HazardRateOrder) rather than imported from Chunk 01's
StochasticOrders.Usual.HazardRateOrder, because each chapter's mission is drafted and reviewed
as an independent Prove2Me proposal and one draft cannot import another draft's unpublished Lean;
its definition is identical in shape to Chunk 01's own restatement of the general,
absolute-continuity-free survival-function form of ≤hr (not the density-ratio form, which
requires absolute continuity the book does not assume at this level of generality).
Every milestone that consumes mrl carries explicit Integrable hypotheses on the random
variables involved (Integrable X μ, and Integrable Y ν or Integrable Z μ as applicable),
formalizing the book's own standing "finite mean" hypothesis from §2.A.1's definition of the mrl
function: without it, the Bochner integral inside mrl would return its junk value 0 for a
non-integrable variable on some tail set, letting a hypothesis like MrlOrder μ ν X Y hold of a
function that is not actually the book's mean residual life function. DMRL μ X is
Antitone (mrl μ X), the book's own "m(t) is decreasing in t" in the weak, non-strict
monotone sense used throughout the book for "increasing"/"decreasing".
A trivializing formalization this mission rules out: stating the goal theorem with the ratio
hypothesis as two separate monotonicity conditions on m and l individually (rather than
genuine monotonicity of the ratio m(t)/l(t) on the region where l(t)>0) would be a different,
strictly stronger and easier-to-satisfy hypothesis than the book's own — the milestone here states
MonotoneOn (fun t => mrl μ X t / mrl ν Y t) {t | 0 < mrl ν Y t}, the genuine ratio restricted to
where the denominator does not vanish, matching Theorem 2.A.2's own "m(t)/l(t) increases in
t" verbatim.
Selected references
M. Shaked and J. G. Shanthikumar, Stochastic Orders, Springer Series in Statistics, Springer
2007, Chapter 2 (Mean Residual Life Orders), §2.A. https://doi.org/10.1007/978-0-387-34675-5
W. Whitt, "Uniform Conditional Stochastic Order," Journal of Applied Probability, 1980
(characterizations of IFR/DFR by the likelihood ratio order, cited by the book's remarks
section as background for the chapter's aging notions).
This series' Chunk 01 (StochasticOrders.Usual), for the usual and hazard rate orders this
chapter's own restated definitions parallel.
Introduction to Online Convex Optimization XIII: Blackwell's Approachability Theorem and Online Convex OptimizationTextbook
Motivation
Von Neumann's minimax theorem (Chapter VIII) settles two-player zero-sum games with scalar
payoffs. In 1956, Blackwell asked the natural generalization: what can a player guarantee in a
repeated game with vector-valued payoffs, where "winning" means driving the average payoff
into a target set rather than above a target value? For decades the resulting theory —
approachability — and the regret-minimization theory this book develops were believed to be
different, with approachability seen as the stronger notion. Chapter 13 closes that gap:
approachability and online convex optimization are shown to be algorithmically equivalent, each
reducible to the other with no loss of efficiency, and along the way this equivalence yields a
constructive, rate-quantified proof of Blackwell's own theorem.
Setting
A generalized vector game (Definition 13.2) is given by bounded convex closed decision sets
K1,K2 and a vector payoff u:K1×K2→Rd. A set S is approachable
(Definition 13.3) if some non-anticipating algorithm, playing in K1 against any sequence
y1,y2,⋯∈K2, drives the average payoff's distance to S to zero. Blackwell's theorem
(13.4) characterizes exactly which S are approachable via a purely geometric condition: every
column-player strategy y admits a row-player best response x landing the payoff in S.
Section 13.2 constructs an explicit approachability algorithm from any OCO algorithm: given a
best-response oracle realizing Blackwell's condition, Algorithm 37 runs the OCO algorithm on the
proxy losses ft(w)=w⊤ut−1−hS(w) (the support function hS(w)=maxx∈S{w⊤x} letting distance-to-S be written, via Lemma 13.5's minimax duality, as a
convex optimization problem over the unit ball), queries the oracle at the OCO algorithm's play
wt, and averages the resulting rewards.
Theorem 13.4 — the mission's goal (sufficiency direction only)
(∀y∈K2,∃x∈K1,u(x,y)∈S)⟹Sis approachable.
Significance
This chapter's headline claim — approachability and OCO are equivalent — is proved in two
directions in the book (§13.2 and §13.3); this mission drafts the direction the book itself
foregrounds as "the more interesting implication" and constructively proves: any sublinear-regret
OCO algorithm converts directly into an explicit approachability algorithm with an explicit
convergence rate, giving a self-contained, algorithmic proof of a 1956 game-theory theorem using
1990s–2000s online-learning machinery. Historically, this equivalence resolved a standing
misconception (approachability believed strictly stronger) and reframes Blackwell's theorem as a
special case of regret minimization rather than a separate theory requiring its own toolkit. No
prior art was found on the platform for Blackwell approachability (planning search:
q=Blackwell — the one hit, PRNGCompression.prng_no_free_lunch's cousin, an unrelated
Rao-Blackwellization result, is not a substitute); this mission drafts both items fresh.
Difficulty
Theorem 13.4's statement is a clean geometric implication, but the book is explicit that its
proof is entirely carried by Theorem 13.7 plus an unstated "explicit conclusion" left as an
exercise (the passage from a finite-horizon rate bound to the asymptotic Dist → 0 claim, using
any of the book's own sublinear-regret OCO algorithms as a witness). Theorem 13.7's own proof
combines three nontrivial facts: Lemma 13.5's minimax-duality rewriting of Dist(⋅,S) as a linear optimization over the unit ball (itself proved via Sion's minimax theorem, not
excerpted here), the best-response oracle's defining inequality (13.2) applied pointwise at each
round's wt, and the OCO algorithm's own regret guarantee applied to the specific proxy-loss
sequence ft built from the realized game trajectory — a genuine composition of three separate
pieces of machinery from earlier in the book (Chapters III–VIII), not a routine substitution.
Formalization scope
IsApproachable is declared as its own definition (per BRIEF.md's explicit instruction, since
Theorem 13.4 depends on it), with the non-anticipation clause made explicit (matching the
series' IsOnlineAlgorithm convention from Chunk 03) even though the book's own Definition 13.3
states it only informally ("x_t ← A(y_1,\dots,y_{t-1})"). SupportFunction is h_S exactly as
displayed, as a real supremum (a genuine maximum given the chapter's standing "closed, bounded"
hypothesis on S). Dist(⋅,S) throughout is Euclidean distance, rendered as Mathlib's
Metric.infDist — confirmed the chapter uses no other distance notion (checked §13.1-13.3
directly, per the pitfall BRIEF.md flags). Theorem 13.7 transcribes Algorithm 37's
ft(w)=w⊤ut−1−hS(w) construction faithfully, including its one-round offset (using the
previous round's realized reward to build the current round's proxy loss, while the
conclusion averages the current round's rewards) — exactly as the book's own pseudocode has it,
not smoothed over.
Scope decision on Theorem 13.4's biconditional. The book states Theorem 13.4 as an ↔ but
proves, and explicitly flags as proved, only the sufficiency direction (←): "The necessity of
this condition is left as an exercise... Our reductions henceforth give an explicit proof of
Blackwell's theorem [meaning: of the sufficiency direction]." Per CAPTAIN_BRIEF.md rule 6 and
BRIEF.md's explicit instruction, this mission drafts only that direction, named as such in the
goal item's own docstring; see STATUS.md.
Not formalized (out of scope for this mission, given the remaining budget and the explicit
"exercise" status of several results on these pages): the necessity direction of Theorem 13.4;
Lemma 13.5 (minimax duality for Dist, itself relying on Sion's theorem, not separately
formalized here); Lemma 13.6 (the equivalent best-response-oracle condition); §13.3's entire
approachability-to-OCO direction (Theorem 13.9, Lemma 13.8, the cone/polar-cone machinery of
§13.3.1) and §13.3.3 (existence of a best-response oracle for the constructed set); the "explicit
conclusion" of Blackwell's theorem from Theorem 13.7, left as an exercise by the book itself.
Selected references
E. Hazan, Introduction to Online Convex Optimization, 2nd ed., arXiv:1909.05207v3, Chapter 13.
D. Blackwell, "An analog of the minimax theorem for vector payoffs," Pacific Journal of
Mathematics 6(1), 1956, 1-8.
N. Abernethy, P. Bartlett, E. Hazan, "Blackwell approachability and no-regret learning are
equivalent," COLT 2011.
Introduction to Online Convex Optimization VI: Bandit Convex Optimization via Gradient EstimationTextbook
Motivation
Every algorithm in Chapters I–V observes the full cost function ft after playing xt. Many
applications only reveal the scalar cost ft(xt) incurred — routing a network and observing
total latency, or placing an ad and observing the click-through revenue, without ever seeing the
cost of a path or bid not taken. This is the bandit feedback model, and Chapter 6 asks whether
sublinear regret survives it. The chapter's answer is a general two-part reduction — turn a
first-order full-information algorithm into a bandit algorithm by feeding it an unbiased gradient
estimator built from a single scalar observation — instantiated concretely on online gradient
descent to produce the first historical bandit convex optimization algorithm, the FKM algorithm
(Flaxman–Kalai–McMahan).
Setting
Let K⊆Rn be the decision set, containing the unit ball centered at 0, with
diameter at most D. At each round t=1,…,T the player picks yt∈K, an adversary has
fixed a cost function ft (Lipschitz constant G, bounded by 1 in absolute value on K), and
the player observes only the scalar ft(yt) — never ft itself or its gradient. Regret is
∑t=1Tft(yt)−minx∈K∑t=1Tft(x), exactly as in the full-information
setting, but now the algorithm's plays are themselves random (they depend on the sampled gradient
estimates), so the guarantee is on expected regret.
The chapter's construction has two independent parts. Part 1 (Lemma 6.5) is a black-box
reduction: given any first order full-information algorithm A (Definition 6.4 — one that
depends on each cost function only through its gradient at the played point) with a full-information
regret bound BA(∇f1(x1),…,∇fT(xT)), feeding A an unbiased estimator gt
of ∇ft(xt) in place of the true gradient preserves the regret bound in expectation, up to
BA evaluated at the estimators instead of the true gradients. Part 2 (Lemma 6.7) supplies
such an estimator using only one scalar observation per round: sample u uniformly from the unit
sphere, play y=x+δu for a small radius δ, and g=δnf(y)u is
(for linear f) an unbiased estimator of ∇f(x) — more precisely, an unbiased estimator of
the gradient of f's δ-smoothed version f^δ(x)=Ev∈B[f(x+δv)], by a Stokes'-theorem identity relating a ball integral to a sphere integral.
Formalization targets
Lemma 6.5 (the reduction, milestone)
E[t=1∑Tft(xt)]−t=1∑Tft(u)≤E[BA(g1,…,gT)]
for any fixed u∈K, any first order algorithm A with full-information bound BA, and any
sequence of estimators gt with E[gt∣history through round t]=∇ft(xt).
Lemma 6.7 (the spherical estimator identity, milestone)
Eu∈S[f(x+δu)u]=nδ∇f^δ(x).
Theorem 6.9 — the mission's goal
The FKM algorithm (Algorithm 23: play yt=xt+δut, form gt=δnft(yt)ut, update xt+1=ΠKδ[xt−ηgt] on the shrunk set Kδ={z∣(1−δ)−1z∈K}) with η=D/(nT3/4), δ=1/T1/4 guarantees
Theorem 6.9's O(T3/4) rate is strictly worse than the O(T) rate of full-information
online gradient descent (Chapter III) — this gap, not a shared rate, is the chapter's real content:
bandit feedback provably costs regret, and the FKM algorithm is the historically first algorithm to
pin down how much, via the clean two-part reduction that later chapters' improved bandit algorithms
(§6.5's self-concordant-barrier method, not formalized here) all refine. Lemma 6.5 is independently
reusable: it is a template, quantified over an arbitrary first-order algorithm A and an arbitrary
unbiased-estimator family, not tied to the sphere-sampling construction that instantiates it for
Theorem 6.9. No prior art was found on the platform for bandit convex optimization, gradient-free
methods, or Frank–Wolfe-style estimators; this mission's three items formalize the standard textbook
account fresh.
Difficulty
Lemma 6.5's proof is a martingale-style argument: it introduces auxiliary deterministic functions
ht(x)=ft(x)+ξt⊤x (where ξt=gt−∇ft(xt)) whose gradient at xt is
exactly gt, applies A's full-information bound to the ht's (a genuinely random cost
sequence, since ξt is random), and then takes expectations, using unbiasedness
(E[ξt∣history]=0) to show E[ht(xt)]=E[ft(xt)] and
E[ht(u)]=ft(u) for the fixed comparator u. This requires a genuine filtration and
conditional expectation, not merely an unconditional expectation, since xt and gt are
themselves random and adapted to different points in the history. Lemma 6.7's proof invokes Stokes'
theorem to relate ∇∫Bδf(x+v)dv to ∫Sδf(x+u)∥u∥udu,
then uses the volume ratio voln(Bδ)/voln−1(Sδ)=δ/n — a
calculus fact about Euclidean balls and spheres, not itself re-derived in this mission's Lean (the
identity is drafted as the statement Lemma 6.7 asserts, to be proved from Mathlib's own
ball/sphere volume and divergence-theorem lemmas).
Formalization scope
IsFirstOrderOnlineAlgorithm formalizes only the substitution property of Definition 6.4 (the
book's second bullet); the first bullet, a closure condition on the admissible family of loss
functions, is a precondition on A's domain rather than a checkable mathematical property and is
not formalized — see MODERATION_NOTES.md. SmoothedFunction (Eq. (6.4)) and
IsUniformOnUnitSphere are declared once and shared by both milestones and the goal, rather than
re-derived inline. Lemma 6.5's history is modeled by an explicit filtration 𝓕 (with x t
adapted to 𝓕 t and g t to 𝓕 (t+1)), since Lean's conditional expectation needs a concrete
σ-algebra to condition on; the book's informal "history x1,f1,…,xt,ft" is exactly this
filtration once the (deterministic) fτ's are set aside as carrying no randomness. Kδ, the
shrunk decision set Algorithm 23 actually projects onto, is kept a separate object from K
throughout (a pitfall the chapter brief flags explicitly), and minx∈K in Theorem 6.9 is
rendered as an infimum, checked non-vacuous since K is nonempty and the objective is bounded
below on K by the chapter's own ∣ft∣≤1 assumption.
Not formalized: §6.5's self-concordant-barrier bandit linear optimization algorithm (starred,
out of the recommended goal's scope) and Corollary 6.8's ellipsoidal-sampling generalization
(a routine corollary of Lemma 6.7 the book itself derives, not independently central).
Selected references
E. Hazan, Introduction to Online Convex Optimization, 2nd ed., arXiv:1909.05207v3, Chapter 6.
A. Flaxman, A. Kalai, H.B. McMahan, "Online convex optimization in the bandit setting: gradient
descent without a gradient," SODA 2005.
Introduction to Online Convex Optimization V: RFTL and the Regret Bound of Follow-the-Regularized-LeaderTextbook
Motivation
Online convex optimization (OCO) asks a learner to repeatedly pick a point in a convex
set K, pay a cost that an adversary reveals only after the choice is made, and be judged
against the best fixed point in hindsight. Chapter III of this series formalized the
simplest general-purpose answer, online gradient descent (OGD): take a gradient step,
project back onto K. OGD's analysis, however, is tied to the Euclidean geometry of the
projection step — it treats every coordinate of K alike, and its regret bound degrades
badly when K's natural geometry is not Euclidean (the probability simplex under the
ℓ1 norm is the standard example, where a Euclidean-projection algorithm's regret
scales with n in the dimension n, while an algorithm that exploits the simplex's
own geometry attains regret scaling only with logn).
Regularized Follow the Leader (RFTL) is the meta-algorithm this chapter introduces to
fix this: rather than fixing a specific geometry, RFTL is parameterized by an arbitrary
regularization functionR, and its regret bound depends on R only through two
scalar quantities the mission makes explicit — the range of R over K, and a
R-dependent "local norm" of the gradients. Choosing R to match K's geometry (entropy
regularization on the simplex, for instance) recovers the sharp bounds that plain OGD
cannot. RFTL and its close relative Online Mirror Descent (OMD), also introduced here,
are the ancestors of essentially every regularization-based online learning algorithm in
use today, including the multiplicative-weights/Hedge algorithm of Chapter I as a special
case (entropy regularization on the simplex) and the exponentiated-gradient algorithm this
book's own Chapter VIII reuses (Corollary 5.7, a further specialization of Theorem 5.2 this
mission's Theorem 5.2 underlies). The naive "Follow the Leader" strategy this chapter opens
by refuting — always play the empirically best point so far — is a natural first idea and
provably fails: the book gives an explicit two-point cost sequence on which it incurs
regret linear in the horizon. Regularization is the fix, and quantifying exactly how much
it costs and buys is this chapter's content.
Setting
Fix a convex, nonempty decision set K in a real inner product space E and a sequence
of convex cost functions f1,f2,⋯:K→R. As in Chapter III, regret
after T rounds is
RegretT=t=1∑Tft(xt)−x⋆∈Kmint=1∑Tft(x⋆).
A regularization functionR:K→R is a strongly convex, smooth, twice
differentiable function with a positive-definite Hessian on the interior of K. Its
Bregman divergence measures the gap between R and its own first-order Taylor
approximation:
BR(x∥y)=R(x)−R(y)−∇R(y)⊤(x−y).
By the mean value theorem, BR(x∥y)=21∥x−y∥z2 for some point z on the
segment [x,y], where ∥⋅∥z is the norm induced by the Hessian ∇2R(z);
its dual norm, denoted ∥⋅∥z∗, is the local norm at z. Writing ∥⋅∥t
for the local norm between consecutive iterates xt,xt+1, the R-diameter of K
is DR2=maxx,y∈K(R(x)−R(y)).
The RFTL algorithm (Algorithm 13), with step size η>0, plays x1=argminx∈KR(x), then at every round updates
The agile Online Mirror Descent algorithm (Algorithm 14, agile version) instead
maintains a dual point yt with ∇R(y1)=0, updates it by
∇R(yt+1)=∇R(xt)−η∇t, and projects via the Bregman
divergence, xt+1=argminx∈KBR(x∥yt+1) (with x1 defined the same way
from y1). RFTL and the lazy variant of OMD coincide for linear costs (Lemma 5.5, not
formalized here — it is not used by either target); the agile variant's analysis is
genuinely different and is the mission's second target.
Formalization targets
Target (Theorem 5.2 — RFTL's regret bound)
RegretT≤2ηt=1∑T∥∇t∥t∗2+ηR(u)−R(x1),for every u∈K.
This is the mission's goal: RFTL, run with any admissible regularizer, attains a regret
bound governed only by the cumulative squared local norm of the gradients and R's range
over K. The bound is proved via two milestones: Lemma 5.3 (regret controlled by the total
"prediction drift" ∑t∇t⊤(xt−xt+1) plus DR2/η), which in turn
rests on Lemma 5.4 (a "follow-the-leader beats be-the-leader" comparison inequality, proved
by induction on the horizon).
Further target (Theorem 5.6 — agile OMD's regret bound)
RegretT≤4ηt=1∑T∥∇t∥t∗2+2ηR(u)−R(x1),for every u∈K.
A structurally similar bound for the agile variant, included as its own goal-level item
since — as the book states explicitly — its proof technique is unrelated to RFTL's, not a
corollary of it.
Both targets are the book's own tightest, non-asymptotic statements: neither is weakened to
an O(⋅) form, and the book's own further (unnumbered) corollary specializing Theorem
5.2 to a uniform local-norm bound ∥∇t∥t∗≤GR is left out, matching this
series' convention of formalizing only the numbered results.
Significance
The results themselves. Theorem 5.2 is the general regret theorem behind every
regularization scheme in online learning: instantiating R recovers the projected-gradient
bound of Chapter III (Euclidean R), the multiplicative-weights bound of Chapter I
(entropy R on the simplex), and — through the exponentiated-gradient specialization
(Corollary 5.7, not itself a target here) — the row-player regret bound this book's own
Chapter VIII cites as "Eq. (8.1)" in its reduction of zero-sum games to regret minimization.
Theorem 5.6 gives the same guarantee for an algorithm (agile OMD) that, unlike RFTL,
maintains a feasible point at every round, which the book notes is preferable in the
adaptive-regret setting of Chapter X.
Formalizing it. Both theorems have complete, elementary proofs in the source (no gaps,
no "with high probability", no hidden regularity conditions); the mission's work is
converting the analytic argument — the Bregman-divergence identity, the generalized
Cauchy-Schwarz inequality bounding the drift term by the local norm, and the two induction
arguments underlying Lemma 5.4 — into machine-checked statements. No formalization of RFTL,
OMD, or the local-norm machinery exists on the platform (checked below); the closest
Formalpedia entries state a related but distinctly narrower result.
Difficulty
The central obstacle is that the regularizer R is a hypothesis, not a fixed function:
the theorem must hold for every admissible R simultaneously, so nothing about R beyond
its stated properties (strong convexity, smoothness, twice differentiability) may be used.
A newcomer's first instinct — bound the local norm ∥∇t∥t∗ by a fixed multiple of
the Euclidean dual norm ∥∇t∥2 — fails in general and is exactly the bound RFTL is
designed to avoid needing; the whole point of the local-norm formulation is that it can be
tight for regularizers (like entropy) whose Hessian is very far from a multiple of the
identity. A second obstacle is Lemma 5.4's induction, which compares xt+1 (a minimizer
over t+1 terms) against u using the minimality of xt+1 at exactly the right
instantiation — an argument that looks almost circular until the induction hypothesis is
applied at u=xt+2, not at the theorem's free variable.
Formalization scope
K ranges over an arbitrary real, complete inner product space (a real Hilbert space),
matching Chapters III and IV, not a fixed Rn. The RFTL and agile-OMD update
rules are represented relationally (IsArgMinOn), since Mathlib has no canonical argmin
operator for a general convex set — mirroring IsMetricProjection's precedent from Chapter
III. The Hessian at the mean-value-theorem's intermediate point is represented via the
second Fréchet derivative of R's gradient map (HasFDerivAt), since Mathlib has no
dedicated Hessian type; the local dual norm is then any value satisfying the resulting
existential characterization (IsLocalDualNormSq), stated once and shared by both targets.
A boundedness hypothesis on R over K is added to Lemma 5.3's statement to keep the
R-diameter DR2 from collapsing to Mathlib's junk value for an unbounded supremum — a
condition every regularizer the book actually uses (strongly convex and smooth over a
bounded K) already satisfies, so it narrows nothing.
Trivializing formalization ruled out. A regret bound stated for an "algorithm" defined
loosely enough to include the after-the-fact optimal choice would be vacuous; IsRFTLRun
and IsOMDAgileRun instead pin down the exact history-dependent update rule of Algorithms
13 and 14 (the current gradient sequence, the current regularizer, and nothing else) as a
hypothesis, so a proof must genuinely use the specific update. Theorem 5.2 and Theorem 5.6
are kept as two separate items rather than one theorem parameterized by an algorithm choice,
since — per the chapter's own remark that their analyses are unrelated — a merged statement
would either need to branch internally on the algorithm or silently identify two genuinely
different update rules.
Reuse and prior art.OnlineConvexOpt.FirstOrder.RegretT (Chapter III, published) is
imported and reused verbatim, keeping the regret functional identical across the whole
book. Definitions specific to Chapter IV (OnlineConvexOpt.SecondOrder, not yet published)
are not imported per this series' convention that a draft cannot import another draft;
quadForm is redeclared locally instead. On the platform, BanditAlgorithm.ftrl_regret_bound,
BanditAlgorithm.mirror_descent_regret_bound, and BanditAlgorithm.ftrl_simplex_exp_weights_regret
(the Bandit Algorithms series, Chapter XII) state regret bounds for FTRL and Mirror Descent
in the linear-cost, bandit-idiom setting (a fixed linear loss ⟨a,yt⟩ at
each round, regret compared via a Bregman-divergence potential at fixed points). Hazan's
Theorem 5.2 and 5.6 are for general convexft and use the book's own local-norm
object, which has no counterpart in those statements; they are read in full and are not
faithful substitutes (different hypothesis class), so this mission drafts its own,
independent items rather than reusing them.
Shalev-Shwartz, Online Learning and Online Convex Optimization, Foundations and Trends in Machine Learning, 2012 (surveys RFTL/Mirror Descent under the name "Online Mirror Descent"). https://doi.org/10.1561/2200000018
Foundations of Reinforcement Learning V: General Decision Making and the Decision-Estimation Coefficient Lower BoundTextbook
Motivation
Online decision-making problems — multi-armed bandits, contextual bandits, structured bandits,
and episodic reinforcement learning — look superficially different but share a common shape: a
learner repeatedly acts, observes feedback, and is scored by regret against the best action in
hindsight. Foster, Kakade, Qian and Rakhlin's Foundations of Reinforcement Learning and
Interactive Decision Making (Foster & Rakhlin, arXiv:2312.16730v1) develops a unifying account of
this shape and asks a sharper question than "does this specific algorithm work?": for a given
class of possible environments, what is the best regret any algorithm can achieve? The
Decision-Estimation Coefficient (DEC), introduced by Foster, Kakade, Qian and Rakhlin (2021, "The
Statistical Complexity of Interactive Decision Making") and refined by Foster, Golowich, Qian,
Rakhlin and Sekhari (2023), was proposed as the answer: a single real-valued complexity measure
of a model class that simultaneously (i) drives a generic optimal-up-to-constants algorithm
(Estimation-to-Decisions, E2D), and (ii) lower-bounds the regret of every algorithm. Item (ii) is
what turns the DEC from "a complexity measure that happens to work for the algorithms we know"
into a genuine characterization of statistical difficulty, in the same sense that minimax rates
characterize the difficulty of estimation problems in classical statistics. This mission
formalizes that lower bound.
Setting
Chapter 6 of the book (pp. 93–128) introduces Decision Making with Structured Observations
(DMSO), a protocol general enough to subsume the contextual-bandit, structured-bandit and episodic
tabular-RL protocols of earlier chapters. Over T rounds, the learner selects a decision πt
from a decision space Π; nature draws a reward-observation pair (rt,ot) from a fixed,
unknown model M⋆(⋅∣πt), where a modelM maps each decision to a distribution
over a reward space R and an observation space O. The learner has access to a model class
M containing M⋆ (realizability). For M∈M, write fM(π):=EM,π[r] for the mean reward function and πM:=argmaxπfM(π) for the
optimal decision; regret is Reg:=∑t=1TfM⋆(πM⋆)−Eπt∼pt[fM⋆(πt)], exactly as in the bandit chapters, now for the
general model class.
Because observations, not just mean rewards, now carry information, the DEC needs a way to measure
distance between the full conditional distributions M(π) and M^(π), not just between
scalars fM(π) and fM^(π). The chapter uses the squared Hellinger distance DH2,
one of a family of Csiszár f-divergences that also includes total variation (DTV) and
Kullback-Leibler (DKL) divergence. For a reference model M^ and scale γ>0, the
general Decision-Estimation Coefficient is the min-max game value
and decγ(M):=supM^∈co(M)decγ(M,M^). This mission's Lean development (FoundationsRL.GeneralDM)
formalizes discrete versions of DTV, DH2, DKL for a finite outcome type, the DMSO
regret, and this DEC.
Formalization targets
The goal is Proposition 28 (DEC Lower Bound), p. 105:
∃c>0 (sufficiently small):∀T with decεTc(M)≥10εT,εT:=c/T,∀algorithmp,∃M∈M:regret(M,p)≥201decεTc(M)⋅T.
Here decεc is the constrained DEC (§6.5.1), a variant of the offset DEC
above that hard-constrains the information gain rather than subtracting it — a technical
refinement needed to make the lower-bound direction go through — and the "localization condition"
decεTc(M)≥10εT is a genuine hypothesis of the
proposition, not a footnote. Unlike almost every other target in this series of missions, the
statement quantifies over every algorithm rather than naming one: it is a genuine impossibility
result. Two supporting divergence facts are included as milestones because the DEC's
information-theoretic argument rests on them: Lemma 19 (DTV2≤DH2≤DKL) and
Lemma 20 (a bounded-likelihood-ratio refinement bounding DKL in terms of DH2). The
chapter's own matching upper bound, Proposition 26 (the E2D regret bound for the general DMSO
protocol, the direct analogue of Chapter 4's Proposition 13), is included as a milestone to give
the reader the matching pair the chapter presents together. Finally, Corollary 1 restates the
lower bound in terms of the localized offset DEC (combining Proposition 28 with Proposition 27),
included as a milestone showing the lower bound's reach beyond the constrained DEC alone.
Significance
Proposition 28 is what makes the DEC a genuine characterization of the statistical complexity of
interactive decision making, rather than merely a sufficient condition for a particular algorithm
family to succeed. Combined with the (uncited, technically deeper) matching upper bound for the
constrained DEC — Proposition 29, stated but not proved in the book — it shows that for any finite
model class, the constrained DEC is necessary and sufficient for low regret up to a
log∣M∣ factor in the localization radius: no complexity measure that is
substantially different from the DEC can characterize the same problems. This is the general
decision-making analogue of how minimax rates pin down statistical estimation, now for interactive
protocols with adaptive feedback.
Formalizing the lower bound is new work: no result of this shape exists on the Prove2Me platform
(searches for "decision-estimation", "general divergence", "constrained DEC" and "Hellinger" — the
last of which surfaces two related-but-distinct affinity/Le Cam bounds from a different mission on
bandit lower bounds — return no faithful prior art; see MODERATION_NOTES.md). The formal
statement is the boxed proposition; the book gives a self-contained but simplified proof (two
named simplifying assumptions, §6.5.3) and cites Foster, Golowich, Qian, Rakhlin & Sekhari (2023)
for the unrestricted argument. This mission's Lean items are draft statements (:= by sorry), not
proofs; formalizing the proof itself — a two-point adaptive testing argument using the chain rule
for KL divergence and a change-of-measure step — is the open contribution this mission proposes.
Difficulty
The obvious first attempt is to try to prove the lower bound by exhibiting one fixed pair of
hard models M,M^, as in classical two-point minimax lower bounds (Le Cam's method, Fano's
inequality). This fails here because the decision-making protocol is interactive and adaptive:
the algorithm's queries depend on what it has observed, so a model pair chosen obliviously (before
seeing the algorithm) cannot in general be made indistinguishable to every algorithm — an
adaptive algorithm can be constructed that distinguishes any two fixed models quickly by querying
where they differ. The book's proof instead selects the "hard" alternative model Mas a function
of the algorithm's own strategy (via the constrained DEC's arg max, Eq. (6.36)), so that the pair
is hard specifically for the algorithm under consideration, then uses the chain rule for KL
divergence plus the change-of-measure identity between the algorithm's induced distributions under
M and M^ to conclude that the algorithm's realized decisions must look similar under both
models — hence it cannot get low regret on both simultaneously. Every step of this argument depends
on the exact game structure of the constrained DEC, not just its numerical value; a formalization
that leaves decεc as an unconstrained real parameter (rather than the actual
inf-sup game with its information-gain constraint) would make the lower bound's conclusion
vacuous, since the hypothesis decεTc(M)≥10εT
would no longer track any actual property of M.
Formalization scope
The decision space Π and the outcome (reward, observation) alphabet Y are both taken as
finite types (Fintype); a model m:Π→Y→R is a conditional probability
vector, and a reward-extraction map rew:Y→R recovers the mean reward
fm(π)=∑ym(π)(y)⋅rew(y). hellingerSq, totalVariationDiscrete,
klDivDiscrete specialize the book's general dominating-measure divergence formula (Eq. (6.5)) to
the counting measure on this finite type; klDivDiscrete returns an ENNReal so its +∞
case (when P is not absolutely continuous w.r.t. Q) is represented honestly. The DEC, the
constrained DEC and the localized subclass are literal sInf-of-sSup/sSup-of-sSup
transcriptions of the book's min-max games — the same convention this series uses for the
Chapter-4 DEC — not opaque free real numbers, which rules out the trivializing formalization named
above.
Three deviations from this series' usual convention of pinning every constant to the value the
book's own proof derives are deliberate and disclosed. First, the numerical constant c in
εT:=c/T is explicitly called "not important" by the authors themselves
(footnote a, p. 105); it is existentially quantified (∃ c > 0) rather than pinned to a numeral.
Second — added at moderation, round 2, 2026-09-19, after the constant was found to be pinned
incorrectly — the lower bound's own multiplicative constant is also existentially quantified
(∃ c' > 0) rather than pinned to 1/20. The book's printed proof (§6.5.3, pp. 107–110) derives
1/20 (p. 110, not p. 109 as an earlier draft of this mission stated) only under two named
simplifying assumptions the theorem's hypotheses do not carry (p. 107, "Simplifications": a
class-wide bounded-curvature hypothesis, Eq. (6.34); and a bound on the unaugmentedsupM^∈Mdeccε(M,M^) rather than the officially-defined,
augmented deccε(M)=supM^∈co(M)deccε(M∪{M^},M^) this mission's decC implements). Since
augmenting either supremum's domain can only raise its value, the printed proof's bound on the
narrower, unaugmented quantity does not license a pinned 1/20 against the fully general decC
this theorem states; the book itself attributes the proof of the general statement to an external
reference (Foster, Golowich, Qian, Rakhlin & Sekhari 2023) not in this document. The existential
c' matches the book's own unpinned ≳ for Proposition 28 as printed on pp. 105–106.
Third, "any algorithm" and E[Reg(T)] are formalized, as throughout
this series, without a full stochastic-process/history model: regret is a deterministic quantity
evaluated at a fixed realized decision-distribution sequence p:FinT→Π→R, rather than an expectation over an adaptive, history-dependent algorithm's own
randomness. Formalizing the fully adaptive, measure-theoretic version of "any algorithm" — with an
explicit filtration and expectation over the induced process law PM — is future work a solver
could add; the current statement is faithful to the book's deterministic-per-realization content
but not to its full generality over randomized, history-dependent strategies. The DMSO protocol
(Def_FoundationsRL_GeneralDM_Protocol) and the DEC (Def_FoundationsRL_GeneralDM_DEC) are
restated locally rather than imported from Chapter 4's mission (FoundationsRL.Structured), since
draft items cannot import another chunk's drafts; contributions extending either mission to reuse
the other's substrate once both are published are welcome.
Selected references
Foster, D. J., Kakade, S. M., Qian, J., & Rakhlin, A. (2023). Foundations of Reinforcement
Learning and Interactive Decision Making. arXiv:2312.16730.
Foster, D. J., Kakade, S. M., Qian, J., & Rakhlin, A. (2021). The Statistical Complexity of
Interactive Decision Making. arXiv:2112.13487.
Foster, D. J., Golowich, N., Qian, J., Rakhlin, A., & Sekhari, A. (2023). A Unified Model and
Dimension for Interactive Estimation. arXiv:2306.06184.
Polyanskiy, Y., & Wu, Y. Information Theory: From Coding to Learning. Cambridge University
Press (draft edition cited by the book as [68]).