Duality and Stability in Extremum Problems Involving Convex Functions 3: If f Is Finite at x and g Is Finite and Continuous at Ax, Then (P) Is Stably Set and inf (P(z)) Is Continuous Near z = 0Research Paper
Motivation
A convex program is useful in practice only if its optimal value responds reasonably to small changes in the data. Lagrangian and Fenchel duality theory makes this precise: the dual problem attains its optimum and has no duality gap exactly when the primal value function does not fall off infinitely steeply under small perturbations. A constraint qualification is a checkable condition on the data that guarantees this good behaviour; Slater's condition (a strictly feasible point) is the best-known example in finite dimensions.
R. T. Rockafellar's 1967 paper Duality and Stability in Extremum Problems Involving Convex Functions (Pacific J. Math. 21 (1967) 167–187) develops Fenchel-type duality for the problem of minimizing in general locally convex spaces. It introduces the notion of a stably set problem, shows that stability is equivalent to strong duality with an attained dual optimum (its Theorem 3), and gives in Theorem 1 a general sufficient condition for stability. Theorem 1 is the infinite-dimensional analogue of Slater's condition and is the form in which the result is usually applied: one exhibits a single point where is finite and is finite and continuous.
Timeline. Fenchel (1951) proved the duality theorem for in under relative-interior conditions. Brøndsted (1964) and Moreau (1966–67) extended conjugate duality to paired locally convex spaces. Rockafellar's 1967 paper (this mission) added the linear map , the perturbation function , the notion of stability, and Theorem 1. The perturbational approach was later systematized in Rockafellar's Conjugate Duality and Optimization (SIAM, 1974).
Setting
Let and be real locally convex Hausdorff topological vector spaces and a continuous linear map. Let and .
- is convex if its epigraph is a convex subset of ; it is proper if for all and for some . is concave if is convex, and proper concave if everywhere and somewhere.
- Throughout, is lower semicontinuous proper convex and is upper semicontinuous proper concave. Their effective domains are and .
- The primal problem is
and its perturbations are : minimize , for . The perturbation function is , so . is consistent if .
- When is finite, the directional derivative is .
- is unstably set if is finite and every neighbourhood of contains vectors with a negative number of arbitrarily large magnitude ( included). is stably set if it is consistent but not unstably set.
Formalization targets
Goal: Theorem 1 (p. 175)
Suppose there exists such that is finite at and is finite and continuous at . Then
The neighbourhood is left unspecified, as in the paper.
Milestones (in the order the proof uses them)
- (4.4) .
- (4.5) meets , and .
- Epigraph of has interior (p. 176): the hypograph has nonempty interior, lies in the epigraph of for every in the epigraph of , and so the epigraph of has nonempty interior.
- Continuity on the interior of the domain (p. 176): and is continuous there.
- (4.6) For a convex with finite: and for all .
Significance
The result. Combined with the paper's Theorem 3, Theorem 1 yields: if is finite at some where is finite and continuous at , then , with the dual maximum attained. This is the standard sufficient condition for Fenchel–Rockafellar duality in infinite dimensions, used in calculus of variations, optimal control, and the convex analysis of integral functionals. The continuity half of Theorem 1 says that the optimal value depends continuously on translations of the constraint data near the unperturbed problem, a basic sensitivity statement.
Formalizing it. The theorem is proved (1967) and appears in many textbooks, but there is no machine-checked version on this platform. Mathlib contains continuity criteria for real-valued convex functions on open sets of normed or finite-dimensional spaces (ConvexOn.continuousOn_tfae, ConvexOn.continuousOn_interior), but nothing for extended-real-valued convex functions on general topological vector spaces, no perturbation function, and no notion of a stably set problem. A complete development would provide reusable infrastructure: the epigraph-interior continuity criterion for -valued convex functions and the elementary calculus of one-sided directional derivatives.
Difficulty
The obvious argument says: is continuous at , so is bounded above near , hence is continuous at and its directional derivatives are bounded. Two steps of this fail without care. First, the passage from "bounded above near a point" to "continuous" requires convexity of (Lemma 2 of the paper, proved in the companion mission) and a continuity criterion valid in an arbitrary topological vector space, with values in ; the normed-space proofs in Mathlib do not apply. Second, may take the value , and the derivative may be in some directions; the bookkeeping of extended-real arithmetic (where is not defined mathematically and is given a junk value in Lean) has to be done honestly. Finally, upper bounds on must be converted into lower bounds, which is where the second inequality of (4.6) enters; an upper bound alone does not give stability.
Formalization scope
All values are in Lean's EReal. Convexity is convexity of the epigraph with real second coordinate (the paper's definition, p. 170); concavity is convexity of . Properness is stated as in the paper. The perturbation function is the EReal infimum ⨅ x, f x - g (A x - z); under properness the undefined form never arises. The directional derivative (4.3) is the lower limit of the difference quotient along , which equals the paper's limit whenever it exists (always, for convex with finite). "Unstably set" quantifies over all neighbourhoods of and all real , with allowing . "Stably set" is together with "not unstably set", so is stably set, as the paper says on p. 176. Continuity is with respect to the order topology of EReal, and "continuous at " is continuity of itself at that point, not of its restriction to .
The paper's standing setting (§3) includes dual spaces , the adjoint and the conjugates . Neither Theorem 1 nor its proof uses them, so they are omitted and the theorem is stated for every pair of real locally convex Hausdorff spaces, which includes every paired setting. The lower and upper semicontinuity of and are standing hypotheses of the paper and are kept, although the proof does not use them. Inequality (4.6) is stated for an arbitrary convex function finite at , the generality in which the paper invokes it. No statement was repaired.
A definition of "stably set" that already presumed finiteness or continuity of near , or that tested the derivative only in a fixed set of directions, would make the first conclusion of Theorem 1 trivial; the definition used here is the paper's p. 175 definition verbatim, applied to an arbitrary function . The definitions are local to this mission; the companion missions on Theorem 3 and Theorem 6 of the same paper define the same objects in their own namespaces. Contributions are welcome on the milestones in any order, and in particular on a general continuity criterion for extended-real-valued convex functions on topological vector spaces, which is reusable well beyond this mission.
Selected references
- R. T. Rockafellar, Duality and stability in extremum problems involving convex functions, Pacific J. Math. 21 (1967) 167–187. https://doi.org/10.2140/pjm.1967.21.167
- A. Brøndsted, Conjugate convex functions in topological vector spaces, Mat.-Fys. Medd. Dansk. Vid. Selsk. 34 (1964), no. 2.
- W. Fenchel, Convex Cones, Sets and Functions, lecture notes, Princeton University, 1951.
- J. J. Moreau, Fonctionnelles convexes, Séminaire Leray, Collège de France, 1966–67.
- R. T. Rockafellar, Conjugate Duality and Optimization, CBMS-NSF Regional Conference Series in Applied Mathematics 16, SIAM, 1974. https://doi.org/10.1137/1.9781611970524