Motivation
Linear–quadratic (LQ) optimal control is the basic test case of stochastic control: a linear stochastic differential equation, a quadratic cost, and an optimal control that one expects to be a linear feedback of the state computed from a Riccati equation. In the indefinite stochastic case the weighting matrices G, Q, R carry no sign condition. The cost can then be convex without being uniformly convex, an optimal control may fail to exist although the value is finite, and the Riccati equation may have no solution of the kind the classical theory needs.
Sun, Li and Yong (SIAM J. Control Optim. 54 (2016) 2274–2308) separate finiteness, convexity, open-loop solvability and closed-loop solvability for this problem. This mission covers their Section 6. Under uniform convexity the optimal control is the Riccati feedback of Corollary 4.7. Section 6 removes uniform convexity: it regularizes the control weight R to R+εI, takes the Riccati feedback control uε of each regularized problem, and shows that open-loop solvability of the original problem is exactly the convergence of uε along some sequence εk→0.
Timeline. Chen, Li and Zhou (SIAM J. Control Optim. 36 (1998)) introduced indefinite stochastic LQ problems. Ait Rami, Moore and Zhou (SIAM J. Control Optim. 40 (2002)) introduced the generalized Riccati equation with a pseudoinverse. Sun and Yong (SIAM J. Control Optim. 52 (2014)) characterized closed-loop solvability by regular solutions of that equation. In 2016 Sun, Li and Yong characterized uniform convexity by strongly regular solutions and open-loop solvability by the regularized feedback sequence treated here.
Setting
Fix a horizon T>0 and a probability space carrying a one-dimensional standard Brownian motion W, with F the augmented natural filtration of W. For an initial pair (t,x)∈[0,T)×Rn and an admissible control u∈U[t,T], an F-progressively measurable Rm-valued process with E∫tT∣u∣2ds<∞, the state solves
dX=(AX+Bu+b)ds+(CX+Du+σ)dW,X(t)=x.
The cost is
J(t,x;u)=E[⟨GX(T),X(T)⟩+2⟨g,X(T)⟩+∫tT(⟨QX,X⟩+2⟨SX,u⟩+⟨Ru,u⟩+2⟨q,X⟩+2⟨ρ,u⟩)ds].
The coefficients A,B,C,D,Q,S,R and G are deterministic, b,σ,q,ρ,g are random, and the integrability conditions are (H1)–(H2). The value function is V(t,x)=infuJ(t,x;u)∈[−∞,∞). A control u∗ is open-loop optimal at (t,x) if J(t,x;u∗)≤J(t,x;u) for every u∈U[t,T]. Problem (SLQ)0 is the case b,σ,g,q,ρ=0, with cost J0.
For ε>0 let Pε be the strongly regular solution of the Riccati equation (5.7),
P˙ε+PεA+A⊤Pε+C⊤PεC+Q−Kε⊤Σε−1Kε=0,Pε(T)=G,
where Σε=R+εI+D⊤PεD≥λI for some λ>0 and Kε=B⊤Pε+D⊤PεC+S. Let (ηε,ζε) be the adapted solution of the linear backward equation (4.11) for these data, and put
Θε=−Σε−1Kε,vε=−Σε−1(B⊤ηε+D⊤ζε+D⊤Pεσ+ρ).
With Xε the solution of the closed-loop system dXε=[(A+BΘε)Xε+Bvε+b]ds+[(C+DΘε)Xε+Dvε+σ]dW, Xε(t)=x, the regularized feedback sequence is
uε=ΘεXε+vε,ε>0.
U[t,T]=LF2(t,T;Rm) is a Hilbert space with inner product E∫tT⟨u,v⟩ds; weak and strong convergence of controls refer to it.
Formalization targets
Goal: Theorem 6.2
Assume (H1)–(H2) and that u↦J0(0,0;u) is convex. For (t,x)∈[0,T)×Rn the following are equivalent:
(SLQ) is open-loop solvable at (t,x)⟺∃εk↓0: uεk⇀u∗⟺∃εk↓0: uεk→u∗ in U[t,T],
and every weak or strong limit of such a subsequence is an open-loop optimal control at (t,x). The goal assumes convexity, not uniform convexity, and no finiteness.
Milestones
- Corollary 3.4: convexity of J(t,x;⋅) or J0(t,x;⋅) at one x, at every x, and J0(t,0;u)≥0 on U[t,T] are equivalent.
- The zero extension (4.3): J0(t,0;u)=J0(0,0;0I[0,t)⊕u).
- Corollary 4.7: under uniform convexity, the Riccati feedback control (4.28) is the unique open-loop optimal control.
- Theorem 6.1: if the problem is finite, limε→0+J(t,x;uε)=V(t,x).
- Lemma 6.3: in a Hilbert space the norm is weakly lower semicontinuous, and strong convergence is weak convergence plus convergence of norms.
- (6.7): E∫tT∣uε∣2ds≤(Vε−V)/ε≤E∫tT∣v∗∣2ds for any optimal v∗.
- Weak lower semicontinuity of u↦J(t,x;u).
Two further statements follow the goal: open-loop solvability is equivalent to supε>0E∫tT∣uε∣2ds<∞ (p. 2303), and Proposition 6.4: if supε>0∫0T∣Θε∣2ds<∞, the Riccati equation (4.6) has a regular solution and Problem (SLQ)0 is closed-loop solvable.
Significance
Theorem 6.1 gives a minimizing sequence computed from Riccati and backward equations whenever the problem is finite. Theorem 6.2 turns it into a test for open-loop solvability that needs no uniform convexity and no regular solution of the original Riccati equation. When an optimal control exists, it is recovered as the limit of feedback controls. Proposition 6.4 converts a bound on the gains Θε into closed-loop solvability of the homogeneous problem. Section 7 of the paper shows that open-loop solvability does not imply closed-loop solvability, so a criterion phrased directly in open-loop terms is needed.
All of these results are proved in the paper. None of them, nor the solution theory of stochastic LQ problems they rest on, had a machine-checked proof on Prove2Me or in Mathlib as of October 2026. A formal development needs the well-posedness of linear SDEs and BSDEs with integrable coefficients, the Riccati theory of Section 4, and the Hilbert-space structure of the space of admissible controls. Those parts are reusable for any stochastic LQ problem.
Difficulty
The obvious approach takes any minimizing sequence and extracts a weakly convergent subsequence. That fails without uniform convexity: a minimizing sequence need not be bounded, and boundedness is exactly what open-loop solvability provides in (6.7). The converse direction needs the limit of the regularized costs to identify the value, which requires both the minimizing property of uε (Theorem 6.1) and weak lower semicontinuity of J. That in turn rests on convexity being transported from J0(0,0;⋅) to J(t,x;⋅) through Corollary 3.4 and the zero extension. Upgrading weak to strong convergence uses the norm bound (6.7) with the limit itself as the optimal control. Every step depends on Corollary 4.7, the Riccati representation of the optimal control of the regularized problem, whose proof requires the theory of Section 4.
Formalization scope
The probability basis is a probability space with a one-dimensional standard Brownian motion and its augmented natural filtration. Vectors are Fin k → ℝ and matrices Matrix (Fin k) (Fin l) ℝ. Time is ℝ≥0, and ∣u∣2 is the Euclidean dot product u ⬝ᵥ u. (H1)–(H2) are standing assumptions, with entrywise Lp conditions on the matrix coefficients. The state from (t,x) is a strong solution of the published SDE notion Peng1990.SMP.SolvesSDE whose coefficients are switched on at t; it has a.s. continuous paths and Esup∣X∣2<∞. The cost is evaluated along a chosen solution, which is unique. V is an infimum in the extended reals. Limits in ε are taken as ε→0+. "A subsequence" is a sequence εk>0 with εk→0, and the limit control is required to be admissible. The backward equations use the published Peng1990.SMP.SolvesBSDE, and the pseudoinverse in (4.6) and (4.11) is the published HarmonicGames.Decomposition.pinv.
Theorem 6.1 prints the term −Θε⊤ρ in its backward equation. The equation (4.11) that its proof uses through Corollary 4.7 has +Θε⊤ρ, and the formalization uses (4.11). Corollary 3.4 is stated without its item (vi), which involves an operator M2(t) that the paper quotes from another source.
The families Pε, (ηε,ζε) and Xε are hypotheses pinned by their equations for every ε>0. The sequence uε is therefore the Riccati feedback sequence (6.2), never an arbitrary minimizing sequence or an arbitrary family of ε-optimal controls; with such a family the implication (ii) ⇒ (i) would be a different theorem.
Contributions are welcome at every level: the solution theory of linear SDEs and BSDEs, Itô's formula for quadratic forms, Riccati and Lyapunov equations in integral form, weak compactness in LF2, and the milestones themselves.
Selected references
- J. Sun, X. Li, J. Yong, Open-loop and closed-loop solvabilities for stochastic linear quadratic optimal control problems, SIAM J. Control Optim. 54(5) (2016) 2274–2308. https://doi.org/10.1137/15M103532X
- J. Sun, J. Yong, Linear quadratic stochastic differential games: open-loop and closed-loop saddle points, SIAM J. Control Optim. 52(6) (2014) 4082–4121. https://doi.org/10.1137/140953642
- S. Chen, X. Li, X. Y. Zhou, Stochastic linear quadratic regulators with indefinite control weight costs, SIAM J. Control Optim. 36(5) (1998) 1685–1702. https://doi.org/10.1137/S0363012996310478
- M. Ait Rami, J. B. Moore, X. Y. Zhou, Indefinite stochastic linear quadratic control and generalized differential Riccati equation, SIAM J. Control Optim. 40(4) (2002) 1296–1311. https://doi.org/10.1137/S0363012900371083
- S. Peng, A general stochastic maximum principle for optimal control problems, SIAM J. Control Optim. 28(4) (1990) 966–979. https://doi.org/10.1137/0328054