Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Dynamical Systems

166 missions · 73 completed

Missions

Open93Completed73All166
🏆Completed
Control TheoryGraph TheoryLinear algebra·Captain: mikedeng1

On Controllability of Delayed Boolean Control Networks: Trajectory Controllability Avoiding Forbidden Trajectories Iff the Reduced Transition-Count Matrix Is IrreducibleResearch Paper

Motivation

Boolean networks model gene regulatory networks by giving each gene an on/off value and updating all values synchronously by logical rules (Kauffman, 1969). Adding external Boolean inputs gives Boolean control networks (BCNs), in which a designer (a drug, an intervention) chooses the inputs over time. The basic control-theoretic question is controllability: can the inputs drive the network from any configuration to any other? Cheng and Qi (Automatica 2009) answered it for BCNs using the semi-tensor product of matrices, which rewrites a BCN as a linear recursion on canonical basis vectors.

Biological regulation is not instantaneous: transcription and translation introduce delays, so the next value of a gene can depend on several past values. Lu, Zhong, Ho, Tang and Cao (SIAM J. Control Optim. 2016) study delayed BCNs, in which the update reads the last μ\muμ states, and give criteria for two kinds of controllability, including the case where some configurations are dangerous and must be avoided (in biology, states corresponding to disease). The mission formalizes their criteria.

Setting

Write D={0,1}\mathcal D=\{0,1\}D={0,1}. A state is x=(x1,…,xn)∈Dnx=(x_1,\dots,x_n)\in\mathcal D^nx=(x1​,…,xn​)∈Dn and an input value is u∈Dmu\in\mathcal D^mu∈Dm. Fix μ≥1\mu\ge1μ≥1. The delayed BCN (2.2) is

xi(t+1)=fi(u(t),x(t−μ+1),…,x(t)),i=1,…,n,x_i(t+1)=f_i\big(u(t),x(t-\mu+1),\dots,x(t)\big),\qquad i=1,\dots,n,xi​(t+1)=fi​(u(t),x(t−μ+1),…,x(t)),i=1,…,n,

with arbitrary Boolean functions fi:Dm+μn→Df_i:\mathcal D^{m+\mu n}\to\mathcal Dfi​:Dm+μn→D, collected into one map FFF with x(t+1)=F(u(t),X(t))x(t+1)=F(u(t),X(t))x(t+1)=F(u(t),X(t)). A trajectory is the window X(t)=(x(t−μ+1),…,x(t))X(t)=(x(t-\mu+1),\dots,x(t))X(t)=(x(t−μ+1),…,x(t)) of the last μ\muμ states; its last entry is the current state. One step maps X(t)X(t)X(t) under the input u(t)u(t)u(t) to X(t+1)=(x(t−μ+2),…,x(t+1))X(t+1)=(x(t-\mu+2),\dots,x(t+1))X(t+1)=(x(t−μ+2),…,x(t+1)). A control sequence of length kkk is U=(u(0),…,u(k−1))U=(u(0),\dots,u(k-1))U=(u(0),…,u(k−1)), with inputs chosen freely; y(i)=X(i)y(i)=X(i)y(i)=X(i) denotes the trajectory after iii steps from an initial trajectory y(0)y(0)y(0).

The transition-count matrix QQQ has rows and columns indexed by trajectories: Qb,aQ_{b,a}Qb,a​ is the number of input values uuu taking trajectory aaa to trajectory bbb in one step. For a set CtC_tCt​ of forbidden trajectories, QCtQ_{C_t}QCt​​ is QQQ with the rows and columns of CtC_tCt​ replaced by zeros, and QCt\mathbb Q_{C_t}QCt​​ is QQQ with those rows and columns deleted.

The notions of controllability are:

  • Trajectory controllable (Definition 3.1): from every initial trajectory, every trajectory XdX_dXd​ equals X(k)X(k)X(k) for some k≥1k\ge1k≥1 and some control sequence.
  • Trajectory controllable under CtC_tCt​ (Definition 3.11): for all trajectories a,b∉Cta,b\notin C_ta,b∈/Ct​ there are k≥0k\ge0k≥0 and a control sequence steering y(0)=ay(0)=ay(0)=a to y(k)=by(k)=by(k)=b with y(i)∉Cty(i)\notin C_ty(i)∈/Ct​ for i=0,…,ki=0,\dots,ki=0,…,k.
  • State controllable (Definition 4.1): from every initial trajectory, every state equals x(k)x(k)x(k) for some k>0k>0k>0 and some control sequence.

A real square matrix AAA of size N≥2N\ge2N≥2 is reducible (Definition 3.7) if a simultaneous permutation of rows and columns brings it to block upper-triangular form (A11A120A22)\begin{pmatrix}A_{11}&A_{12}\\0&A_{22}\end{pmatrix}(A11​0​A12​A22​​) with square diagonal blocks; it is irreducible otherwise, so every 1×11\times11×1 matrix is irreducible.

N1(k;ya,yb,Ct)\mathbb N_1(k;y_a,y_b,C_t)N1​(k;ya​,yb​,Ct​) counts the control sequences of length kkk steering yay_aya​ to yby_byb​ while avoiding CtC_tCt​; N2(k;a,bs)\mathbb N_2(k;a,b_s)N2​(k;a,bs​) counts those steering the initial trajectory aaa to x(k)=bsx(k)=b_sx(k)=bs​; Ξμp\Xi^{p}_\muΞμp​ is the set of trajectories with current state ppp.

Formalization targets

Goal: Theorem 3.12

the delayed BCN is trajectory controllable under Ct  ⟺  QCt is irreducible,\text{the delayed BCN is trajectory controllable under } C_t\iff \mathbb Q_{C_t}\ \text{is irreducible},the delayed BCN is trajectory controllable under Ct​⟺QCt​​ is irreducible,

for every μ≥1\mu\ge1μ≥1, nnn, mmm, every update map and every forbidden set CtC_tCt​. It is the most general criterion of the paper.

Milestones

  • Proposition 3.5: for k>0k>0k>0, N1(k;ya,yb,Ct)=ybT(QCt)kya\mathbb N_1(k;y_a,y_b,C_t)=y_b^{\mathsf T}(Q_{C_t})^ky_aN1​(k;ya​,yb​,Ct​)=ybT​(QCt​​)kya​.
  • Remark 3: N1(k;ya,yb)=ybTQkya\mathbb N_1(k;y_a,y_b)=y_b^{\mathsf T}Q^ky_aN1​(k;ya​,yb​)=ybT​Qkya​.
  • Theorem 3.10: trajectory controllable   ⟺  \iff⟺ QQQ irreducible.
  • Theorem 4.3: N2(k;a,bs)=∑b∈ΞμbsbTQka\mathbb N_2(k;a,b_s)=\sum_{b\in\Xi^{b_s}_\mu}b^{\mathsf T}Q^kaN2​(k;a,bs​)=∑b∈Ξμbs​​​bTQka.
  • Theorem 5.1: the same count while avoiding forbidden states CsC_sCs​, with QQQ zeroed on the trajectories containing a state of CsC_sCs​.
  • Corollary 5.3: trajectory controllability implies state controllability.

A supporting item, Lemma 3.9 (corrected form), relates Definition 3.7 to positivity of entries of powers for nonnegative matrices of size at least 2.

Significance

The criteria replace a question about control sequences of unbounded length by a finite test on one nonnegative integer matrix of size 2μn2^{\mu n}2μn. The counting identities give more than a yes/no answer: they enumerate the control sequences achieving a transfer, which is what a designer choosing among interventions needs, and they handle forbidden states by passing to forbidden trajectories.

The results are proved in the paper; none of them has a machine-checked proof. Formalizing them yields a reusable Lean model of delayed (and, for μ=1\mu=1μ=1, ordinary) Boolean control networks defined directly through their dynamics, together with a checked bridge from dynamic reachability to the combinatorics of nonnegative matrices. A formal version also pins down points the printed text leaves loose: Lemma 3.9 as printed is false (it characterizes primitive, not irreducible, matrices), and the two different matrices QCtQ_{C_t}QCt​​ (zeroed) and QCt\mathbb Q_{C_t}QCt​​ (deleted) must not be confused.

Difficulty

The central step is the passage between three objects: reachability under the dynamics, positivity of entries of powers of QQQ, and the block-triangular definition of irreducibility. The counting identity for powers of QQQ is a statement about sequences of inputs, not about paths in a graph, so the bijection between control sequences and weighted walks has to be established with the avoidance constraint carried at every intermediate time, including the endpoints. The equivalence between Definition 3.7 and strong connectivity is the classical graph-theoretic characterization, but it has edge cases the obvious argument misses: a 1×11\times11×1 zero matrix is irreducible by Definition 3.7 yet has no positive power, which is exactly why Definition 3.11 allows k=0k=0k=0 while Definition 3.1 does not. A proof that routes through "some power of QCt\mathbb Q_{C_t}QCt​​ is entrywise positive", following the printed Lemma 3.9, proves a false intermediate statement.

Formalization scope

Conventions committed to in Lean:

  • A state is Fin n → Bool (true is the paper's 1); a trajectory is Fin μ → State n with index 0 the oldest state and index μ−1\mu-1μ−1 the current state; μ≥1\mu\ge1μ≥1 is a standing assumption (NeZero μ); n,m≥0n,m\ge0n,m≥0 are arbitrary and no assumption is placed on the update functions.
  • Matrices are indexed by trajectories rather than by the paper's index jjj of δ2μnj\delta^j_{2^{\mu n}}δ2μnj​. The paper's Q=L⋉12mQ=L\ltimes\mathbf 1_{2^m}Q=L⋉12m​ is obtained by the simultaneous relabelling of Lemma 2.6, and every statement (entries of powers, sums over sets of trajectories, Definition 3.7) is invariant under it. QCt\mathbb Q_{C_t}QCt​​ is indexed by the subtype of allowed trajectories.
  • Irreducibility is Definition 3.7 applied to the matrix with entries cast to R\mathbb RR; it is not Mathlib's Matrix.IsIrreducible, which differs on 1×11\times11×1 matrices.
  • Pinned readings: Definition 3.1 and Definition 4.1 use k≥1k\ge1k≥1; Definition 3.11 uses k≥0k\ge0k≥0; Proposition 3.5, Theorem 4.3 and Theorem 5.1 are stated for k>0k>0k>0 (Proposition 3.5 is false at k=0k=0k=0 when ya=yb∈Cty_a=y_b\in C_tya​=yb​∈Ct​); Remark 3 holds for all k≥0k\ge0k≥0. "Avoiding CsC_sCs​" in Theorem 5.1 means that no state x(i)x(i)x(i), i=1−μ,…,ki=1-\mu,\dots,ki=1−μ,…,k, lies in CsC_sCs​, which is the theorem's own middle term N1(k;a,b,ΞCs)\mathbb N_1(k;a,b,\Xi^{C_s})N1​(k;a,b,ΞCs​). Ξμp\Xi^p_\muΞμp​ is defined semantically by eq. (4.3), since the printed index range in (4.4) is a misprint. Lemma 3.9 is included in corrected form with N≥2N\ge2N≥2.

Controllability is defined through the dynamics and control sequences, never as positivity of entries of powers of QQQ; a formalization that defines reachability by (Qk)b,a>0(Q^k)_{b,a}>0(Qk)b,a​>0 would reduce Theorems 3.10 and 3.12 to library facts and is ruled out.

Needed infrastructure: the correspondence between control sequences and products of entries of QQQ (the core of Proposition 3.5), and the equivalence of Definition 3.7 with strong connectivity of the support graph for nonnegative matrices (Mathlib's Matrix.IsIrreducible, Matrix.isIrreducible_iff_exists_pow_pos and Matrix.pow_apply_pos_iff_nonempty_path cover much of the second part for sizes at least 2). Both are reusable beyond this mission, for ordinary BCNs, probabilistic BCNs and finite automata. Contributions of either piece, or of the semi-tensor-product bridge identifying QQQ with L⋉12mL\ltimes\mathbf 1_{2^m}L⋉12m​, are welcome.

Selected references

  • J. Lu, J. Zhong, D. W. C. Ho, Y. Tang, J. Cao, On Controllability of Delayed Boolean Control Networks, SIAM J. Control Optim. 54(2):475–494, 2016. https://doi.org/10.1137/140991820
  • D. Cheng, H. Qi, Controllability and observability of Boolean control networks, Automatica 45(7):1659–1667, 2009. https://doi.org/10.1016/j.automatica.2009.03.006
  • S. A. Kauffman, Metabolic stability and epigenesis in randomly constructed genetic nets, J. Theoret. Biol. 22(3):437–467, 1969. https://doi.org/10.1016/0022-5193(69)90015-0
  • A. Berman, R. J. Plemmons, Nonnegative Matrices in the Mathematical Sciences, SIAM Classics in Applied Mathematics 9, 1994. https://doi.org/10.1137/1.9781611971262
9 thms3 active usersReviewed
🏆Completed
Group Theory·Captain: dbenbenn

Cannon–Floyd–Parry: Thompson's group F and the simplicity of its commutator subgroupTextbook

Motivation

This mission formalizes §4 of Cannon, Floyd and Parry's Introductory notes on Richard Thompson's groups, together with the definition of Thompson's group FFF from their §1. The goal is their Theorem 4.5: the commutator subgroup [F,F][F,F][F,F] is simple.

In the 1960s Richard Thompson defined three groups, now written FFF, TTT and VVV, whose properties have kept them in use ever since as a source of examples at the edge of what groups can do. FFF is the smallest of the three and the least understood. It is finitely presented (§3 of the source) and torsion-free, it has no free subgroup of rank two, and whether it is amenable — whether it carries a finitely additive left-invariant probability measure defined on all its subsets — is open. Cannon, Floyd and Parry record (§4, p. 227) that Geoghegan raised the question and conjectured in 1979 both that FFF contains no non-Abelian free subgroup and that FFF is not amenable.

That question is what makes FFF worth pinning down precisely. Write AGAGAG for the class of amenable discrete groups, EGEGEG for the elementary amenable ones, and NFNFNF for the groups with no free subgroup of rank two. That AG⊂NFAG \subset NFAG⊂NF was noted by Day and follows from von Neumann; whether it is strict is the von Neumann–Day problem. It is: Olshanskii proved AG≠NFAG \neq NFAG=NF in a 1984 ICM address and Gromov gave an independent proof — but by examples that are not finitely presented. Brin and Squier proved in 1985 that F∈NFF \in NFF∈NF, and FFF is not elementary amenable (Theorem 4.10 of the source, CannonFloydParry.not_elementaryAmenable_F). So FFF is a finitely presented group in AG∖EGAG \setminus EGAG∖EG if it is amenable and in NF∖AGNF \setminus AGNF∖AG if it is not — a question with no other finitely presented candidate.

Setting

Call a real number dyadic if it has the form m/2km/2^{k}m/2k with m∈Zm \in \mathbb{Z}m∈Z and k∈Nk \in \mathbb{N}k∈N.

Thompson's group FFF, as §1 of the source defines it, is the set of piecewise linear homeomorphisms of the closed unit interval [0,1][0,1][0,1] onto itself that are differentiable except at finitely many dyadic rationals, and whose derivatives, where they exist, are powers of 222. Since those derivatives are positive, every element preserves orientation, so the elements of FFF are increasing. Composition of two such maps is again one, and so is the inverse of one, so FFF is a group.

The formalization calls such a map piecewise linear over the dyadics, and defines FFF as the subgroup generated by those maps — so that closure under composition and inverses is a theorem rather than part of the construction, as the source has it. What the model fixes rather than derives is under Formalization scope below.

Two particular elements generate it. Write

A(x)={x/20≤x≤12x−1412≤x≤342x−134≤x≤1B(x)={x0≤x≤12x/2+1412≤x≤34x−1834≤x≤782x−178≤x≤1.A(x) = \begin{cases} x/2 & 0 \le x \le \tfrac12\\ x - \tfrac14 & \tfrac12 \le x \le \tfrac34\\ 2x-1 & \tfrac34 \le x \le 1\end{cases} \qquad B(x) = \begin{cases} x & 0 \le x \le \tfrac12 \\ x/2 + \tfrac14 & \tfrac12 \le x \le \tfrac34 \\ x - \tfrac18 & \tfrac34 \le x \le \tfrac78 \\ 2x-1 & \tfrac78 \le x \le 1.\end{cases}A(x)=⎩⎨⎧​x/2x−41​2x−1​0≤x≤21​21​≤x≤43​43​≤x≤1​B(x)=⎩⎨⎧​xx/2+41​x−81​2x−1​0≤x≤21​21​≤x≤43​43​≤x≤87​87​≤x≤1.​

An element of FFF is trivial near 000 if it fixes every point of some interval [0,ε)[0,\varepsilon)[0,ε), and trivial near 111 if it fixes every point of some (1−ε,1](1-\varepsilon, 1](1−ε,1]. The support of fff is the set of points of [0,1][0,1][0,1] that fff moves. The commutator convention throughout is [x,y]=xyx−1y−1[x,y] = xyx^{-1}y^{-1}[x,y]=xyx−1y−1, and [F,F][F,F][F,F] denotes the commutator subgroup.

Formalization targets

Goal

[F,F] is a simple group.[F,F] \ \text{is a simple group.}[F,F] is a simple group.

This is the capstone of §4: it says the commutator subgroup has no normal subgroup other than itself and the trivial one. It is the goal because the rest of the section feeds it — both halves of Theorem 4.1, Theorem 4.3, and both supporting lemmas below are consumed by its proof.

Theorem 4.1, which has two parts

[F,F]  =  { f∈F:f is trivial near 0 and near 1 }[F,F] \;=\; \{\, f \in F : f \text{ is trivial near } 0 \text{ and near } 1 \,\}[F,F]={f∈F:f is trivial near 0 and near 1} F/[F,F]  ≅  Z⊕ZF/[F,F] \;\cong\; \mathbb{Z} \oplus \mathbb{Z}F/[F,F]≅Z⊕Z

Theorem 4.3

N⊴F, N≠1  ⟹  F/N is AbelianN \trianglelefteq F,\ N \neq 1 \;\Longrightarrow\; F/N \text{ is Abelian}N⊴F, N=1⟹F/N is Abelian

So FFF has no interesting proper quotients at all. With the first part of Theorem 4.1 this forces every nontrivial normal subgroup of FFF to contain [F,F][F,F][F,F].

Supporting results

That the piecewise-linear maps are already closed under composition and inverses, so that FFF consists of exactly those maps; a transitivity lemma on dyadic partitions of [0,1][0,1][0,1]; the fact that the subgroup of elements supported in a dyadic interval [a,b][a,b][a,b] of dyadic length is isomorphic to FFF itself; triviality of the center; that FFF contains no non-Abelian free group; and that FFF admits a total order invariant under multiplication on both sides.

Significance

What the results give. Theorem 4.1 identifies [F,F][F,F][F,F] concretely — a subgroup defined by a global algebraic condition turns out to be cut out by local behavior at the two endpoints — and computes the abelianization, making the pair of endpoint slopes a complete invariant of FFF modulo commutators. Theorem 4.3 and the simplicity of [F,F][F,F][F,F] together determine the whole normal subgroup lattice: every normal subgroup of FFF is trivial or contains [F,F][F,F][F,F]. That lattice is the input to the elementary-amenability argument.

What formalizing adds. All of these are proved in the source; none is in Mathlib, which has no piecewise-linear homeomorphism API and no Thompson group. Four of the milestones are proved as part of this proposal: that the piecewise-linear maps form a subgroup, that elements of FFF permute the dyadic rationals, that FFF embeds in the group Brin and Squier work with, and the absence of a free subgroup of rank two, which follows from the already-formalized Brin–Squier theorem via that embedding. The rest are open. The piecewise-linear machinery built along the way — local affineness, dyadic-breakpoint bookkeeping, extension by the identity — is reusable for TTT, for VVV, and for the wider family of piecewise-linear homeomorphism groups.

Difficulty

The obvious approach to the goal is to argue that a normal subgroup of [F,F][F,F][F,F] containing a nontrivial element must be everything, by conjugating that element around. It fails on its own: an element of [F,F][F,F][F,F] is pinned down only by being trivial near the two endpoints, and one still has to manufacture — inside [F,F][F,F][F,F], not merely inside FFF — an element carrying a prescribed pair of neighborhoods into those. That construction is what the dyadic-partition transitivity lemma supplies, and it is where the combinatorics of dyadic subdivision enters.

The second difficulty was that the source proves §4 using the tree-diagram normal form of §2. That section is now formalized in its own mission, Cannon–Floyd–Parry §2: tree diagrams and the normal form (mission ffd1e4ea-9f9a-4cb6-8419-78e70f2545e8), all of whose milestones are proved. Corollary 2.6 — milestone 5 here, the same theorem object — is closed from there, and Theorem 2.5 (represents_word_exponents) and the normal form (existsUnique_normalForm) are available to a solver attacking Theorem 4.3, so the source's argument can now be followed. A solution file imports only definitions, so whatever it uses from §2 must be reproved inline; the §2 solutions are public and written to be reused that way. The piecewise-linear route — dyadic-partition transitivity, Lemma 4.4 and Theorem 4.1 — remains an alternative, and is what Theorem 4.5's own argument uses.

Formalization scope

The unit interval is [0,1]⊆R[0,1] \subseteq \mathbb{R}[0,1]⊆R as a subtype, and an element of FFF is an order isomorphism of it, so orientation preservation is built into the representation rather than derived — faithful to the source's set, but assuming one sentence CFP prove. Piecewise linearity is stated as: there is a finite set BBB of dyadic reals such that the map is affine, with slope a power of two, on every closed interval whose interior misses BBB. Intercepts are not required to be dyadic — that is derived by induction along the breakpoints, not part of the definition.

The definition is not vacuous: AAA and BBB of Example 1.1 are constructed explicitly, and that FFF is not the trivial group is one of the milestones below — so no statement here is satisfied by the trivial group. In particular the goal, which asserts simplicity and therefore nontriviality, is not trivially false.

A companion definition places the same data on the real line, each element extended by the identity outside [0,1][0,1][0,1]; that line realisation is what the bridge statement connects to Brin and Squier's group.

Selected references

  • J. W. Cannon, W. J. Floyd, W. R. Parry, Introductory notes on Richard Thompson's groups, L'Enseignement Mathématique (2) 42 (1996), 215–256. doi:10.5169/seals-87877
  • M. G. Brin, C. C. Squier, Groups of piecewise linear homeomorphisms of the real line, Inventiones Mathematicae 79 (1985), 485–498. doi:10.1007/BF01388519
  • C. Chou, Elementary amenable groups, Illinois Journal of Mathematics 24 (1980), 396–407. doi:10.1215/ijm/1256047608
  • M. M. Day, Amenable semigroups, Illinois Journal of Mathematics 1 (1957), 509–544. doi:10.1215/ijm/1255380675
  • J. von Neumann, Zur allgemeinen Theorie des Maßes, Fundamenta Mathematicae 13 (1929), 73–116. doi:10.4064/fm-13-1-73-116
  • A. Yu. Olshanskii, On a geometric method in the combinatorial group theory, Proceedings of the International Congress of Mathematicians (Warsaw, 1983), vol. 1, 1984, pp. 415–424. IMU archive
  • M. Gromov, Hyperbolic groups, in Essays in Group Theory (S. M. Gersten, ed.), MSRI Publications 8, Springer, 1987, pp. 75–263. doi:10.1007/978-1-4613-9586-7_3
34 thms3 active usersReviewed
Mathematical PhysicsQuantum Information·Captain: mikedeng1

Highly Efficient Energy Excitation Transfer in Light-Harvesting Complexes: The Fundamental Role of Noise-Assisted Transport: Sink Population 1/(N−1) Without Noise, 1 Under DephasingResearch Paper

Motivation

Photosynthetic light-harvesting complexes move an electronic excitation from the pigment that absorbed a photon to a reaction centre, where its energy is stored chemically. In the Fenna–Matthews–Olson (FMO) complex this transfer is close to lossless, and two-dimensional spectroscopy showed long-lived quantum coherence during it (Engel et al. 2007). This raised a concrete question in open-system quantum dynamics: does the environment, whose noise destroys coherence, hinder transport, or can it help?

Numerical studies of FMO models found that local dephasing raises transfer efficiency compared with purely coherent evolution (Mohseni et al. 2008; Plenio and Huelga 2008; Rebentrost et al. 2009). Caruso, Chin, Datta, Huelga and Plenio (arXiv:0901.4454, J. Chem. Phys. 2009) isolated a mechanism behind this in a model that can be solved exactly: the fully connected network (FCN). There, coherent evolution traps most of the excitation by destructive interference, and any amount of uniform dephasing removes the trap. This mission formalizes that exact result.

Setting

The network has NNN sites. The single-excitation space has orthonormal basis ∣0⟩,∣1⟩,…,∣N⟩,∣N+1⟩|0\rangle, |1\rangle, \dots, |N\rangle, |N+1\rangle∣0⟩,∣1⟩,…,∣N⟩,∣N+1⟩: ∣0⟩|0\rangle∣0⟩ is the zero-exciton state (population lost to the environment), ∣j⟩|j\rangle∣j⟩ for 1≤j≤N1 \le j \le N1≤j≤N is one excitation on site jjj, and ∣N+1⟩|N+1\rangle∣N+1⟩ is the sink (the reaction centre). The operators σj+=∣j⟩⟨0∣\sigma_j^+ = |j\rangle\langle 0|σj+​=∣j⟩⟨0∣ and σj−=∣0⟩⟨j∣\sigma_j^- = |0\rangle\langle j|σj−​=∣0⟩⟨j∣ create and destroy the excitation on site jjj.

The FCN Hamiltonian HHH (with ℏ=1\hbar = 1ℏ=1) has ⟨j∣H∣j⟩=ωj\langle j|H|j\rangle = \omega_j⟨j∣H∣j⟩=ωj​, the site energies, and ⟨i∣H∣j⟩=J\langle i|H|j\rangle = J⟨i∣H∣j⟩=J for every pair of distinct sites, and vanishes on ∣0⟩|0\rangle∣0⟩ and ∣N+1⟩|N+1\rangle∣N+1⟩. For a real rate rrr and an operator ccc write

Dr,c(ρ)=r [2cρc†−{c†c,ρ}].\mathcal D_{r,c}(\rho) = r\,\bigl[2c\rho c^\dagger - \{c^\dagger c, \rho\}\bigr].Dr,c​(ρ)=r[2cρc†−{c†c,ρ}].

The state ρ(t)\rho(t)ρ(t), a complex (N+2)×(N+2)(N+2)\times(N+2)(N+2)×(N+2) matrix, obeys the Lindblad master equation ρ˙=L(ρ)\dot\rho = \mathcal L(\rho)ρ˙​=L(ρ) with

L(ρ)=−i[H,ρ]+∑j=1NDΓj, σj−(ρ)+∑j=1NDγj, ∣j⟩⟨j∣(ρ)+DΓN+1, ∣N+1⟩⟨k∣(ρ).\mathcal L(\rho) = -i[H,\rho] + \sum_{j=1}^N \mathcal D_{\Gamma_j,\,\sigma_j^-}(\rho) + \sum_{j=1}^N \mathcal D_{\gamma_j,\,|j\rangle\langle j|}(\rho) + \mathcal D_{\Gamma_{N+1},\,|N+1\rangle\langle k|}(\rho).L(ρ)=−i[H,ρ]+j=1∑N​DΓj​,σj−​​(ρ)+j=1∑N​Dγj​,∣j⟩⟨j∣​(ρ)+DΓN+1​,∣N+1⟩⟨k∣​(ρ).

The terms are coherent hopping, dissipation to the environment at rates Γj\Gamma_jΓj​, pure dephasing at rates γj\gamma_jγj​, and irreversible decay into the sink from a chosen site kkk at rate ΓN+1\Gamma_{N+1}ΓN+1​. So ρ(t)=etLρ(0)\rho(t) = e^{t\mathcal L}\rho(0)ρ(t)=etLρ(0). The initial state is ρ(0)=∣1⟩⟨1∣\rho(0) = |1\rangle\langle 1|ρ(0)=∣1⟩⟨1∣, and transport is measured by the sink population

psink(t)=2ΓN+1∫0tρkk(t′) dt′.p_{\rm sink}(t) = 2\Gamma_{N+1}\int_0^t \rho_{kk}(t')\,dt'.psink​(t)=2ΓN+1​∫0t​ρkk​(t′)dt′.

The goal concerns the FCN of §II.A: ωj=0\omega_j = 0ωj​=0, Γj=0\Gamma_j = 0Γj​=0, the sink attached at k=Nk = Nk=N, and a uniform dephasing rate γj=γ≥0\gamma_j = \gamma \ge 0γj​=γ≥0.

Formalization targets

Goal: noise-free and dephased limits

For N≥2N \ge 2N≥2, J≠0J \ne 0J=0 and ΓN+1>0\Gamma_{N+1} > 0ΓN+1​>0:

γ=0:lim⁡t→∞psink(t)=1N−1,γ>0:lim⁡t→∞psink(t)=1.\gamma = 0:\quad \lim_{t\to\infty} p_{\rm sink}(t) = \frac{1}{N-1}, \qquad\qquad \gamma > 0:\quad \lim_{t\to\infty} p_{\rm sink}(t) = 1.γ=0:t→∞lim​psink​(t)=N−11​,γ>0:t→∞lim​psink​(t)=1.

The first limit is Eq. (5) of the paper. The second is the claim of §II.C, confirmed for uniform dephasing in Appendix A.3, Eq. (A30). The coupling JJJ, the sink rate and the dephasing rate are left free; neither limit depends on them.

Milestones

  1. (A7) Population sum rule: 1=∑j=1Nρjj(t)+ρ00(t)+psink(t)1 = \sum_{j=1}^N \rho_{jj}(t) + \rho_{00}(t) + p_{\rm sink}(t)1=∑j=1N​ρjj​(t)+ρ00​(t)+psink​(t) for all ttt.
  2. §II.A spectrum. ∣ϕ⟩=N−1/2∑j∣j⟩|\phi\rangle = N^{-1/2}\sum_j |j\rangle∣ϕ⟩=N−1/2∑j​∣j⟩ has energy J(N−1)J(N-1)J(N−1). The states ∣ψj⟩=∣1⟩−∣j⟩|\psi_j\rangle = |1\rangle - |j\rangle∣ψj​⟩=∣1⟩−∣j⟩, j=2,…,Nj = 2,\dots,Nj=2,…,N, have energy −J-J−J, and together with ∣ϕ⟩|\phi\rangle∣ϕ⟩ they span the site space.
  3. Eq. (8). ∣1⟩=1N−1[∑j=2N−1∣ψj⟩+N∣ϕ⟩−∣N⟩]|1\rangle = \frac{1}{N-1}\bigl[\sum_{j=2}^{N-1}|\psi_j\rangle + \sqrt N|\phi\rangle - |N\rangle\bigr]∣1⟩=N−11​[∑j=2N−1​∣ψj​⟩+N​∣ϕ⟩−∣N⟩].
  4. Invariant states. In the noiseless FCN, an eigenstate of HHH with no overlap with site NNN does not evolve, and psink≡0p_{\rm sink} \equiv 0psink​≡0.
  5. Eqs. (6)–(7). For N≥3N \ge 3N≥3, ρ(t)→N−2N−1∣Ψ⟩⟨Ψ∣+1N−1∣N+1⟩⟨N+1∣\rho(t) \to \frac{N-2}{N-1}|\Psi\rangle\langle\Psi| + \frac1{N-1}|N+1\rangle\langle N+1|ρ(t)→N−1N−2​∣Ψ⟩⟨Ψ∣+N−11​∣N+1⟩⟨N+1∣.
  6. (A14). The closed form of ρNN(t)\rho_{NN}(t)ρNN​(t) for the noiseless FCN, N≥3N \ge 3N≥3.
  7. Appendix A.1. The closed linear system of six equations for Λ=∑i,jρij\Lambda = \sum_{i,j}\rho_{ij}Λ=∑i,j​ρij​, X+iY=∑jρNjX + iY = \sum_j \rho_{Nj}X+iY=∑j​ρNj​, ρNN\rho_{NN}ρNN​, ρ00\rho_{00}ρ00​ and psinkp_{\rm sink}psink​ under uniform ω\omegaω, Γ\GammaΓ, γ\gammaγ.

Significance

The result. The noise-free limit 1/(N−1)1/(N-1)1/(N−1) shows that a perfectly coherent, fully symmetric network is a poor transporter: for N=10N = 10N=10 only 1/91/91/9 of the excitation reaches the sink, whereas a classical random walk on the same graph delivers all of it. The dephased limit 111 shows that arbitrarily weak local noise restores complete transfer. Together they are the cleanest exactly solvable instance of dephasing-assisted transport. The invariant-subspace argument behind them (milestones 2–5) also predicts which states are protected from a sink, a mechanism related to coherent population trapping in quantum optics and condensed-matter systems.

Formalizing it. The paper derives these limits from Laplace-domain calculations and residue computations, some of them only sketched. A machine-checked proof would settle the exact constants, the hypotheses under which each limit holds (the necessity of J≠0J \ne 0J=0 and ΓN+1>0\Gamma_{N+1} > 0ΓN+1​>0, and the case N=2N = 2N=2), and the passage from the matrix exponential to the collective variables. As far as is known, none of these results has been formalized. The development also produces reusable pieces: the Lindblad generator of a single-excitation network with a sink, the trace identity (A7), and the spectrum of the complete-graph hopping Hamiltonian.

Difficulty

The obvious route is to compute etLe^{t\mathcal L}etL, but L\mathcal LL acts on an (N+2)2(N+2)^2(N+2)2-dimensional space for arbitrary NNN, so no fixed-size computation applies. The noise-free limit hinges on an exact cancellation: N−2N−1\frac{N-2}{N-1}N−1N−2​ of the weight lies in an HHH-eigenspace that is invisible to the sink, and the remainder must be shown to drain completely, which is a statement about the spectrum of a non-normal generator on the complementary subspace. Under dephasing that invariant subspace no longer exists, but the reduced six-variable system still has to be shown to have psink=1p_{\rm sink} = 1psink​=1 as its only attracting steady state, for every γ>0\gamma > 0γ>0 and every NNN. In the paper this is done through a final-value theorem applied to a fifth-order characteristic polynomial (A26), which is misprinted. A proof that the limit exists, and not only what it equals, is part of the task.

Formalization scope

  • Basis and operators. The basis is Fin (N + 2) in the paper's numbering (0 = zero-exciton state, 1…N = sites, N + 1 = sink), with natural-number indices cast into it. Operators are Matrix (Fin (N + 2)) (Fin (N + 2)) ℂ.
  • Hopping and rates. The hopping is normalized as ⟨i∣H∣j⟩=J\langle i|H|j\rangle = J⟨i∣H∣j⟩=J, which matches (A1), (A34) and the spectrum on p. 4. The rates multiply 2cρc†−{c†c,ρ}2c\rho c^\dagger - \{c^\dagger c,\rho\}2cρc†−{c†c,ρ} with no factor ½, as in Eqs. (2)–(4).
  • Evolution. ρ(t)\rho(t)ρ(t) is semigroupEvolution of the published definition P16, that is, NormedSpace.exp of tLt\mathcal LtL, applied to ∣1⟩⟨1∣|1\rangle\langle 1|∣1⟩⟨1∣.
  • Sink population. psinkp_{\rm sink}psink​ is the interval integral of the real part of ρkk\rho_{kk}ρkk​, as defined on p. 3. It is not the sink entry ρN+1,N+1\rho_{N+1,N+1}ρN+1,N+1​; that the two agree is part of milestone 1.
  • Added hypotheses. The goal assumes N≥2N \ge 2N≥2, J≠0J \ne 0J=0 and ΓN+1>0\Gamma_{N+1} > 0ΓN+1​>0; without any one of them the limits fail. Milestones 5 and 6 assume N≥3N \ge 3N≥3, where ∣Ψ⟩|\Psi\rangle∣Ψ⟩ and the closed form are defined.
  • Uniform dephasing. The dephased clause is stated only for a uniform rate γj=γ\gamma_j = \gammaγj​=γ, which is the case the paper solves. It is quantified over every γ>0\gamma > 0γ>0.

A trivializing formalization is ruled out by construction: NNN and γ\gammaγ are free, psinkp_{\rm sink}psink​ unfolds to an integral of an entry of the matrix exponential of the literal generator, and none of the limits is built into a definition.

Needed infrastructure includes calculus for t↦etLXt \mapsto e^{tL}Xt↦etLX (derivatives, HasDerivAt of entries, the fundamental theorem of calculus for psinkp_{\rm sink}psink​), invariant-subspace arguments for linear ODEs, and asymptotics of linear systems with a stable matrix. Contributions of general lemmas about Lindblad semigroups (trace preservation, Hermiticity preservation, stationary states) are welcome and reusable beyond this mission.

Not formalized here: Eq. (9) (static disorder), Eq. (10) (dissipation), §II.D–§V, the Laplace-domain route (A9)–(A13) and (A25)–(A29), the two-level system (A32), and the general networks of (A39)–(A40).

Selected references

  • F. Caruso, A. W. Chin, A. Datta, S. F. Huelga, M. B. Plenio, Highly efficient energy excitation transfer in light-harvesting complexes: The fundamental role of noise-assisted transport, J. Chem. Phys. 131, 105106 (2009). https://arxiv.org/abs/0901.4454v2 — https://doi.org/10.1063/1.3223548
  • G. S. Engel et al., Evidence for wavelike energy transfer through quantum coherence in photosynthetic systems, Nature 446, 782 (2007). https://doi.org/10.1038/nature05678
  • M. Mohseni, P. Rebentrost, S. Lloyd, A. Aspuru-Guzik, Environment-assisted quantum walks in photosynthetic energy transfer, J. Chem. Phys. 129, 174106 (2008). https://doi.org/10.1063/1.3002335
  • M. B. Plenio, S. F. Huelga, Dephasing-assisted transport: quantum networks and biomolecules, New J. Phys. 10, 113019 (2008). https://doi.org/10.1088/1367-2630/10/11/113019
  • P. Rebentrost, M. Mohseni, I. Kassal, S. Lloyd, A. Aspuru-Guzik, Environment-assisted quantum transport, New J. Phys. 11, 033003 (2009). https://doi.org/10.1088/1367-2630/11/3/033003
  • G. Lindblad, On the generators of quantum dynamical semigroups, Commun. Math. Phys. 48, 119 (1976). https://doi.org/10.1007/BF01608499
10 thms2 active usersReviewed
🏆Completed
Algorithmic Game TheoryEconomics·Captain: mikedeng1

Network Externalities and Market Dominance: Under In/Out Demand the Impulse Selects the Introspective Equilibrium by Its Position Relative to the Middle EquilibriumResearch Paper

Motivation

Markets with network externalities can support several levels of adoption at the same price. A consumer's willingness to buy may rise when many other consumers buy, while the ordinary price effect still works in the opposite direction. A price and an aggregate demand curve can therefore identify several self-consistent quantities without identifying which one consumers reach. In Network Externalities and Market Dominance, Akerlof, Holden and Rayo study this selection problem before analyzing firms' pricing decisions (accepted manuscript, §2.1).

The paper uses an introspective equilibrium: consumers begin with an impulse about firm 1's sales and repeatedly revise consumption in response to the previous level. The resulting limit gives a selection rule tied to an observable starting condition rather than to an arbitrary choice among fixed points. The mission formalizes Proposition 1 of the accepted manuscript, dated September 16, 2022. Its source is the repository manuscript; the numbering and printed pages here refer to that artifact, not the journal typesetting (Akerlof, Holden and Rayo, Proposition 1, p. 10).

Setting

There is a unit mass of consumers, each with unit demand. Write p=p1−p2p=p_1-p_2p=p1​−p2​ for firm 1's relative price, and let Q∈[0,1]Q\in[0,1]Q∈[0,1] be its current total sales. The aggregate demand D(p,Q)∈[0,1]D(p,Q)\in[0,1]D(p,Q)∈[0,1] is the quantity that would be demanded at price ppp if consumers believed sales were QQQ. With one firm, the paper sets the second firm's price and quantity to zero, so the same two-argument demand map applies. With two firms, ppp is the difference of their prices. An equilibrium quantity is a feasible fixed point,

Q=D(p,Q).Q=D(p,Q).Q=D(p,Q).

The inverse demand curve PPP gives a price at which a given quantity is self-consistent: D(P(Q),Q)=QD(P(Q),Q)=QD(P(Q),Q)=Q for Q∈[0,1]Q\in[0,1]Q∈[0,1]. The market assumptions say demand is continuous in price and feasible quantity, decreases with price, and increases with believed quantity. The formal market records weak monotonicity together with strict price comparisons at an inverse-demand point on the nonsaturated part of the range. These comparisons give the signs used in the paper's footnote 12 (§2, p. 5; footnote 12, p. 10).

An In/Out curve has two quantity thresholds 0<QL<QH<10<Q_L<Q_H<10<QL​<QH​<1. The curve PPP is strictly decreasing and convex on [0,QL][0,Q_L][0,QL​], strictly increasing on [QL,QH][Q_L,Q_H][QL​,QH​], and strictly decreasing and concave on [QH,1][Q_H,1][QH​,1]; convexity and concavity here are weak. Define pmin⁡=P(QL)p_{\min}=P(Q_L)pmin​=P(QL​) and pmax⁡=P(QH)p_{\max}=P(Q_H)pmax​=P(QH​). The endpoint conditions are pmax⁡<P(0)p_{\max}<P(0)pmax​<P(0) and P(1)<pmin⁡P(1)<p_{\min}P(1)<pmin​. At a price between the thresholds, the intersections of P(Q)=pP(Q)=pP(Q)=p with the three branches are Qout(p)Q^{\mathrm{out}}(p)Qout(p), Qmid(p)Q^{\mathrm{mid}}(p)Qmid(p), and Qin(p)Q^{\mathrm{in}}(p)Qin(p). At either threshold price, two adjacent branch labels can name the same quantity (footnote 7, p. 6; §2.1, p. 8).

The consumers' impulse I0I_0I0​ lies in [0,1][0,1][0,1]. Level-kkk consumption is the actual iteration Ik=D(p,Ik−1)I_k=D(p,I_{k-1})Ik​=D(p,Ik−1​), or Ik=D(p,⋅)∘k(I0)I_k=D(p,\cdot)^{\circ k}(I_0)Ik​=D(p,⋅)∘k(I0​) with I0I_0I0​ at level zero. An introspective equilibrium Q1∗Q_1^*Q1∗​ is the limit of this sequence as k→∞k\to\inftyk→∞ (Definition 1, p. 9).

Formalization targets

Equilibrium structure

For pmin⁡<p<pmax⁡p_{\min}<p<p_{\max}pmin​<p<pmax​, the three branch quantities are distinct and exhaust the feasible equilibrium quantities. At p=pmin⁡p=p_{\min}p=pmin​ or p=pmax⁡p=p_{\max}p=pmax​, two distinct quantities remain. The milestone from §2.1 also records uniqueness within each branch. Footnote 12 records where D(p,Q)D(p,Q)D(p,Q) lies above or below QQQ between these intersections (§2.1, p. 8; footnote 12, p. 10).

Selection rule

The goal is the full two-part Proposition 1. When pmin⁡≤p≤pmax⁡p_{\min}\le p\le p_{\max}pmin​≤p≤pmax​, the branch equilibria exist and

Q1∗(p)={Qin(p),I0>Qmid(p),Qmid(p),I0=Qmid(p),Qout(p),I0<Qmid(p).Q_1^*(p)= \begin{cases} Q^{\mathrm{in}}(p),&I_0>Q^{\mathrm{mid}}(p),\\ Q^{\mathrm{mid}}(p),&I_0=Q^{\mathrm{mid}}(p),\\ Q^{\mathrm{out}}(p),&I_0<Q^{\mathrm{mid}}(p). \end{cases}Q1∗​(p)=⎩⎨⎧​Qin(p),Qmid(p),Qout(p),​I0​>Qmid(p),I0​=Qmid(p),I0​<Qmid(p).​

When p>pmax⁡p>p_{\max}p>pmax​ or p<pmin⁡p<p_{\min}p<pmin​, exactly one feasible quantity solves Q=D(p,Q)Q=D(p,Q)Q=D(p,Q), and IkI_kIk​ converges to it for every I0∈[0,1]I_0\in[0,1]I0​∈[0,1]. The proof's convergence and uniqueness passages are separate milestones, so the goal retains both claims without taking either as an extra assumption (Proposition 1 and proof, p. 10).

Significance

Proposition 1 ties a market's adoption outcome to the initial impulse. In the multiple-equilibrium price range, the middle equilibrium separates impulses that select the low and high quantities; outside that range, the selected quantity is independent of the impulse. This makes the refinement usable when the subsequent economic analysis asks how a price or a change in expectations can move the market between dominant firms (§2.1–§3).

The paper proves the result in ordinary mathematics. The remaining work here is a machine-checked proof of its precise selection statement and of the source passages that support it. The definition layer also supplies a reusable interface for continuous aggregate demand and inverse demand on a bounded quantity interval. There is no claim that this paper's later pricing-game propositions have already been formalized.

Difficulty

The inverse-demand picture shows three crossings, but a picture alone does not establish that every branch crossing exists or that no additional feasible fixed point is present. At a threshold, two branch labels meet, so a claim that always demands three distinct quantities would be false. Outside the threshold interval, the paper's reference to a unique intersection of P(Q)=pP(Q)=pP(Q)=p fails at prices beyond P(0)P(0)P(0) or P(1)P(1)P(1): the equilibrium can instead be a saturated fixed point at 000 or 111. The formal statements must cover those prices with D(p,Q)=QD(p,Q)=QD(p,Q)=Q (Proposition 1 and proof, p. 10).

The convergence claim concerns a specific recursive sequence from every allowed impulse. Fixed-point existence by itself does not identify that limit or its dependence on the impulse. The market assumptions also require care at the saturation endpoints: strict decrease in price on the whole real line would conflict with nonnegative demand at Q=0Q=0Q=0, while merely weak decrease permits extra fixed points that would defeat the selection claim.

Formalization scope

Lean represents prices and quantities by real numbers and restricts feasible quantities and impulses to [0,1][0,1][0,1]. A Market stores DDD, PPP, continuity of DDD on real prices and feasible quantities, range bounds, weak monotonicity in quantity and price, the inverse-demand identity, and the strict nonsaturation signs from footnote 12. The paper says demand is strictly increasing in quantity below 111; the formal interface uses weak increase because its own saturated consumer model can have a constant zero-demand segment. The strict price signs make explicit the stronger reading of “decreasing” needed at inverse-demand points. Both choices are disclosed in the setting item. The polynomial and clamped-demand example in the local verification file witnesses that the assumptions are consistent.

IsInOut retains every monotonicity, convexity, concavity, threshold-order, and endpoint condition of footnote 7, even when a clause is unused in a proof. The branch quantities are predicates that include their intervals and the equation P(Q)=pP(Q)=pP(Q)=p; the goal asserts their existence before quantifying over them. IsIntrospectiveEq uses Function.iterate and Tendsto for the prescribed IkI_kIk​, so it cannot be satisfied by selecting an unrelated fixed point or sequence. Outside the threshold interval, uniqueness is over feasible fixed points of DDD, including 000 and 111. The assumptions apply to the aggregate map for either one or two firms; consumer types, their distribution, the micro-foundations, the firms' pricing game, profits, the WIN constraint, Corollary 1, and later sections are outside this mission.

A complete development needs continuity and intermediate-value results, monotonicity and convexity of real functions on intervals, and convergence of bounded sequences of real numbers. The market and level-kkk definitions can be reused by later work on equilibrium selection. Contributions may prove the listed milestones, supply independent proofs of Proposition 1, or build the interval-dynamics lemmas they require, while retaining the statement's full price and impulse domains.

Selected references

  • R. Akerlof, R. Holden and L. Rayo, Network Externalities and Market Dominance, author's accepted manuscript, WRAP 178238, dated September 16, 2022; published in Management Science (2024). Accepted manuscript; DOI.
7 thms2 active usersReviewed
EconomicsOperations ResearchOptimization·Captain: mikedeng1

Revenue Management in Crowdfunding 1: Optimal Pledge Level and Campaign Duration Under Triangular Valuations When Independent or Herding Backers DominateResearch Paper

Motivation

Reward-based crowdfunding platforms such as Kickstarter let a project creator collect pledges from the public for a fixed period. Two numbers are fixed before launch and cannot be changed afterwards: the pledge level ppp each backer pays, and the campaign duration TTT. A high pledge level earns more per backer but deters backers with low valuations; a long campaign gives more backers time to arrive but, because backers are paid out only at the end, discounts the project's value in their eyes. Zhang, Savin and Veeraraghavan (SSRN 3065267, published in Manufacturing & Service Operations Management, 2022, doi:10.1287/msom.2022.1147) model this trade-off as a revenue-management problem for a deterministic fluid model of the pledging process, with two kinds of backers: independent backers, who arrive on their own, and herding backers, who arrive at a rate proportional to the amount already pledged, in the spirit of the imitators of the Bass diffusion model. The mission formalizes the paper's model, its closed-form solution, and its main optimization result for valuations with a right-triangular distribution.

Setting

A campaign has a population I^>0\hat I>0I^>0 of independent backers, who arrive at rate k>0k>0k>0 times the number not yet arrived, and herding backers, who arrive at rate Λhqp\Lambda_h q pΛh​qp times the number of pledges made so far (Λh≥0\Lambda_h\ge0Λh​≥0 an arrival rate, q≥0q\ge0q≥0 a propensity). A backer's valuation VVV is drawn from a law on [0,vˉ][0,\bar v][0,vˉ] with survival function Fˉi\bar F_iFˉi​ (independent) or Fˉh\bar F_hFˉh​ (herding). A backer arriving at time t∈[0,T]t\in[0,T]t∈[0,T] pledges iff Ve−r(T−t)≥pVe^{-r(T-t)}\ge pVe−r(T−t)≥p, where r>0r>0r>0 is the backers' discount rate; that happens with probability Fˉ(per(T−t))\bar F(pe^{r(T-t)})Fˉ(per(T−t)). The numbers nip,niln^p_i,n^l_inip​,nil​ of pledging and lost independent backers obey the linear system (1)–(4),

dnipdt=k(I^−ni) Fˉi(per(T−t)),dnildt=k(I^−ni)(1−Fˉi(per(T−t))),ni=nip+nil,\frac{dn^p_i}{dt}=k(\hat I-n_i)\,\bar F_i(pe^{r(T-t)}),\qquad \frac{dn^l_i}{dt}=k(\hat I-n_i)\bigl(1-\bar F_i(pe^{r(T-t)})\bigr),\qquad n_i=n^p_i+n^l_i,dtdnip​​=k(I^−ni​)Fˉi​(per(T−t)),dtdnil​​=k(I^−ni​)(1−Fˉi​(per(T−t))),ni​=nip​+nil​,

and the herding counts nhp,nhln^p_h,n^l_hnhp​,nhl​ obey (8)–(10),

dnhpdt=Λhqp (nip+nhp) Fˉh(per(T−t)),dnhldt=Λhqp (nip+nhp)(1−Fˉh(per(T−t))),\frac{dn^p_h}{dt}=\Lambda_h q p\,(n^p_i+n^p_h)\,\bar F_h(pe^{r(T-t)}),\qquad \frac{dn^l_h}{dt}=\Lambda_h q p\,(n^p_i+n^p_h)\bigl(1-\bar F_h(pe^{r(T-t)})\bigr),dtdnhp​​=Λh​qp(nip​+nhp​)Fˉh​(per(T−t)),dtdnhl​​=Λh​qp(nip​+nhp​)(1−Fˉh​(per(T−t))),

all starting from 000. The total number of pledges is n(p,T)=nip(T)+nhp(T)n(p,T)=n^p_i(T)+n^p_h(T)n(p,T)=nip​(T)+nhp​(T), the revenue is π(p,T)=p n(p,T)\pi(p,T)=p\,n(p,T)π(p,T)=pn(p,T), and the creator solves

max⁡ π(p,T)over0<p≤vˉ,  0≤T≤1rln⁡(vˉ/p).(18)\max\ \pi(p,T)\quad\text{over}\quad 0<p\le\bar v,\ \ 0\le T\le\tfrac1r\ln(\bar v/p).\qquad(18)max π(p,T)over0<p≤vˉ,  0≤T≤r1​ln(vˉ/p).(18)

Two reduced revenue functions appear in the limiting regimes: without herding, Ri(p,T)=kI^pe−kT∫0TekxFˉi(perx)dxR_i(p,T)=k\hat Ipe^{-kT}\int_0^Te^{kx}\bar F_i(pe^{rx})dxRi​(p,T)=kI^pe−kT∫0T​ekxFˉi​(perx)dx (22); in the herding-dominated regime, the proxy Rh(p,T)=p∫0TFˉh(pery)dyR_h(p,T)=p\int_0^T\bar F_h(pe^{ry})dyRh​(p,T)=p∫0T​Fˉh​(pery)dy (27). A right-triangular law on [0,vˉ][0,\bar v][0,vˉ] has mode 000 (Fˉ(y)=(1−y/vˉ)2\bar F(y)=(1-y/\bar v)^2Fˉ(y)=(1−y/vˉ)2) or mode vˉ\bar vvˉ (Fˉ(y)=1−(y/vˉ)2\bar F(y)=1-(y/\bar v)^2Fˉ(y)=1−(y/vˉ)2).

Formalization targets

Goal: Proposition 7

With x0∗x^*_0x0∗​, x1∗x^*_1x1∗​ the explicit algebraic constants (34), (35):

  • (a) if k=rk=rk=r and Λh=0\Lambda_h=0Λh​=0, the unique maximizer of (18) is
(p∗,T∗)=(vˉx0∗−x0∗+1(x0∗)2+x0∗+1, 1rln⁡x0∗) (mode 0),(vˉ1+x1∗+(x1∗)2, 1rln⁡x1∗) (mode vˉ);(p^*,T^*)=\Bigl(\bar v\tfrac{x^*_0-\sqrt{x^*_0}+1}{(x^*_0)^2+x^*_0+1},\ \tfrac1r\ln x^*_0\Bigr)\ \text{(mode 0)},\qquad \Bigl(\tfrac{\bar v}{\sqrt{1+x^*_1+(x^*_1)^2}},\ \tfrac1r\ln x^*_1\Bigr)\ \text{(mode }\bar v);(p∗,T∗)=(vˉ(x0∗​)2+x0∗​+1x0∗​−x0∗​​+1​, r1​lnx0∗​) (mode 0),(1+x1∗​+(x1∗​)2​vˉ​, r1​lnx1∗​) (mode vˉ);
  • (b) the unique maximizer of RhR_hRh​ over the same feasible set is (β∗vˉ,1rln⁡1β∗)(\beta^*\bar v,\frac1r\ln\frac1{\beta^*})(β∗vˉ,r1​lnβ∗1​) with β∗\beta^*β∗ the unique root in (0,1)(0,1)(0,1) of ln⁡1β=32(β−43)2−16\ln\frac1\beta=\frac32(\beta-\frac43)^2-\frac16lnβ1​=23​(β−34​)2−61​ (mode 0), and (βvˉ,1rln⁡1β)(\beta\bar v,\frac1r\ln\frac1\beta)(βvˉ,r1​lnβ1​) with β=−W(−3e−3)/3\beta=\sqrt{-W(-3e^{-3})/3}β=−W(−3e−3)/3​ (mode vˉ\bar vvˉ).

Milestones

  1. Proposition 1 and Proposition 2: every solution of (1)–(4) and (8)–(10) equals the closed forms (5)–(7), (11)–(12), and these solve the systems.
  2. Corollary 2: n(p,T)n(p,T)n(p,T) equals the single integral (17); and (22): π=Ri\pi=R_iπ=Ri​ when Λh=0\Lambda_h=0Λh​=0.
  3. Proposition 4(a), (b): with Λh=0\Lambda_h=0Λh​=0, k=rk=rk=r, the optimal duration T∗(p)T^*(p)T∗(p) for each fixed ppp and the optimal pledge level p∗(T)p^*(T)p∗(T) for each fixed T>0T>0T>0, in closed form (23)–(26).
  4. Proposition 5(a), (b): the same for RhR_hRh​, (28)–(31).

Significance

Proposition 7 is the paper's answer, for triangular valuations, to the question that motivates it: how a creator should set both levers together. Its four cases show how the optimal pledge level and duration move between campaigns dominated by low- or high-valuation independent backers and those dominated by herding backers; in particular herding-dominated campaigns call for markedly longer durations. Propositions 4 and 5 are the "limited-flexibility" policies for platforms where one lever is fixed by convention, and they are what the joint optimization is built from.

The model results (Propositions 1–2, Corollary 2) are proved in the manuscript's Appendix. The proofs of Propositions 4, 5 and 7 are in the paper's online Technical Appendix, which is not part of the source this mission cites; the decomposition into milestones follows the statements of the main text. None of these results has a machine-checked proof. A formalization produces verified closed forms for a nonlinear-in-parameters pricing problem and pins down three printing slips of the source (below).

Difficulty

Propositions 1 and 2 concern linear ordinary differential equations whose coefficients jump whenever the valuation law has an atom, so the classical theory does not apply directly; solutions are absolutely continuous and must be handled in integral form, and uniqueness needs a Grönwall-type argument for measurable coefficients. Corollary 2 is an integration by parts and a change of variables inside a double integral with an exponential of an inner integral. For the optimization results the obstacle is not the first-order condition but the global statement: each "optimal" claim asserts a unique global maximizer over a curved feasible region whose boundary T=1rln⁡(vˉ/p)T=\frac1r\ln(\bar v/p)T=r1​ln(vˉ/p) is active in some cases (Proposition 5) and inactive in others (Proposition 4, Proposition 7(a)). The first-order conditions are cubic or quartic equations whose roots are given by trigonometric and Cardano-type formulas, and part (b) involves transcendental equations; matching the right root and excluding boundary maxima is where the work lies.

Formalization scope

The model is a structure Campaign with real parameters Ihat, k, r, Lh (Λh\Lambda_hΛh​), q, vbar and the survival functions Fbi, Fbh. Standing assumptions: I^,k,r,vˉ>0\hat I,k,r,\bar v>0I^,k,r,vˉ>0, Λh,q≥0\Lambda_h,q\ge0Λh​,q≥0, and each survival function is non-increasing, [0,1][0,1][0,1]-valued, 111 below 000 and 000 from vˉ\bar vvˉ on. The positivity p>0p>0p>0 is added to the feasible set of (18), since ln⁡(vˉ/p)\ln(\bar v/p)ln(vˉ/p) needs it and π(0,T)=0\pi(0,T)=0π(0,T)=0. The pledging probability P(Ve−r(T−t)≥p)\mathbb P(Ve^{-r(T-t)}\ge p)P(Ve−r(T−t)≥p) is written Fˉ(per(T−t))\bar F(pe^{r(T-t)})Fˉ(per(T−t)). The differential systems are stated in integral form with continuity on [0,T][0,T][0,T]; Propositions 1–2 assert both that every solution equals the closed forms and that the closed forms solve the system. "Optimal" always means: feasible, attaining the maximum, and the unique point that does. For a fixed TTT the optimal pledge level is posed only for T>0T>0T>0, because π(⋅,0)\pi(\cdot,0)π(⋅,0) and Rh(⋅,0)R_h(\cdot,0)Rh​(⋅,0) vanish identically.

Three corrections of printing slips are part of the statements: (12) is stated with the factor Λhqp\Lambda_h q pΛh​qp of (9) and with the inner integration limits read as uuu; (39) has the second root β=1\beta=1β=1, so uniqueness is posed on (0,1)(0,1)(0,1); (40) is printed with iii and a complex Lambert WWW, and is stated in the equivalent real form with W(−3e−3)W(-3e^{-3})W(−3e−3) characterized as the unique w∈(−1,0)w\in(-1,0)w∈(−1,0) with wew=−3e−3we^w=-3e^{-3}wew=−3e−3. Printed decimals (one of which, 0.191vˉ0.191\bar v0.191vˉ in (36), is wrong: the exact value is ≈0.198vˉ\approx0.198\bar v≈0.198vˉ) are not part of any statement.

Trivializing formalizations are ruled out: n(p,T)n(p,T)n(p,T) is built from (5) and (11), not defined as (17); the differential systems are integral equations, not their closed forms and not a classical-derivative condition that no solution of a discontinuous system satisfies; optimality is a unique-maximizer statement, not an sSup or a first-order condition; and part (b) maximizes the explicit function (27), not a limit Λh→∞\Lambda_h\to\inftyΛh​→∞.

The development needs interval integrals, the exponential, logarithm, square and cube roots from Mathlib, and a uniqueness argument for linear Volterra integral equations; the latter, and the change-of-variables identity behind (22) and Corollary 2, are reusable for other fluid models of diffusion. Proofs of any milestone, and alternative routes to Proposition 7 (for instance through the profile functions T↦π(p∗(T),T)T\mapsto\pi(p^*(T),T)T↦π(p∗(T),T)), are welcome.

Selected references

  • J. Zhang, S. Savin, S. Veeraraghavan, Revenue Management in Crowdfunding, manuscript of May 26, 2021, SSRN 3065267. https://ssrn.com/abstract=3065267 — published in Manufacturing & Service Operations Management, 2022. https://doi.org/10.1287/msom.2022.1147
  • F. M. Bass, A New Product Growth for Model Consumer Durables, Management Science 15(5), 1969, 215–227. https://doi.org/10.1287/mnsc.15.5.215
  • R. M. Corless, G. H. Gonnet, D. E. G. Hare, D. J. Jeffrey, D. E. Knuth, On the Lambert W function, Advances in Computational Mathematics 5, 1996, 329–359. https://doi.org/10.1007/BF02124750
10 thms2 active usersReviewed
🏆Completed
EconomicsOperations ResearchOptimization·Captain: mikedeng1

Minimum Earnings Regulation and the Stability of Marketplaces II: Without Subsidies a Utilization Shock u₀ Can Be Absorbed Exactly When u₀ ≥ M/J(C(M))Research Paper

Motivation

In 2018 New York City's Taxi and Limousine Commission adopted a minimum earnings rule for ride-hailing drivers: each platform must pay drivers, per hour spent with a passenger, at least a target hourly earnings level divided by the platform's measured driver utilization in the previous period. The rule ties next period's wage floor to this period's idle time, so a platform that over-recruits drivers must raise wages. Asadpour, Lobel and van Ryzin (SSRN 3502607, published in Manufacturing & Service Operations Management, 2022) model this rule as a dynamical system and ask when the regulated marketplace can stay stable, meaning wages stay bounded while the platform does not lose money.

Their main result (Theorem 1, a separate mission of this series) characterizes stability in a deterministic market. Real markets are hit by demand shocks: a sudden drop in ride requests lowers utilization in one period, and the rule then forces a high wage in the next. This mission formalizes the paper's answer (Theorem 2, §4.1) to whether a platform that may not subsidize rides can absorb such a one-time shock.

Setting

Time is discrete. In each period ttt the platform chooses a price pt≥0p_t \ge 0pt​≥0 per ride hour and a wage wt≥0w_t \ge 0wt​≥0 per ride hour. The demand D(p)D(p)D(p) is the number of ride hours requested at price ppp; the supply S(z)S(z)S(z) is the number of driver hours offered when drivers earn zzz per hour. Rides served are Q(p,z)=min⁡{D(p),S(z)}Q(p,z) = \min\{D(p), S(z)\}Q(p,z)=min{D(p),S(z)}, the utilization is u(p,z)=Q(p,z)/S(z)u(p,z) = Q(p,z)/S(z)u(p,z)=Q(p,z)/S(z), and drivers' hourly earnings ztz_tzt​ solve the equilibrium condition

zt=wt u(pt,zt).z_t = w_t \, u(p_t, z_t).zt​=wt​u(pt​,zt​).

A price, wage and earnings sequence satisfying this in every period is an equilibrium-augmented policy. The platform's profit is π(p,w,z)=(p−w) Q(p,z)\pi(p,w,z) = (p-w)\,Q(p,z)π(p,w,z)=(p−w)Q(p,z). With target M>0M > 0M>0, the minimum earnings rule requires

wt+1≥Mu(pt,zt)in every period.w_{t+1} \ge \frac{M}{u(p_t, z_t)} \quad \text{in every period.}wt+1​≥u(pt​,zt​)M​in every period.

The revenue and cost functions are R(p)=p D(p)R(p) = p\,D(p)R(p)=pD(p) and C(z)=z S(z)C(z) = z\,S(z)C(z)=zS(z). The paper assumes DDD positive, strictly decreasing and continuous; SSS strictly increasing, continuous, and positive and differentiable away from 000; RRR unimodal with maximum at p∗p^*p∗; and demand and supply crossing at w∗w^*w∗, D(w∗)=S(w∗)D(w^*) = S(w^*)D(w∗)=S(w∗). HHH is the inverse of CCC, and JJJ is the inverse of RRR on its decreasing branch: J(r)=pJ(r) = pJ(r)=p iff p≥p∗p \ge p^*p≥p∗ and R(p)=rR(p) = rR(p)=r.

A shock lowers utilization to u0u_0u0​ in one period. A marketplace absorbs a u0u_0u0​ utilization shock (Definition 3) if some feasible equilibrium-augmented policy obeying the rule, with first post-shock wage w1≥M/u0w_1 \ge M/u_0w1​≥M/u0​, has bounded wages and non-negative profit in every period.

Formalization targets

Goal: Theorem 2

the marketplace absorbs a u0 utilization shock  ⟺  u0≥MJ(C(M)).\text{the marketplace absorbs a } u_0 \text{ utilization shock} \iff u_0 \ge \frac{M}{J(C(M))}.the marketplace absorbs a u0​ utilization shock⟺u0​≥J(C(M))M​.

The threshold is explicit in the model primitives; no constant is chosen by the formalization.

Milestones (the steps of the published proof, Online Appendix p. 5)

  1. If u0<M/J(C(M))u_0 < M/J(C(M))u0​<M/J(C(M)) and w1≥M/u0w_1 \ge M/u_0w1​≥M/u0​, then M/H(R(w1))≥ϕ(M,u0)>1M/H(R(w_1)) \ge \phi(M,u_0) > 1M/H(R(w1​))≥ϕ(M,u0​)>1, where ϕ(M,u0)=M/H(R(M/u0))\phi(M,u_0) = M/H(R(M/u_0))ϕ(M,u0​)=M/H(R(M/u0​)).
  2. Along a policy with p=wp = wp=w after such a shock, wt+1≥ϕ(M,u0) wtw_{t+1} \ge \phi(M,u_0)\,w_twt+1​≥ϕ(M,u0​)wt​, hence wt≥ϕ(M,u0)t−1w1w_t \ge \phi(M,u_0)^{t-1} w_1wt​≥ϕ(M,u0​)t−1w1​.
  3. If u0≥M/J(C(M))u_0 \ge M/J(C(M))u0​≥M/J(C(M)), then at p=w=J(C(M))p = w = J(C(M))p=w=J(C(M)) and z=Mz = Mz=M: z/w=D(p)/S(z)=u(p,z)z/w = D(p)/S(z) = u(p,z)z/w=D(p)/S(z)=u(p,z), so z=Mz = Mz=M is an equilibrium.

Significance

The result. Theorem 2 quantifies the fragility of a regulated marketplace whose platform cannot cross-subsidize: there is a sharp utilization level below which a single shock sends wages into unbounded growth, and above which the platform recovers immediately with a zero-profit stationary policy. Its threshold depends on the market only through the decreasing branch of revenue and the cost of paying MMM, which makes it a concrete design criterion for the target MMM: a regulator choosing MMM also chooses how deep a utilization drop the market can survive. The remark after the theorem (p. 14) relates it to the stability threshold of Theorem 1.

Formalizing it. The result is proved in the paper; no machine-checked version exists. A formal proof must close points the published argument leaves implicit: the reduction to p=wp = wp=w policies (the paper's Lemma 3, posed in mission I) must hold in the all-periods form used here; the wage recursion of Lemma 4 needs wages above w∗w^*w∗, which the proof does not check; and the sufficiency policy needs J(C(M))≥MJ(C(M)) \ge MJ(C(M))≥M, which holds only because utilizations are at most one. The mission also gives the platform a second, independent use of the shared marketplace model.

Difficulty

The sufficiency direction is a direct check of one stationary policy. The necessity direction is where the work lies. The natural attempt, to argue that a high first wage simply cannot be paid without loss, fails: profit only requires pt≥wtp_t \ge w_tpt​≥wt​, and a platform may raise its price along with the wage. The obstruction is dynamic. Raising the price above J(C(M))J(C(M))J(C(M)) lowers revenue below the cost of supplying earnings MMM, so equilibrium earnings fall below MMM, utilization falls, and the rule raises the next wage by a factor bounded away from one. Turning this into a proof requires controlling arbitrary policies with pt≥wtp_t \ge w_tpt​≥wt​, not just the convenient p=wp = wp=w, and carrying an induction hypothesis (wages stay above M/u0M/u_0M/u0​) that the paper does not state.

Formalization scope

The Lean development lives in namespace MinEarnings.Shock. Demand and supply are functions D S : ℝ → ℝ; all regularity is required on [0,∞)[0,\infty)[0,∞), and "differentiable" is read as differentiable on (0,∞)(0,\infty)(0,∞), which is all the argument uses. "RRR unimodal with maximum at p∗p^*p∗" is strict increase on [0,p∗][0,p^*][0,p∗] and strict decrease on [p∗,∞)[p^*,\infty)[p∗,∞). The points p∗p^*p∗, w∗w^*w∗ and the inverse cost HHH are parameters carrying their defining properties. Time is 0-based: Lean's period 000 is the paper's period 111, so the shock constraint w1≥M/u0w_1 \ge M/u_0w1​≥M/u0​ is a bound on Lean's first wage and the rule constrains every later wage. Bounded wages means ∃B ∀t, wt≤B\exists B\ \forall t,\ w_t \le B∃B ∀t, wt​≤B, and profit is non-negative in every period.

Three conventions are pinned and disclosed in every statement:

  • J(C(M))J(C(M))J(C(M)) is not defined as a function. It is passed as a price qqq with q≥p∗q \ge p^*q≥p∗ and R(q)=C(M)R(q) = C(M)R(q)=C(M), which determines it uniquely. The paper's JJJ is defined on (0,R(p∗)](0, R(p^*)](0,R(p∗)], which presumes R(p)→0R(p) \to 0R(p)→0, an assumption the paper does not make.
  • The shock utilization satisfies 0<u0≤10 < u_0 \le 10<u0​≤1. Without u0≤1u_0 \le 1u0​≤1, which Definition 3 leaves implicit, the sufficiency direction fails when p∗≤w∗<Mp^* \le w^* < Mp∗≤w∗<M.
  • Equilibrium earnings are positive, zt>0z_t > 0zt​>0. Lean defines 0/0=00/0 = 00/0=0, so a zero-earnings "equilibrium" with S(0)=0S(0) = 0S(0)=0 would have utilization 000 and turn the rule into M/0=0≤wt+1M/0 = 0 \le w_{t+1}M/0=0≤wt+1​; the positivity requirement rules out this trivializing reading, and the requirement that wages be bounded uniformly rules out a vacuous reading of stability.

The development needs only Mathlib's real analysis: monotonicity on intervals, inverse functions on (0,∞)(0,\infty)(0,∞), and geometric growth of sequences. The setting file is shared, up to namespace, with the other two missions of the series. Contributions welcome: proofs of the milestones, a proof of the all-periods reduction to p=wp = wp=w policies, and a general lemma that a sequence with wt+1≥ϕwtw_{t+1} \ge \phi w_twt+1​≥ϕwt​, ϕ>1\phi > 1ϕ>1, w0>0w_0 > 0w0​>0 is unbounded.

Selected references

  • A. Asadpour, I. Lobel, G. van Ryzin, Minimum Earnings Regulation and the Stability of Marketplaces, SSRN 3502607 (version of August 24, 2022); Manufacturing & Service Operations Management, 2022. https://ssrn.com/abstract=3502607 · https://doi.org/10.1287/msom.2022.1150
6 thms2 active usersReviewed
🏆Completed
EconomicsOperations ResearchOptimization·Captain: mikedeng1

Minimum Earnings Regulation and the Stability of Marketplaces III: A Minimum Earnings Marketplace Is Dynamically Stable Exactly When It Is Statically StableResearch Paper

Utilization-based minimum earnings rules

In 2018 New York City's Taxi and Limousine Commission (TLC) imposed a minimum pay formula on the largest ride-hailing platforms, following a proposal by Parrott and Reich (2018): the pay per minute and per mile driven is divided by the platform's utilization rate, the fraction of drivers' working time spent carrying passengers. Seattle adopted a similar rule in 2020. The rule targets drivers' hourly earnings while leaving them free to choose when and how much to work. Because utilization is only observed after the fact, the regulation computes the floor for the next measurement period (six months in New York) from the utilization of the current one.

Asadpour, Lobel and van Ryzin (2022) model this rule as a dynamic system and ask when a platform can comply with it while keeping wages bounded and profits non-negative. This mission formalizes their Theorem 3: the lag in the rule does not matter for stability, because the dynamic system is stable exactly when a single static system of equations has a solution. Two companion missions of the series formalize Theorem 1 (the threshold z∗z^*z∗ on stable earnings targets) and Theorem 2 (absorption of a utilization shock).

Setting

Time is discrete. In period ttt the platform charges riders a price pt≥0p_t \ge 0pt​≥0 per hour of driving and pays drivers a wage wt≥0w_t \ge 0wt​≥0 per hour of driving riders. A demand function DDD gives the ride hours demanded at price ppp, and a supply function SSS gives the driver hours offered at expected hourly earnings zzz. The regularity assumptions are that DDD is positive, strictly decreasing and continuous, and SSS is strictly increasing, continuous, and positive and differentiable away from zero. The ride hours produced, the utilization and the platform's profit are

Q(p,z)=min⁡{D(p),S(z)},u(p,z)=Q(p,z)S(z),π(p,w,z)=(p−w) Q(p,z).Q(p,z)=\min\{D(p),S(z)\},\qquad u(p,z)=\frac{Q(p,z)}{S(z)},\qquad \pi(p,w,z)=(p-w)\,Q(p,z).Q(p,z)=min{D(p),S(z)},u(p,z)=S(z)Q(p,z)​,π(p,w,z)=(p−w)Q(p,z).

Drivers earn wtw_twt​ only while busy, so earnings satisfy the equilibrium condition zt=wt u(pt,zt)z_t = w_t\,u(p_t,z_t)zt​=wt​u(pt​,zt​). The minimum earnings rule with target M>0M>0M>0 is

wt+1 ≥ Mu(pt,zt)for every period t.w_{t+1}\ \ge\ \frac{M}{u(p_t,z_t)}\qquad\text{for every period } t.wt+1​ ≥ u(pt​,zt​)M​for every period t.

The MMM-minimum-earnings marketplace is stable if some policy (pt,wt,zt)(p_t,w_t,z_t)(pt​,wt​,zt​) that is feasible, satisfies the equilibrium condition and obeys the rule has a bounded wage sequence and π(pt,wt,zt)≥0\pi(p_t,w_t,z_t)\ge 0π(pt​,wt​,zt​)≥0 in all but finitely many periods. It is statically stable if there are p,w,z≥0p,w,z\ge 0p,w,z≥0 and u∈(0,1]u\in(0,1]u∈(0,1] with

u=Q(p,z)S(z),z=w u,w≥Mu,p≥w.(8)u=\frac{Q(p,z)}{S(z)},\qquad z=w\,u,\qquad w\ge\frac{M}{u},\qquad p\ge w. \tag{8}u=S(z)Q(p,z)​,z=wu,w≥uM​,p≥w.(8)

Formalization targets

Goal: Theorem 3

the M-minimum-earnings marketplace is stable  ⟺  it is statically stable.\text{the } M\text{-minimum-earnings marketplace is stable}\iff\text{it is statically stable}.the M-minimum-earnings marketplace is stable⟺it is statically stable.

The statement carries only the regularity assumptions on DDD and SSS and M>0M>0M>0.

Milestones

The milestones follow the proof in the Online Appendix.

  1. A statically stable marketplace is stable.
  2. Along a policy with pt=wtp_t = w_tpt​=wt​ that satisfies the equilibrium condition and the rule, if ut+1≥utu_{t+1}\ge u_tut+1​≥ut​ for some ttt, the marketplace is statically stable.
  3. Along the same kind of policy, if wt≥M/utw_t\ge M/u_twt​≥M/ut​ for some ttt, the marketplace is statically stable.
  4. If neither case occurs and wages are bounded, then wt→ww_t\to wwt​→w and ut→uu_t\to uut​→u, and the limits satisfy 0<u≤10<u\le 10<u≤1, w≥M/uw\ge M/uw≥M/u and u=Q(w,wu)/S(wu)u = Q(w,wu)/S(wu)u=Q(w,wu)/S(wu).

Significance

Theorem 3 reduces a question about infinite sequences to a question about one system of four relations in four unknowns. The paper uses it to give a second proof of its threshold theorem, and it shows that the lag in the regulation cannot be blamed for instability: every earnings target that a real-time rule could sustain can also be sustained under the lagged rule, and conversely. This gives regulators and platforms a criterion that can be checked by solving equations rather than by simulating policies.

The result is proved in the paper. No machine-checked version of it or of the paper's other results exists. Formalizing it checks the passage to the limit in the dynamic-to-static direction, where the paper leaves one step implicit (the positivity of the limiting utilization), and it provides a Lean model of the regulated marketplace that the other two missions of the series share.

Difficulty

The static-to-dynamic direction is immediate. In the other direction, a stable policy is a sequence, and a solution of (8) is a single point. Fixing one period of a stable policy does not give such a point: the rule compares wt+1w_{t+1}wt+1​ with utu_tut​, while (8) compares www with the utilization of the same point. A solution has to be extracted either from a period where the comparison happens to go the right way or from a limit. The limit is delicate because the utilization Q(p,z)/S(z)Q(p,z)/S(z)Q(p,z)/S(z) is a ratio, and a limit with u=0u = 0u=0 would not solve (8). The positivity of the limiting utilization has to come from the rule and the bound on wages together. The reduction to policies with pt=wtp_t = w_tpt​=wt​ (Lemma 3 of the paper) also has to be carried out on the policy before the case analysis can start; that lemma is posed as a milestone of the first mission of this series and is not repeated here.

Formalization scope

Prices, wages and earnings are real numbers, and D,S:R→RD, S : \mathbb{R}\to\mathbb{R}D,S:R→R are constrained on [0,∞)[0,\infty)[0,∞). A policy is a triple of sequences indexed by N\mathbb{N}N starting at 000, so Lean's period ttt is the paper's period t+1t+1t+1, and the rule constrains every wage except the first. "Bounded" is an upper bound on the wages, which are non-negative; "all but finitely many periods" is an eventually-along-atTop statement. "Differentiable" is read as differentiability on (0,∞)(0,\infty)(0,∞) together with continuity on [0,∞)[0,\infty)[0,∞).

The equilibrium condition requires zt>0z_t>0zt​>0. Without it the encoding is trivial: if S(0)=0S(0)=0S(0)=0, which the assumptions allow, Lean evaluates u(p,0)=0/0u(p,0)=0/0u(p,0)=0/0 as 000, the rule becomes 0≤wt+10\le w_{t+1}0≤wt+1​, and every target MMM would count as stable. For the same reason Definition 4's u∈(0,1]u\in(0,1]u∈(0,1] is kept with its strict lower bound. The paper's standing assumptions that the revenue pD(p)pD(p)pD(p) is unimodal and that DDD and SSS cross are not used by Theorem 3 or its proof and are not assumed, so the formal statements are slightly more general than the paper's.

A complete development needs basic real analysis from Mathlib (monotone convergence, continuity of DDD, SSS and min⁡\minmin, limits of quotients) and the equilibrium construction behind Lemma 3, which uses the inverse of the cost function C(z)=zS(z)C(z)=zS(z)C(z)=zS(z). That construction is reusable across the series. Proofs of the milestones, of the p=wp=wp=w reduction, and of the goal are all welcome.

Selected references

  • A. Asadpour, I. Lobel, G. van Ryzin, Minimum Earnings Regulation and the Stability of Marketplaces, SSRN 3502607 (version of August 24, 2022); Theorem 3 on p. 15, proof in Online Appendix pp. 5–6. https://ssrn.com/abstract=3502607
  • A. Asadpour, I. Lobel, G. van Ryzin, Minimum Earnings Regulation and the Stability of Marketplaces, Manufacturing & Service Operations Management, 2022. https://doi.org/10.1287/msom.2022.1150
  • J. A. Parrott, M. Reich, An Earnings Standard for New York City's App-based Drivers: Economic Analysis and Policy Assessment, report for the New York City Taxi and Limousine Commission, 2018 (cited in the paper as Parrott and Reich [2018]).
7 thms2 active usersReviewed
Mathematical Physics·Captain: Lucas

Alexander–Temple–Vogler 2025: Instability of the Critical Friedmann Spacetime at the Big BangResearch Paper

Motivation

The Friedmann spacetimes (FLRW spacetimes) are the explicit, spatially homogeneous and isotropic solutions of Einstein's field equations on which standard Big Bang cosmology is built. Under a pressureless (dust, p=0p=0p=0) equation of state they form a family indexed by a curvature parameter kkk: the critical spacetime k=0k=0k=0, the underdense spacetimes k<0k<0k<0 and the overdense spacetimes k>0k>0k>0. The current Λ\LambdaΛCDM model fits supernova data with the critical Friedmann spacetime plus a cosmological constant (dark energy).

Alexander, Temple and Vogler (arXiv:2510.14228) study how stable the pressureless Friedmann spacetimes are under smooth, spherically symmetric (radial) perturbations near the Big Bang. They write the Einstein–Euler equations in self-similar variables (tˉ,ξ)(\bar t,\xi)(tˉ,ξ), ξ=rˉ/tˉ\xi=\bar r/\bar tξ=rˉ/tˉ, a formulation introduced by Smoller, Temple and Vogler (Proc. R. Soc. A, 2017). In these variables the critical Friedmann spacetime is a time-independent solution. They argue that the instability of this rest point causes underdense perturbations to accelerate away from k<0k<0k<0 Friedmann spacetimes at intermediate times, and they propose this as a mechanism for the observed acceleration that needs no cosmological constant.

This mission formalizes the dynamical-systems core of that paper: the STV ODE of orders n=1n=1n=1 and n=2n=2n=2, its rest points and eigenvalues, the exact k<0k<0k<0 Friedmann trajectory, and the order-2 instability theorem.

Setting

Expand a solution that is smooth at the centre of symmetry in even powers of ξ\xiξ: z=κρrˉ2=z2(tˉ)ξ2+z4(tˉ)ξ4+…z=\kappa\rho\bar r^2=z_2(\bar t)\xi^2+z_4(\bar t)\xi^4+\dotsz=κρrˉ2=z2​(tˉ)ξ2+z4​(tˉ)ξ4+… (density) and w=v/ξ=w0(tˉ)+w2(tˉ)ξ2+…w=v/\xi=w_0(\bar t)+w_2(\bar t)\xi^2+\dotsw=v/ξ=w0​(tˉ)+w2​(tˉ)ξ2+… (velocity). Collecting like powers of ξ\xiξ gives, at each order nnn, a closed 2n×2n2n\times 2n2n×2n system tˉ U˙=Fn(U)\bar t\,\dot U=F_n(U)tˉU˙=Fn​(U), the STV ODE of order nnn. At order 111, in the unknowns (z2,w0)(z_2,w_0)(z2​,w0​):

tˉz˙2=2z2−3z2w0,tˉw˙0=−16z2+w0−w02.\bar t\dot z_2=2z_2-3z_2w_0,\qquad \bar t\dot w_0=-\tfrac16z_2+w_0-w_0^2 .tˉz˙2​=2z2​−3z2​w0​,tˉw˙0​=−61​z2​+w0​−w02​.

At order 222, in (z2,w0,z4,w2)(z_2,w_0,z_4,w_2)(z2​,w0​,z4​,w2​), the system adds

tˉz˙4=512z22w0+4z4−5w0z4−5z2w2,tˉw˙2=−124z22+14z2w02−110z4+3w2−4w0w2.\bar t\dot z_4=\tfrac5{12}z_2^2w_0+4z_4-5w_0z_4-5z_2w_2,\qquad \bar t\dot w_2=-\tfrac1{24}z_2^2+\tfrac14z_2w_0^2-\tfrac1{10}z_4+3w_2-4w_0w_2 .tˉz˙4​=125​z22​w0​+4z4​−5w0​z4​−5z2​w2​,tˉw˙2​=−241​z22​+41​z2​w02​−101​z4​+3w2​−4w0​w2​.

The system is autonomous in log-time τ=ln⁡tˉ\tau=\ln\bar tτ=lntˉ. Its rest points include the Minkowski point M=(0,1)M=(0,1)M=(0,1), resp. (0,1,0,0)(0,1,0,0)(0,1,0,0), and the critical Friedmann point SM=(43,23)SM=(\tfrac43,\tfrac23)SM=(34​,32​), resp. (43,23,4027,29)(\tfrac43,\tfrac23,\tfrac{40}{27},\tfrac29)(34​,32​,2740​,92​). The p=0p=0p=0, k=−1k=-1k=−1 Friedmann spacetime with parameter Δ0>0\Delta_0>0Δ0​>0 is given in parametric form by tˉ=Δ02(sinh⁡2θ−2θ)\bar t=\tfrac{\Delta_0}{2}(\sinh2\theta-2\theta)tˉ=2Δ0​​(sinh2θ−2θ) and explicit functions z~2,w~0,z~4,w~2\tilde z_2,\tilde w_0,\tilde z_4,\tilde w_2z~2​,w~0​,z~4​,w~2​ of θ>0\theta>0θ>0 (equations (2.41), (2.43)).

Formalization targets

Goal: Theorem 8 at order n=2n=2n=2

Fix Δ0>0\Delta_0>0Δ0​>0. Let S\mathcal SS be the set of solutions of the order-2 STV ODE on tˉ∈(0,∞)\bar t\in(0,\infty)tˉ∈(0,∞) that tend to SMSMSM as tˉ→0+\bar t\to0^+tˉ→0+, tend to MMM as tˉ→∞\bar t\to\inftytˉ→∞, and agree exactly with the k=−1k=-1k=−1 Friedmann spacetime at leading order, i.e. (z2,w0)(tˉ)=(z~2,w~0)(θ)(z_2,w_0)(\bar t)=(\tilde z_2,\tilde w_0)(\theta)(z2​,w0​)(tˉ)=(z~2​,w~0​)(θ). Then

S={Ub:b∈R},b↦Ub injective,U0=(z~2,w~0,z~4,w~2).\mathcal S=\{U_b : b\in\mathbb R\},\qquad b\mapsto U_b \text{ injective},\qquad U_0=(\tilde z_2,\tilde w_0,\tilde z_4,\tilde w_2).S={Ub​:b∈R},b↦Ub​ injective,U0​=(z~2​,w~0​,z~4​,w~2​).

So the k<0k<0k<0 Friedmann spacetime is one member of a one-parameter family of trajectories from SMSMSM to MMM. All members agree with it at leading order, and the others differ from it at order 2.

Milestones

  1. Corollary 1 at n=1n=1n=1: the rest points U,M,SMU,M,SMU,M,SM; the eigenpairs (23,(−9,32))(\tfrac23,(-9,\tfrac32))(32​,(−9,23​)) and (−1,(4,1))(-1,(4,1))(−1,(4,1)) at SMSMSM; MMM is degenerate stable.
  2. Corollary 1 at n=2n=2n=2: the rest points; the four eigenpairs (2.30)–(2.33) at SMSMSM; −1-1−1 is the only eigenvalue at MMM.
  3. Equation (2.29): for every k≥1k\ge1k≥1 the block PkP_kPk​ of (2.26) at SMSMSM has eigenvalues 2k3\tfrac{2k}332k​ and 2k−53\tfrac{2k-5}332k−5​.
  4. Theorem 5 at n=1n=1n=1 and n=2n=2n=2: the explicit k=−1k=-1k=−1 Friedmann curve solves the STV ODE and runs from SMSMSM to MMM.
  5. Theorem 7: solutions tending to MMM satisfy z2,z4=O(tˉ−1)z_2,z_4=O(\bar t^{-1})z2​,z4​=O(tˉ−1) and w0−1,w2=O(tˉ−1ln⁡tˉ)w_0-1,w_2=O(\bar t^{-1}\ln\bar t)w0​−1,w2​=O(tˉ−1lntˉ).
  6. Theorem 9 at n=2n=2n=2: some solutions that agree with Friedmann at leading order and decay to MMM blow up as tˉ→0+\bar t\to0^+tˉ→0+ instead of tending to SMSMSM.

Significance

The result. At order 111 every relevant trajectory is a Friedmann spacetime. Order 222 is the first order where the instability of SMSMSM (the second positive eigenvalue 43\tfrac4334​) produces trajectories that agree with a k<0k<0k<0 Friedmann spacetime as tˉ→0\bar t\to0tˉ→0 and as tˉ→∞\bar t\to\inftytˉ→∞ but differ from it in between. The paper reads this as an acceleration away from Friedmann spacetimes without dark energy. The extra eigenvalue −13-\tfrac13−31​ is why some perturbations do not have a self-similar Big Bang.

Formalizing it. The paper is an announcement: most claims are justified by eigenvalue computations and appeals to standard ODE theory (Hartman–Grobman, decay at degenerate nodes). A machine-checked proof of the order-2 statements would turn these appeals into explicit arguments for a concrete polynomial system. None of these results is known to have been formalized.

Difficulty

The eigenvalue milestones are finite computations. The trajectory milestones (Theorem 5) need hyperbolic-function identities and limits at θ→0+\theta\to0^+θ→0+, where numerators and denominators both vanish to high order. The goal is harder because it is global. Linearizing at SMSMSM only describes trajectories near SMSMSM. One must also show that every member of the family exists for all time and reaches MMM, and that nothing outside the family belongs to S\mathcal SS. Theorem 7 needs sharp decay rates at a rest point whose Jacobian is not diagonalizable, which is where the logarithm comes from.

Formalization scope

  • Phase-space points are vectors Fin 2 → ℝ or Fin 4 → ℝ, with coordinates ordered (z2,w0)(z_2,w_0)(z2​,w0​) and (z2,w0,z4,w2)(z_2,w_0,z_4,w_2)(z2​,w0​,z4​,w2​).
  • A solution is a map U:R→R2nU:\mathbb R\to\mathbb R^{2n}U:R→R2n of log-time τ=ln⁡tˉ\tau=\ln\bar tτ=lntˉ with U′(τ)=Fn(U(τ))U'(\tau)=F_n(U(\tau))U′(τ)=Fn​(U(τ)) for every τ\tauτ. Hence tˉ→0+\bar t\to0^+tˉ→0+ is τ→−∞\tau\to-\inftyτ→−∞, tˉ→∞\bar t\to\inftytˉ→∞ is τ→+∞\tau\to+\inftyτ→+∞, and tˉ=Δ02(sinh⁡2θ−2θ)\bar t=\tfrac{\Delta_0}{2}(\sinh2\theta-2\theta)tˉ=2Δ0​​(sinh2θ−2θ) becomes τ=log⁡(Δ0⋅bigBangTime(θ))\tau=\log(\Delta_0\cdot\mathrm{bigBangTime}(\theta))τ=log(Δ0​⋅bigBangTime(θ)).
  • Jacobians are Fréchet derivatives (fderiv). Norms on R4\mathbb R^{4}R4 are sup norms.
  • The goal requires a family parametrized by R\mathbb RR that is injective, has range exactly S\mathcal SS, and has U0U_0U0​ equal to the Friedmann curve. Exhibiting a single solution does not prove it.
  • Out of scope: the derivation of the STV PDE and STV ODE from the Einstein–Euler equations (Theorems 1–3), the coordinate transformations (Theorems 4 and 6), and the general-order statements of Theorems 8–9. The paper does not write out the order-nnn system for general nnn, so these cannot be stated without first formalizing that derivation. Contributions in that direction are welcome.
  • Discrepancy with the source: Corollary 1 says RM\boldsymbol R_MRM​ is the only eigenvector at MMM. For the explicit order-2 system (2.48)–(2.51) the −1-1−1 eigenspace at MMM is two-dimensional, so the order-2 milestone does not include that uniqueness claim.

Selected references

  • C. Alexander, B. Temple, Z. Vogler, The Instability of the Critical Friedmann Spacetime at the Big Bang as an Alternative to Dark Energy, arXiv preprint, 2025. https://arxiv.org/abs/2510.14228
  • J. Smoller, B. Temple, Z. Vogler, An instability of the standard model of cosmology creates the anomalous acceleration without dark energy, Proc. R. Soc. A 473 (2017). https://doi.org/10.1098/rspa.2016.0887
13 thms2 active usersReviewed
Topology·Captain: Lucas

C^r Stability Conjecture (Palis–Smale)Open Problem

Motivation

Structural stability asks when the qualitative behaviour of a dynamical system survives small perturbations. A diffeomorphism fff of a closed manifold is structurally stable if every diffeomorphism ggg close enough to fff is topologically conjugate to fff: some homeomorphism hhh of the manifold satisfies h∘f=g∘hh\circ f=g\circ hh∘f=g∘h, so that hhh carries orbits of fff onto orbits of ggg. Systems that model physical phenomena are only known up to small errors, which is the original reason for interest in this notion (Andronov–Pontryagin, 1937).

In the 1960s Smale introduced Axiom A, a uniform-hyperbolicity condition on the nonwandering set, and showed that it yields a detailed description of the dynamics (spectral decomposition, symbolic dynamics). Palis and Smale conjectured that structural stability forces this hyperbolic structure. The conjecture appears on the Open Problem Garden as the CrC^rCr Stability Conjecture (openproblemgarden.org/op/c_r_stability_conjecture, rated Outstanding): any CrC^rCr structurally stable diffeomorphism is hyperbolic. The same page describes the higher-regularity case as one of the most important and difficult problems in dynamical systems.

Timeline.

  • 1967 — D. V. Anosov proves that Anosov diffeomorphisms (the whole manifold is a hyperbolic set) are structurally stable (Proc. Steklov Inst. Math. 90).
  • 1970 — J. Palis and S. Smale prove that Morse–Smale diffeomorphisms are structurally stable and state the stability conjecture: fff is structurally stable if and only if fff satisfies Axiom A and the strong transversality condition (Global Analysis, Proc. Sympos. Pure Math. 14, AMS).
  • 1971 — J. Robbin proves the "if" direction for C2C^2C2 diffeomorphisms (Ann. of Math. 94); J. Franks obtains necessary conditions for C1C^1C1 stability, including hyperbolicity of periodic points (Trans. Amer. Math. Soc. 158).
  • 1976 — C. Robinson proves the "if" direction for C1C^1C1 diffeomorphisms (J. Differential Equations 22).
  • 1988 — R. Mañé proves the "only if" direction in the C1C^1C1 topology: a C1C^1C1 structurally stable diffeomorphism satisfies Axiom A (Publ. Math. IHÉS 66). In the same volume J. Palis derives the C1C^1C1 Ω\OmegaΩ-stability conjecture.
  • 1997 — S. Hayashi proves the analogous C1C^1C1 statements for flows (Ann. of Math. 145).

For every r≥2r\ge 2r≥2 the "only if" direction remains open.

Setting

Let MMM be a closed manifold: a compact Hausdorff smooth manifold without boundary, of dimension nnn. For an integer r≥1r\ge 1r≥1, Diffr(M)\mathrm{Diff}^r(M)Diffr(M) is the set of CrC^rCr diffeomorphisms f ⁣:M→Mf\colon M\to Mf:M→M, with the CrC^rCr topology: ggg is close to fff when, in finitely many charts and on compact sets, ggg and its derivatives of order ≤r\le r≤r are uniformly close to those of fff.

  • A point xxx is nonwandering for fff if for every neighbourhood UUU of xxx there is k≥1k\ge 1k≥1 with fk(U)∩U≠∅f^k(U)\cap U\neq\emptysetfk(U)∩U=∅. The nonwandering points form the compact invariant set Ω(f)\Omega(f)Ω(f). Every periodic point lies in Ω(f)\Omega(f)Ω(f).
  • A compact set Λ\LambdaΛ with f(Λ)=Λf(\Lambda)=\Lambdaf(Λ)=Λ is hyperbolic if, for a continuous Riemannian metric, each tangent space TxMT_xMTx​M, x∈Λx\in\Lambdax∈Λ, splits as Es(x)⊕Eu(x)E^s(x)\oplus E^u(x)Es(x)⊕Eu(x), the splitting is carried to itself by DfDfDf, and there are C>0C>0C>0 and 0<λ<10<\lambda<10<λ<1 with
∥Dfxkv∥≤Cλk∥v∥ (v∈Es(x)),∥Dfx−kv∥≤Cλk∥v∥ (v∈Eu(x)),k≥0.\|Df^k_x v\|\le C\lambda^k\|v\|\ (v\in E^s(x)),\qquad \|Df^{-k}_x v\|\le C\lambda^k\|v\|\ (v\in E^u(x)),\qquad k\ge 0 .∥Dfxk​v∥≤Cλk∥v∥ (v∈Es(x)),∥Dfx−k​v∥≤Cλk∥v∥ (v∈Eu(x)),k≥0.
  • fff satisfies Axiom A if Ω(f)\Omega(f)Ω(f) is hyperbolic and the periodic points of fff are dense in Ω(f)\Omega(f)Ω(f). fff is Anosov if MMM itself is hyperbolic.
  • fff is CrC^rCr structurally stable if some CrC^rCr neighbourhood of fff consists of diffeomorphisms topologically conjugate to fff. It is CrC^rCr Ω\OmegaΩ-stable if for all ggg in some CrC^rCr neighbourhood, f∣Ω(f)f|_{\Omega(f)}f∣Ω(f)​ and g∣Ω(g)g|_{\Omega(g)}g∣Ω(g)​ are topologically conjugate.

Formalization targets

Goal: the CrC^rCr stability conjecture

For every closed manifold MMM, every r≥1r\ge 1r≥1 and every f∈Diffr(M)f\in\mathrm{Diff}^r(M)f∈Diffr(M),

f is Cr structurally stable  ⟹  f satisfies Axiom A.f \text{ is } C^r \text{ structurally stable} \;\Longrightarrow\; f \text{ satisfies Axiom A}.f is Cr structurally stable⟹f satisfies Axiom A.

The case r=1r=1r=1 is Mañé's theorem; the cases r≥2r\ge 2r≥2 are open.

Milestones

  1. Franks (1971). A C1C^1C1 structurally stable diffeomorphism has only hyperbolic periodic points.
  2. Consequence of Pugh's closing lemma. For a C1C^1C1 structurally stable fff, Per(f)‾=Ω(f)\overline{\mathrm{Per}(f)}=\Omega(f)Per(f)​=Ω(f).
  3. Mañé (1988). The goal for r=1r=1r=1.
  4. Palis (1988). A C1C^1C1 Ω\OmegaΩ-stable diffeomorphism satisfies Axiom A.
  5. Anosov (1967). For every r≥1r\ge1r≥1, an Anosov CrC^rCr diffeomorphism is CrC^rCr structurally stable.

Significance

The result. A positive answer would give a dynamical characterization of structural stability in every regularity: together with the theorems of Robbin and Robinson (Axiom A plus strong transversality implies stability), it would show that structurally stable diffeomorphisms are exactly the hyperbolic ones with transverse stable and unstable manifolds. Every structurally stable system would then inherit Smale's spectral decomposition and its symbolic models. In the C1C^1C1 topology this picture is complete (Mañé); in higher regularity it is not known whether a structurally stable system can fail to be hyperbolic.

Formalizing it. The mission produces a common Lean vocabulary for hyperbolic sets, Axiom A, and structural and Ω\OmegaΩ-stability of diffeomorphisms of closed manifolds, compatible with the existing CrC^rCr topology and nonwandering-set definitions on the platform. The proved cases (Anosov, Franks, Mañé, Palis) are milestones whose formal proofs would be new contributions; the goal itself is open for r≥2r\ge 2r≥2.

Difficulty

The known C1C^1C1 proof rests on perturbation tools that work only in the C1C^1C1 topology: Franks' lemma (realizing any small change of the derivative along a periodic orbit by a C1C^1C1-small perturbation), Pugh's closing lemma and Mañé's ergodic closing lemma. In the CrC^rCr topology, r≥2r\ge 2r≥2, a perturbation that changes the derivative by a fixed amount on a small ball has large higher derivatives, so these local constructions are not CrC^rCr-small; Gutierrez's examples on the torus show that the local perturbation schemes used for the C1C^1C1 closing lemma cannot work in the C2C^2C2 topology. Whether periodic points are even dense in Ω(f)\Omega(f)Ω(f) for a CrC^rCr structurally stable fff is a case of the CrC^rCr closing problem, itself open.

Formalization scope

  • MMM is a type with [TopologicalSpace M] [T2Space M] [CompactSpace M], a ChartedSpace structure over EuclideanSpace ℝ (Fin n) and IsManifold (𝓡 n) ∞ M (smooth, no boundary). Diffr(M)\mathrm{Diff}^r(M)Diffr(M) is ClosingLemma.Diff n M r with the weak CrC^rCr topology ClosingLemma.crTopology r (published definition ClosingLemma_DiffeoCrTopology); on compact MMM it coincides with the strong topology. rrr is a natural number with r≥1r\ge 1r≥1; r=∞r=\inftyr=∞ is not covered.
  • Ω(f)\Omega(f)Ω(f) is PughClosingLemma.nonwanderingSet (published definition PughClosingLemma_nonwandering).
  • Hyperbolicity uses mfderiv and an arbitrary continuous Riemannian metric (Bundle.ContinuousRiemannianMetric on the tangent bundle); since MMM is compact, the choice of metric only changes CCC. Continuity of the splitting is not assumed, being a consequence of the estimates. A periodic point is hyperbolic when its finite orbit is a hyperbolic set, which is equivalent to the eigenvalue condition.
  • Axiom A requires density of periodic points in Ω(f)\Omega(f)Ω(f) as a separate condition, following Smale's definition.
  • Structural stability asks only for a conjugating homeomorphism, without requiring it to be close to the identity. The strong transversality part of the Palis–Smale conjecture is not part of the goal.
  • Infrastructure needed: stable manifold theory for hyperbolic sets, shadowing, Franks' lemma and closing lemmas on manifolds. These are reusable beyond this mission, and contributions of them are welcome.

Selected references

  • Open Problem Garden, CrC^rCr Stability Conjecture, posted December 20, 2007. https://www.openproblemgarden.org/op/c_r_stability_conjecture
  • D. V. Anosov, Geodesic flows on closed Riemannian manifolds with negative curvature, Proc. Steklov Inst. Math. 90, 1967.
  • J. Palis, S. Smale, Structural stability theorems, Global Analysis, Proc. Sympos. Pure Math. 14, AMS, 1970.
  • J. Robbin, A structural stability theorem, Ann. of Math. 94, 1971.
  • J. Franks, Necessary conditions for stability of diffeomorphisms, Trans. Amer. Math. Soc. 158, 1971.
  • C. Robinson, Structural stability of C1C^1C1 diffeomorphisms, J. Differential Equations 22, 1976.
  • R. Mañé, A proof of the C1C^1C1 stability conjecture, Publ. Math. IHÉS 66, 1988.
  • J. Palis, On the C1C^1C1 Ω\OmegaΩ-stability conjecture, Publ. Math. IHÉS 66, 1988.
  • S. Hayashi, Connecting invariant manifolds and the solution of the C1C^1C1 stability and Ω\OmegaΩ-stability conjectures for flows, Ann. of Math. 145, 1997.
  • C. Pugh, An improved closing lemma and a general density theorem, Amer. J. Math. 89, 1967.
12 thms2 active usersReviewed
Captain: Lucas

Palis Conjecture: Denseness of Finitude of AttractorsOpen Problem

Motivation

A basic aim of the theory of dynamical systems is to describe the long-term behaviour of typical orbits of typical systems. In the 1960s Smale's programme hoped that hyperbolic (structurally stable) systems would be dense, so that the asymptotic behaviour of a dense set of systems would be described by finitely many hyperbolic pieces. This hope fails: there are open sets of diffeomorphisms none of which is hyperbolic. Jacob Palis proposed a replacement global picture, in which hyperbolicity is replaced by a statistical requirement: for a dense set of systems, the asymptotics of Lebesgue-almost every orbit is captured by finitely many attractors. The problem appears on the Open Problem Garden (page), rated Outstanding, with the monograph of Bonatti, Diaz and Viana as reference.

Timeline.

  • 1962 — Peixoto: on a compact orientable surface, structurally stable vector fields (which are Morse–Smale) form an open and dense subset of Xr(M)\mathfrak X^r(M)Xr(M), r≥1r\ge1r≥1. In particular the flow version of the conjecture holds on orientable surfaces (Topology 1, 1962).
  • 1970s — Sinai, Ruelle and Bowen: for C2C^2C2 Axiom A systems, Lebesgue-almost every point lies in the basin of one of finitely many hyperbolic attractors (Bowen, Equilibrium States and the Ergodic Theory of Anosov Diffeomorphisms, LNM 470, 1975; Bowen–Ruelle, Invent. Math. 29, 1975).
  • 1974 — Newhouse: there are open sets of C2C^2C2 surface diffeomorphisms in which a residual subset has infinitely many sinks. Hence finitude of attractors cannot hold on an open and dense set in general, and dense is the natural quantifier.
  • 2000 — Palis states the global conjecture on the denseness of finitude of attractors (Astérisque 261), together with companion conjectures on physical measures and stochastic stability.
  • 2000 — Pujals–Sambarino: every C1C^1C1 surface diffeomorphism can be C1C^1C1-approximated by a hyperbolic one or by one with a homoclinic tangency (Ann. of Math. 151).

The conjecture is open in general.

Setting

Let MMM be a compact, connected, boundaryless smooth manifold of dimension nnn. For r≥1r\ge1r≥1 let Diffr(M)\mathrm{Diff}^r(M)Diffr(M) be the space of CrC^rCr diffeomorphisms of MMM and Xr(M)\mathfrak X^r(M)Xr(M) the space of CrC^rCr vector fields, both with the CrC^rCr topology (uniform convergence of the maps and of their derivatives up to order rrr in charts).

For a diffeomorphism fff and p∈Mp\in Mp∈M, the ω\omegaω-limit set ω(p)\omega(p)ω(p) is the set of accumulation points of the forward orbit fk(p)f^k(p)fk(p), k→∞k\to\inftyk→∞; for a flow (φt)t∈R(\varphi_t)_{t\in\mathbb R}(φt​)t∈R​ it is the set of accumulation points of φt(p)\varphi_t(p)φt​(p) as t→+∞t\to+\inftyt→+∞. The basin of a set Λ⊂M\Lambda\subset MΛ⊂M is

B(Λ)={p∈M: ω(p)⊂Λ}.B(\Lambda)=\{p\in M:\ \omega(p)\subset\Lambda\}.B(Λ)={p∈M: ω(p)⊂Λ}.

Following the source, Λ\LambdaΛ is an attractor if it is invariant (f(Λ)=Λf(\Lambda)=\Lambdaf(Λ)=Λ, resp. φt(Λ)=Λ\varphi_t(\Lambda)=\Lambdaφt​(Λ)=Λ for all ttt), transitive (some point of Λ\LambdaΛ has a forward orbit dense in Λ\LambdaΛ), and B(Λ)B(\Lambda)B(Λ) has positive Lebesgue measure. A set has Lebesgue measure zero in MMM if its image in every chart has Lebesgue measure zero in Rn\mathbb R^nRn; this notion does not depend on the smooth atlas.

Formalization targets

Goal: the Palis conjecture

For every r≥1r\ge1r≥1 there is a dense set D⊂Diffr(M)D\subset\mathrm{Diff}^r(M)D⊂Diffr(M) such that every f∈Df\in Df∈D has finitely many attractors Λ1,…,Λk\Lambda_1,\dots,\Lambda_kΛ1​,…,Λk​ with

Leb(M∖⋃i=1kB(Λi))=0,\mathrm{Leb}\Big(M\setminus\bigcup_{i=1}^k B(\Lambda_i)\Big)=0,Leb(M∖i=1⋃k​B(Λi​))=0,

and likewise there is a dense set D⊂Xr(M)D\subset\mathfrak X^r(M)D⊂Xr(M) such that the flow of every X∈DX\in DX∈D has finitely many attractors whose basins cover Lebesgue-almost all of MMM.

Milestones

  1. The diffeomorphism version and the flow version of the conjecture, separately.
  2. Dimension one: the diffeomorphism version on the circle.
  3. Peixoto: the flow version on compact orientable surfaces.
  4. Basic facts fixing the meaning of the definitions: a hyperbolic sink is an attractor; the identity map (dimension ≥1\ge1≥1) does not have finitely many attractors covering almost all of MMM; every CrC^rCr vector field on a compact boundaryless manifold has a unique global flow.

Significance

The result. A positive answer would give a dense set of systems whose statistical behaviour is completely described by finitely many invariant pieces, providing a global substitute for the failed density of hyperbolicity. It underlies Palis' companion conjectures on the existence of finitely many physical (SRB) measures and their stochastic stability.

Formalizing it. The full conjecture is open. The mission produces a reusable formal language for CrC^rCr diffeomorphisms and vector fields of compact manifolds, CrC^rCr density, Lebesgue-null sets on manifolds, ω\omegaω-limit sets, basins and attractors, together with formal statements of the classical cases (circle diffeomorphisms; Peixoto's theorem on orientable surfaces).

Difficulty

The obvious route — perturb to a hyperbolic system and invoke the Axiom A theory — fails because hyperbolic systems are not dense in dimension ≥2\ge2≥2 for diffeomorphisms (Newhouse phenomenon, robust homoclinic tangencies and heterodimensional cycles). One must control systems near which non-hyperbolic phenomena persist on open sets, where generic systems can have infinitely many sinks, and still find dense subsets with finitely many attractors. Even in the classical cases the proofs require the full machinery of hyperbolic critical elements, stable manifolds and the Kupka–Smale theorem.

Formalization scope

  • MMM is a Hausdorff, compact, connected topological space with a charted-space structure modelled on EuclideanSpace ℝ (Fin n) and a C∞C^\inftyC∞ manifold structure IsManifold (𝓡 n) ∞ M; the model has no boundary, so MMM is boundaryless.
  • rrr is a natural number with r≥1r\ge1r≥1 (the C∞C^\inftyC∞ topology is not covered). Diffr(M)\mathrm{Diff}^r(M)Diffr(M) is M ≃ₘ^r⟮𝓡 n, 𝓡 n⟯ M; vector fields are sections (x : M) → TangentSpace (𝓡 n) x, of class CrC^rCr when x↦(x,X(x))x\mapsto(x,X(x))x↦(x,X(x)) is CrC^rCr into the tangent bundle.
  • Density is expressed with sequences: every element is the CrC^rCr limit of a sequence from DDD (equivalent to topological density since the CrC^rCr topology on a compact manifold is metrizable). CrC^rCr convergence of maps is compact-open convergence plus uniform convergence on compact subsets of chart domains of all derivatives of order ≤r\le r≤r of the chart representatives; for vector fields, the same for the chart representatives y↦De(e−1y) X(e−1y)y\mapsto De(e^{-1}y)\,X(e^{-1}y)y↦De(e−1y)X(e−1y).
  • A set is Lebesgue-null if its image under every chart of the atlas has Lebesgue outer measure zero. ω\omegaω-limits use Mathlib's omegaLimit along atTop. Transitivity means the closure of a forward orbit of a point of Λ\LambdaΛ equals Λ\LambdaΛ.
  • Flows: the flow statements quantify over every global flow Φ\PhiΦ of XXX (Φ0=id\Phi_0=\mathrm{id}Φ0​=id, each orbit an integral curve of XXX); a milestone states that such a flow exists and is unique, so these statements are not vacuous.
  • The goal is not trivialized by taking DDD to be all systems: the identity milestone shows that the finitude property fails for some diffeomorphisms.
  • Reusable infrastructure: Lebesgue-null sets on manifolds, CrC^rCr convergence and density, attractors and basins, flows of vector fields on compact manifolds. Contributions such as hyperbolic fixed points and periodic orbits, stable manifold theorems, rotation numbers of circle diffeomorphisms, and Morse–Smale systems are welcome.

Selected references

  • J. Palis, A global view of dynamics and a conjecture on the denseness of finitude of attractors, Astérisque 261 (2000), 335–347.
  • J. Palis, A global perspective for non-conservative dynamics, Ann. Inst. H. Poincaré Anal. Non Linéaire 22 (2005), 485–507.
  • C. Bonatti, L. J. Díaz, M. Viana, Dynamics Beyond Uniform Hyperbolicity, Encyclopaedia of Mathematical Sciences 102, Springer, 2005.
  • M. M. Peixoto, Structural stability on two-dimensional manifolds, Topology 1 (1962), 101–120.
  • S. E. Newhouse, Diffeomorphisms with infinitely many sinks, Topology 13 (1974), 9–18.
  • R. Bowen, Equilibrium States and the Ergodic Theory of Anosov Diffeomorphisms, Lecture Notes in Math. 470, Springer, 1975.
  • R. Bowen, D. Ruelle, The ergodic theory of Axiom A flows, Invent. Math. 29 (1975), 181–202.
  • E. R. Pujals, M. Sambarino, Homoclinic tangencies and hyperbolicity for surface diffeomorphisms, Ann. of Math. 151 (2000), 961–1023.
  • J. Palis, W. de Melo, Geometric Theory of Dynamical Systems: An Introduction, Springer, 1982.
  • W. de Melo, S. van Strien, One-Dimensional Dynamics, Springer, 1993.
  • Open Problem Garden: https://www.openproblemgarden.org/op/jacob_palis_conjecture_finitude_of_attractors_dynamical_systems
13 thms2 active usersReviewed
Topology·Captain: Lucas

C^r Closing Lemma for DiffeomorphismsOpen Problem

Motivation

A central question in smooth dynamics is how much of the long-term behaviour of a system is captured by its periodic orbits. Every periodic point is nonwandering (each of its neighbourhoods returns to itself under some iterate), but a nonwandering point need not be periodic. The closing lemma asks whether this gap can be removed by an arbitrarily small perturbation: given a nonwandering point ppp of a diffeomorphism fff, is there a diffeomorphism ggg, as close to fff as desired, for which ppp is a periodic point?

The answer controls the generic picture of dynamics. Pugh's General Density Theorem, which rests on the closing lemma, says that for a generic C1C^1C1 diffeomorphism of a closed manifold the periodic points are dense in the nonwandering set. Results of this kind underlie the C1C^1C1-generic theory of dynamical systems (stability conjectures, generic properties of homoclinic classes). Whether the same holds for smoother perturbations is open; the question appears on the Open Problem Garden (closing lemma for diffeomorphisms, rated Outstanding) and is Problem 10 on Smale's 1998 list of mathematical problems for the next century.

Timeline.

  • 1967 — C. Pugh proves the closing lemma for C1C^1C1 perturbations of diffeomorphisms of a compact manifold, together with the General Density Theorem (Amer. J. Math. 89).
  • 1983 — C. Pugh and C. Robinson extend the C1C^1C1 closing lemma to flows and to conservative and Hamiltonian systems (Ergodic Theory Dynam. Systems 3).
  • 1987 — C. Gutierrez constructs examples on the torus showing that the local perturbation schemes used for C1C^1C1 cannot work in the C2C^2C2 topology (Ergodic Theory Dynam. Systems 7).
  • 1997 — S. Hayashi proves the C1C^1C1 connecting lemma (Ann. of Math. 145); the Open Problem Garden credits him with the C1C^1C1 case for flows.
  • 2016 — M. Asaoka and K. Irie prove a C∞C^\inftyC∞ closing lemma for Hamiltonian diffeomorphisms of closed surfaces (arXiv:1512.06336), a special conservative setting in which the closing is obtained near a given open set rather than at a prescribed point.

For general diffeomorphisms and every r>1r > 1r>1 the problem remains open.

Setting

Let MMM be a closed manifold: a compact Hausdorff smooth manifold without boundary, of dimension nnn. For r≥1r \ge 1r≥1, Diffr(M)\mathrm{Diff}^r(M)Diffr(M) is the set of CrC^rCr diffeomorphisms of MMM.

The CrC^rCr topology on Diffr(M)\mathrm{Diff}^r(M)Diffr(M) is defined through charts. For f∈Diffr(M)f \in \mathrm{Diff}^r(M)f∈Diffr(M), smooth charts (φ,U)(\varphi, U)(φ,U) and (ψ,V)(\psi, V)(ψ,V) of MMM, a compact set K⊆UK \subseteq UK⊆U with f(K)⊆Vf(K) \subseteq Vf(K)⊆V, and ε>0\varepsilon > 0ε>0, the basic set

Nr(f;φ,ψ,K,ε)={g:g(K)⊆V, ∥Dk(ψgφ−1)(x)−Dk(ψfφ−1)(x)∥<ε for all x∈φ(K), 0≤k≤r}\mathcal N^r(f;\varphi,\psi,K,\varepsilon) = \Big\{ g : g(K)\subseteq V,\ \big\|D^k(\psi g \varphi^{-1})(x) - D^k(\psi f \varphi^{-1})(x)\big\| < \varepsilon \text{ for all } x \in \varphi(K),\ 0 \le k \le r \Big\}Nr(f;φ,ψ,K,ε)={g:g(K)⊆V, ​Dk(ψgφ−1)(x)−Dk(ψfφ−1)(x)​<ε for all x∈φ(K), 0≤k≤r}

collects the diffeomorphisms whose local representative has all derivatives of order at most rrr uniformly within ε\varepsilonε of those of fff on φ(K)\varphi(K)φ(K). These sets generate the (weak) CrC^rCr topology; on a closed manifold it coincides with the Whitney CrC^rCr topology.

For a map f ⁣:M→Mf\colon M\to Mf:M→M, a point ppp is nonwandering if every neighbourhood UUU of ppp satisfies fk(U)∩U≠∅f^k(U)\cap U\neq\emptysetfk(U)∩U=∅ for some k≥1k\ge 1k≥1; the set of such points is the nonwandering set Ω(f)\Omega(f)Ω(f). A point ppp is periodic for ggg if gm(p)=pg^m(p)=pgm(p)=p for some m≥1m\ge1m≥1.

Formalization targets

Goal: the CrC^rCr closing lemma

For every closed manifold MMM, every r≥1r\ge 1r≥1, every f∈Diffr(M)f\in\mathrm{Diff}^r(M)f∈Diffr(M) and every p∈Ω(f)p\in\Omega(f)p∈Ω(f):

∀ V∋f a Cr-neighbourhood,∃ g∈V, ∃ m≥1: gm(p)=p.\forall\, \mathcal V \ni f \text{ a } C^r\text{-neighbourhood},\quad \exists\, g\in\mathcal V,\ \exists\, m\ge 1:\ g^m(p)=p .∀V∋f a Cr-neighbourhood,∃g∈V, ∃m≥1: gm(p)=p.

Milestones

  1. Compatibility of C1C^1C1 topologies. The C1C^1C1 topology defined above through charts coincides with the C1C^1C1 topology induced by the tangent maps g↦Tgg\mapsto Tgg↦Tg (compact-open topology on maps of the tangent bundle), used by the published statements of Pugh's theorems. Together with milestone 2 it yields the goal for r=1r = 1r=1.
  2. Pugh's C1C^1C1 closing lemma (1967) — the case r=1r=1r=1 (published platform statement).
  3. Pugh's General Density Theorem (1967) — for a residual set of g∈Diff1(M)g\in\mathrm{Diff}^1(M)g∈Diff1(M), Per(g)‾=Ω(g)\overline{\mathrm{Per}(g)}=\Omega(g)Per(g)​=Ω(g) (published platform statement).

Significance

A CrC^rCr closing lemma for r≥2r\ge2r≥2 would give, through the same Baire-category argument as in Pugh's work, a CrC^rCr General Density Theorem: CrC^rCr-generic diffeomorphisms would have periodic points dense in the nonwandering set. Much of the C1C^1C1-generic theory would then become available in the smoother topologies used in smooth ergodic theory, where distortion estimates need at least C1+αC^{1+\alpha}C1+α regularity.

On the formal side, the mission produces a reusable definition of the CrC^rCr topology on diffeomorphism groups, which Mathlib does not currently provide. The r=1r=1r=1 case is a theorem (Pugh 1967) without a machine-checked proof; formalizing it, and the compatibility of the two C1C^1C1 topologies, are concrete sub-goals. The case r≥2r\ge 2r≥2 is open, so a proof of the goal would be a new mathematical result.

Difficulty

A perturbation that makes an almost-returning orbit close up must move the orbit by a distance comparable to how close it comes back. With C1C^1C1 control, the perturbation can be spread over many iterates, and its C1C^1C1 size stays small because derivatives are only constrained to first order. For r≥2r\ge2r≥2, the CrC^rCr norm of a bump of displacement δ\deltaδ supported on a set of diameter ρ\rhoρ scales like δ/ρr\delta/\rho^rδ/ρr, and spreading the perturbation along the orbit no longer keeps it small. Gutierrez's examples show that the local perturbation schemes that work for r=1r=1r=1 do fail in the C2C^2C2 topology, so the natural first idea of copying Pugh's argument is ruled out.

Formalization scope

  • MMM is a type with a charted-space structure modelled on EuclideanSpace ℝ (Fin n) and a C∞C^\inftyC∞ manifold structure (IsManifold (𝓡 n) ∞ M), assumed compact and Hausdorff. Because the model space has no corners, MMM has no boundary.
  • Diffr(M)\mathrm{Diff}^r(M)Diffr(M) is Mathlib's Diffeomorph (𝓡 n) (𝓡 n) M M r, with rrr a natural number.
  • The CrC^rCr topology ClosingLemma.crTopology r is generated by Hirsch's basic sets, using charts of the maximal C∞C^\inftyC∞ atlas and Fréchet derivatives of order 0,…,r0,\dots,r0,…,r of the local representatives at points of φ(K)\varphi(K)φ(K). The goal quantifies over all neighbourhoods of fff for this topology.
  • The nonwandering set is the published PughClosingLemma.nonwanderingSet, shared with the existing statements of Pugh's theorems; periodic points are Mathlib's Function.periodicPts (period at least 111).
  • The hypothesis r≥1r\ge1r≥1 matches the source; r=1r=1r=1 is included in the goal, so the goal is a uniform statement for all finite r≥1r\ge1r≥1.

Infrastructure that would help: a usable API for the CrC^rCr topology (basic neighbourhoods, compatibility under change of charts, the Baire property of Diffr(M)\mathrm{Diff}^r(M)Diffr(M)), and local perturbation lemmas (bump-function perturbations of the identity supported in a chart, with CrC^rCr estimates). Contributions of these as separate lemmas are welcome.

Selected references

  • C. C. Pugh, An improved closing lemma and a general density theorem, Amer. J. Math. 89 (1967), 1010–1021. https://doi.org/10.2307/2373414
  • C. C. Pugh and C. Robinson, The C1C^1C1 closing lemma, including Hamiltonians, Ergodic Theory Dynam. Systems 3 (1983), 261–313.
  • C. Gutierrez, A counter-example to a C2C^2C2 closing lemma, Ergodic Theory Dynam. Systems 7 (1987), 509–530.
  • S. Hayashi, Connecting invariant manifolds and the solution of the C1C^1C1 stability and Ω\OmegaΩ-stability conjectures for flows, Ann. of Math. 145 (1997), 81–137.
  • M. Asaoka and K. Irie, A C∞C^\inftyC∞ closing lemma for Hamiltonian diffeomorphisms of closed surfaces, Geom. Funct. Anal. 26 (2016). https://arxiv.org/abs/1512.06336
  • S. Smale, Mathematical problems for the next century, Math. Intelligencer 20 (1998), 7–15.
  • M. W. Hirsch, Differential Topology, Springer GTM 33, Ch. 2 (definition of the CrC^rCr topologies).
  • Open Problem Garden, Closing Lemma for Diffeomorphism (Dynamical Systems). https://www.openproblemgarden.org/op/closing_lemma_for_diffeomorphism_dynamical_systems
5 thms2 active usersReviewed
🏆Completed
Linear algebra·Captain: Lucas

Dynamic Stochastic General Equilibrium I: The Taylor Principle and DeterminacyTextbook

Motivation

Dynamic stochastic general equilibrium (DSGE) models are the standard framework used by central banks and fiscal authorities for policy analysis and forecasting (Wikipedia overview). The models used for monetary-policy analysis are built from three interrelated blocks — demand, supply and a monetary-policy rule — that jointly determine output, inflation and the nominal interest rate. The canonical small-scale instance is the three-equation New Keynesian model (Woodford 2003; Galí 2008; Clarida, Galí and Gertler 1999).

A basic question about such a model is whether it pins down a unique equilibrium path at all. If many bounded paths solve the model, the model makes no definite prediction and expectations can become self-fulfilling. The answer for the three-equation model is the Taylor principle: the interest-rate rule must respond to inflation strongly enough.

Timeline. Blanchard and Kahn (1980) gave the eigenvalue-counting criterion for existence and uniqueness of bounded solutions of linear rational-expectations models. Kydland and Prescott (1982) started the real-business-cycle/DSGE programme. Rotemberg and Woodford (1997) introduced the New Keynesian DSGE framework. Bullard and Mitra (2002) derived the explicit determinacy condition κ(ϕπ−1)+(1−β)ϕy>0\kappa(\phi_\pi - 1) + (1-\beta)\phi_y > 0κ(ϕπ​−1)+(1−β)ϕy​>0 for the model with a contemporaneous Taylor rule, presented in textbook form by Galí (2008, Ch. 3).

Setting

Time is discrete, t=0,1,2,…t = 0, 1, 2, \dotst=0,1,2,…. All variables are deviations from the zero-inflation steady state: yty_tyt​ is the output gap, πt\pi_tπt​ inflation, and iti_tit​ the nominal interest rate. The parameters are σ>0\sigma > 0σ>0 (inverse elasticity of intertemporal substitution), β∈(0,1)\beta \in (0,1)β∈(0,1) (discount factor), κ>0\kappa > 0κ>0 (slope of the Phillips curve), and the policy coefficients ϕπ,ϕy≥0\phi_\pi, \phi_y \ge 0ϕπ​,ϕy​≥0.

A triple of real sequences (y,π,i)(y, \pi, i)(y,π,i) is an equilibrium if for every ttt

yt=yt+1−1σ(it−πt+1)(demand: dynamic IS curve)πt=βπt+1+κyt(supply: New Keynesian Phillips curve)it=ϕππt+ϕyyt(monetary policy: Taylor rule).\begin{aligned} y_t &= y_{t+1} - \tfrac{1}{\sigma}(i_t - \pi_{t+1}) && \text{(demand: dynamic IS curve)}\\ \pi_t &= \beta \pi_{t+1} + \kappa y_t && \text{(supply: New Keynesian Phillips curve)}\\ i_t &= \phi_\pi \pi_t + \phi_y y_t && \text{(monetary policy: Taylor rule).} \end{aligned}yt​πt​it​​=yt+1​−σ1​(it​−πt+1​)=βπt+1​+κyt​=ϕπ​πt​+ϕy​yt​​​(demand: dynamic IS curve)(supply: New Keynesian Phillips curve)(monetary policy: Taylor rule).​

The demand equation is the log-linearised consumption Euler equation, which equates marginal utility of consumption today with discounted marginal utility tomorrow. The model is determinate if the zero path is its only equilibrium in which yyy, π\piπ and iii all stay bounded.

Formalization targets

Goal: the Taylor principle

For σ>0\sigma > 0σ>0, 0<β<10 < \beta < 10<β<1, κ>0\kappa > 0κ>0, ϕπ,ϕy≥0\phi_\pi, \phi_y \ge 0ϕπ​,ϕy​≥0:

the model is determinate  ⟺  κ(ϕπ−1)+(1−β)ϕy>0.\text{the model is determinate} \iff \kappa(\phi_\pi - 1) + (1 - \beta)\phi_y > 0 .the model is determinate⟺κ(ϕπ​−1)+(1−β)ϕy​>0.

Milestones

  1. Consumption Euler equation. At an interior optimum of the two-period consumption–saving problem, u′(c0)=β(1+r)u′(c1)u'(c_0) = \beta(1+r)u'(c_1)u′(c0​)=β(1+r)u′(c1​).
  2. State-space form. For σ,β≠0\sigma, \beta \ne 0σ,β=0, the model is equivalent to (yt+1,πt+1)⊤=M(yt,πt)⊤(y_{t+1}, \pi_{t+1})^\top = M(y_t, \pi_t)^\top(yt+1​,πt+1​)⊤=M(yt​,πt​)⊤ together with the Taylor rule, for an explicit 2×22\times22×2 matrix MMM.
  3. Equilibria are parametrised by initial conditions. Each (y0,π0)(y_0, \pi_0)(y0​,π0​) determines exactly one equilibrium.
  4. Schur–Cohn test. For real TTT and D>0D > 0D>0, both roots of z2−Tz+Dz^2 - Tz + Dz2−Tz+D have modulus >1> 1>1 iff D>1D > 1D>1 and ∣T∣<1+D|T| < 1 + D∣T∣<1+D.
  5. Blanchard–Kahn lemma. For a real square matrix MMM, the only bounded solution of xt+1=Mxtx_{t+1} = Mx_txt+1​=Mxt​ is zero iff every complex eigenvalue of MMM has modulus >1> 1>1.

Significance

The result itself. The Taylor principle is the standard criterion for whether an interest-rate rule yields a well-defined equilibrium in New Keynesian models, and it is the first property checked when a policy rule is proposed. The determinacy region it describes is the starting point for the analysis of optimal policy and of learnability (Bullard and Mitra 2002).

Formalizing it. The result is classical and proved on paper. This mission formalizes the known argument. The mission produces a reusable Lean definition of the basic New Keynesian model, a general lemma on bounded orbits of linear recursions (which applies to any linear rational-expectations model with only forward-looking variables), and a formal Schur–Cohn criterion for real quadratics.

Difficulty

The economic content is elementary, but the obvious argument skips the hardest step. Textbook treatments state "determinacy holds iff both eigenvalues lie outside the unit circle" without proof, and the equivalence between "no nonzero bounded solution" and an eigenvalue condition has to be established for real sequences while the eigenvalues may be complex. In particular the converse direction needs a real bounded solution built from a complex eigenvector, and the boundary case of eigenvalues on the unit circle must come out on the non-determinate side. The parameter translation also has to handle complex-conjugate eigenvalues, not only real ones.

Formalization scope

  • Sequences are functions N→R\mathbb N \to \mathbb RN→R; the model is the deterministic (shock-free) version, so there are no expectation operators. Stochastic shocks do not change the determinacy condition, but that extension is outside the scope of this mission.
  • "Bounded" means a single real bound for all ttt; determinacy requires yyy, π\piπ and iii to be bounded. Boundedness of iii follows from that of yyy and π\piπ, so this adds no restriction.
  • Division is Lean's total division; every statement that divides by σ\sigmaσ or β\betaβ assumes they are nonzero (or positive).
  • Eigenvalues are complex roots of the characteristic polynomial of the complexified matrix.
  • The goal is not trivial: the zero path is always an equilibrium, determinacy is a genuine uniqueness claim, and the parameter hypotheses are satisfiable (e.g. σ=1\sigma = 1σ=1, β=0.99\beta = 0.99β=0.99, κ=0.1\kappa = 0.1κ=0.1, ϕπ=1.5\phi_\pi = 1.5ϕπ​=1.5, ϕy=0.5\phi_y = 0.5ϕy​=0.5).
  • All declarations live in the namespace DSGE. Contributions of general linear-recursion and polynomial-root lemmas are welcome.

Selected references

  • Wikipedia, Dynamic stochastic general equilibrium. https://en.wikipedia.org/wiki/Dynamic_stochastic_general_equilibrium
  • O. J. Blanchard and C. M. Kahn, The Solution of Linear Difference Models under Rational Expectations, Econometrica 48(5), 1980. https://doi.org/10.2307/1912186
  • F. E. Kydland and E. C. Prescott, Time to Build and Aggregate Fluctuations, Econometrica 50(6), 1982. https://doi.org/10.2307/1913386
  • R. Clarida, J. Galí and M. Gertler, The Science of Monetary Policy: A New Keynesian Perspective, Journal of Economic Literature 37(4), 1999. https://doi.org/10.1257/jel.37.4.1661
  • J. Bullard and K. Mitra, Learning about Monetary Policy Rules, Journal of Monetary Economics 49(6), 2002. https://doi.org/10.1016/S0304-3932(02)00144-7
  • M. Woodford, Interest and Prices: Foundations of a Theory of Monetary Policy, Princeton University Press, 2003.
  • J. Galí, Monetary Policy, Inflation, and the Business Cycle, Princeton University Press, 2008 (Chapter 3).
7 thms2 active usersReviewed
🏆Completed
Convex OptimizationOptimization·Captain: mikedeng1

Understanding the Acceleration Phenomenon via High-Resolution Differential Equations V: Along the High-Resolution ODE of NAG-C, inf ‖∇f(X(u))‖² ≤ (12 + 9sL)‖x₀ − x⋆‖²/(2√s(t³ − t₀³))Research Paper

Motivation

Nesterov's accelerated gradient method for smooth convex functions, called NAG-C in the source paper, minimizes an LLL-smooth convex function fff with function values decreasing at the rate O(L/k2)O(L/k^2)O(L/k2). That rate is optimal among first-order methods (Nesterov, 1983). A line of work starting with Su, Boyd & Candès (2016) studies such methods through ordinary differential equations obtained in the limit of vanishing step size. Their low-resolution ODE X¨+3tX˙+∇f(X)=0\ddot X+\frac3t\dot X+\nabla f(X)=0X¨+t3​X˙+∇f(X)=0 reproduces the O(1/t2)O(1/t^2)O(1/t2) function-value rate. The same ODE also models the heavy-ball method, so it cannot explain why Nesterov's method behaves differently from heavy-ball.

Shi, Du, Jordan & Su (arXiv:1810.08907v3) keep the O(s)O(\sqrt s)O(s​) terms of the limit, where sss is the step size. The resulting high-resolution ODEs contain a gradient-correction term s ∇2f(X)X˙\sqrt s\,\nabla^2 f(X)\dot Xs​∇2f(X)X˙, which is absent from the heavy-ball ODE. This mission formalizes the paper's analysis of the high-resolution ODE of NAG-C (Section 4.1, pp. 21–24). Along this ODE the smallest squared gradient norm up to time ttt decays like 1/t31/t^31/t3, while the low-resolution ODE gives only 1/t21/t^21/t2. Small gradients are the natural stopping criterion in practice and the natural target in nonconvex and dual problems, which is why the squared gradient norm is studied separately from function values (Nesterov, 2012).

Setting

Let f:Rn→Rf:\mathbb R^n\to\mathbb Rf:Rn→R have gradient ∇f\nabla f∇f and Hessian ∇2f\nabla^2 f∇2f. For L>0L>0L>0, the class FL1(Rn)\mathcal F^1_L(\mathbb R^n)FL1​(Rn) consists of the differentiable fff with

f(y)≥f(x)+⟨∇f(x),y−x⟩,∥∇f(x)−∇f(y)∥≤L∥x−y∥(x,y∈Rn).f(y)\ge f(x)+\langle\nabla f(x),y-x\rangle,\qquad \|\nabla f(x)-\nabla f(y)\|\le L\|x-y\|\qquad(x,y\in\mathbb R^n).f(y)≥f(x)+⟨∇f(x),y−x⟩,∥∇f(x)−∇f(y)∥≤L∥x−y∥(x,y∈Rn).

The class FL2(Rn)\mathcal F^2_L(\mathbb R^n)FL2​(Rn) is its subclass of twice continuously differentiable functions whose Hessian is Lipschitz continuous. A minimizer x⋆x^\starx⋆ of fff is fixed.

Given a step size s>0s>0s>0, put t0=1.5st_0=1.5\sqrt st0​=1.5s​. The high-resolution ODE of NAG-C (1.12) is

X¨(t)+3tX˙(t)+s ∇2f(X(t))X˙(t)+(1+3s2t)∇f(X(t))=0(t≥t0),\ddot X(t)+\frac3t\dot X(t)+\sqrt s\,\nabla^2 f(X(t))\dot X(t)+\Big(1+\frac{3\sqrt s}{2t}\Big)\nabla f(X(t))=0\qquad(t\ge t_0),X¨(t)+t3​X˙(t)+s​∇2f(X(t))X˙(t)+(1+2t3s​​)∇f(X(t))=0(t≥t0​),

with X(t0)=x0X(t_0)=x_0X(t0​)=x0​ and X˙(t0)=−s ∇f(x0)\dot X(t_0)=-\sqrt s\,\nabla f(x_0)X˙(t0​)=−s​∇f(x0​). The analysis uses the Lyapunov function (4.1)

E(t)=t(t+s2)(f(X)−f(x⋆))+12∥tX˙+2(X−x⋆)+ts ∇f(X)∥2.\mathcal E(t)=t\Big(t+\frac{\sqrt s}{2}\Big)\big(f(X)-f(x^\star)\big)+\frac12\big\|t\dot X+2(X-x^\star)+t\sqrt s\,\nabla f(X)\big\|^2 .E(t)=t(t+2s​​)(f(X)−f(x⋆))+21​​tX˙+2(X−x⋆)+ts​∇f(X)​2.

With s=0s=0s=0 it reduces to the Lyapunov function of Su, Boyd and Candès.

Formalization targets

Goal: Theorem 5 (p. 21)

For every f∈FL2(Rn)f\in\mathcal F^2_L(\mathbb R^n)f∈FL2​(Rn), every step size s>0s>0s>0, and every solution XXX of (1.12),

inf⁡t0≤u≤t∥∇f(X(u))∥2≤(12+9sL) ∥x0−x⋆∥22s (t3−t03)for all t>t0.\inf_{t_0\le u\le t}\|\nabla f(X(u))\|^2\le\frac{(12+9sL)\,\|x_0-x^\star\|^2}{2\sqrt s\,(t^3-t_0^3)}\qquad\text{for all }t>t_0 .t0​≤u≤tinf​∥∇f(X(u))∥2≤2s​(t3−t03​)(12+9sL)∥x0​−x⋆∥2​for all t>t0​.

With s=1/Ls=1/Ls=1/L this is O(L/t3)O(\sqrt L/t^3)O(L​/t3). The infimum cannot be dropped, because the gradient norm need not decrease along the trajectory.

Milestones (pp. 22–23)

  1. The exact derivative of E\mathcal EE along (1.12) (first display of the proof of Lemma 4.1, p. 23).
  2. Lemma 4.1, (4.2): dEdt≤−[s t2+(1L+s2)t+s2L]∥∇f(X)∥2\frac{d\mathcal E}{dt}\le-\big[\sqrt s\,t^2+(\frac1L+\frac s2)t+\frac{\sqrt s}{2L}\big]\|\nabla f(X)\|^2dtdE​≤−[s​t2+(L1​+2s​)t+2Ls​​]∥∇f(X)∥2 for t≥t0t\ge t_0t≥t0​.
  3. The integrated form: ∫t0t[s u2+(1L+s2)u+s2L]∥∇f(X(u))∥2 du≤E(t0)−E(t)≤E(t0)\int_{t_0}^t\big[\sqrt s\,u^2+(\frac1L+\frac s2)u+\frac{\sqrt s}{2L}\big]\|\nabla f(X(u))\|^2\,du\le\mathcal E(t_0)-\mathcal E(t)\le\mathcal E(t_0)∫t0​t​[s​u2+(L1​+2s​)u+2Ls​​]∥∇f(X(u))∥2du≤E(t0​)−E(t)≤E(t0​).
  4. (4.3): the infimum is at most E(t0)\mathcal E(t_0)E(t0​) divided by s(t3−t03)/3+(1L+s2)(t2−t02)/2+s2L(t−t0)\sqrt s(t^3-t_0^3)/3+(\frac1L+\frac s2)(t^2-t_0^2)/2+\frac{\sqrt s}{2L}(t-t_0)s​(t3−t03​)/3+(L1​+2s​)(t2−t02​)/2+2Ls​​(t−t0​).
  5. E(t0)≤3s⋅L2∥x0−x⋆∥2+2∥x0−x⋆∥2\mathcal E(t_0)\le 3s\cdot\frac L2\|x_0-x^\star\|^2+2\|x_0-x^\star\|^2E(t0​)≤3s⋅2L​∥x0​−x⋆∥2+2∥x0​−x⋆∥2, from the initial conditions.
  6. (4.4): the same bound as (4.3) with numerator (2+1.5sL)∥x0−x⋆∥2(2+1.5sL)\|x_0-x^\star\|^2(2+1.5sL)∥x0​−x⋆∥2. Keeping only the cubic term of the denominator gives Theorem 5.

A companion item states Corollary 4.2 (p. 24): f(X(t))−f(x⋆)≤(4+3sL)∥x0−x⋆∥2t(2t+s)f(X(t))-f(x^\star)\le\frac{(4+3sL)\|x_0-x^\star\|^2}{t(2t+\sqrt s)}f(X(t))−f(x⋆)≤t(2t+s​)(4+3sL)∥x0​−x⋆∥2​ for t>t0t>t_0t>t0​.

Significance

Theorem 5 is the continuous-time model of the paper's Theorem 6, which shows that NAG-C itself, without modification, drives min⁡i≤k∥∇f(xi)∥2\min_{i\le k}\|\nabla f(x_i)\|^2mini≤k​∥∇f(xi​)∥2 to zero at the rate O(L2/k3)O(L^2/k^3)O(L2/k3). Combining the O(1/t2)O(1/t^2)O(1/t2) function-value rate with ∥∇f∥2≤2L(f−f⋆)\|\nabla f\|^2\le 2L(f-f^\star)∥∇f∥2≤2L(f−f⋆) gives only O(L/t2)O(L/t^2)O(L/t2). Previously known O(L2/k3)O(L^2/k^3)O(L2/k3) rates required modified methods (Ghadimi & Lan, 2016). The proof attributes the improvement to the gradient-correction term: the factor ∥∇f(X)∥2\|\nabla f(X)\|^2∥∇f(X)∥2 in Lemma 4.1 comes from the term ts ∇f(X)t\sqrt s\,\nabla f(X)ts​∇f(X) in (4.1), which exists only because of the Hessian term in (1.12). The authors conjecture that the low-resolution ODE does not achieve the 1/t31/t^31/t3 rate (p. 23).

The results of Section 4.1 are proved in the paper; no machine-checked version of them is known. Formalizing them produces a checked Lyapunov analysis of a second-order ODE with Hessian damping and explicit constants. It also gives a template that the discrete analysis of NAG-C (a separate mission in this series) mirrors step by step. Related Hessian-damped systems are analysed in Attouch, Chbani, Fadili & Riahi (2020), with qualitative integrability conclusions instead of an explicit bound on the infimum.

Difficulty

The obvious route goes through the function-value rate and the inequality ∥∇f∥2≤2L(f−f⋆)\|\nabla f\|^2\le2L(f-f^\star)∥∇f∥2≤2L(f−f⋆). It loses a factor of ttt and yields only 1/t21/t^21/t2. The cubic rate needs a Lyapunov function whose derivative contains a term proportional to t2∥∇f(X)∥2t^2\|\nabla f(X)\|^2t2∥∇f(X)∥2. Proving the derivative identity requires differentiating t↦∇f(X(t))t\mapsto\nabla f(X(t))t↦∇f(X(t)) through the chain rule with the Hessian, and then cancelling that derivative against the gradient-correction term of the ODE. The derivative bound also uses the co-coercivity inequality f(x⋆)≥f(X)+⟨∇f(X),x⋆−X⟩+12L∥∇f(X)∥2f(x^\star)\ge f(X)+\langle\nabla f(X),x^\star-X\rangle+\frac1{2L}\|\nabla f(X)\|^2f(x⋆)≥f(X)+⟨∇f(X),x⋆−X⟩+2L1​∥∇f(X)∥2 of LLL-smooth convex functions. The remaining steps are measure-theoretic: integrate a one-sided derivative bound on [t0,t][t_0,t][t0​,t], and compare an infimum with a weighted average.

Formalization scope

  • Rn\mathbb R^nRn is EuclideanSpace ℝ (Fin n), ∇f\nabla f∇f is Mathlib's gradient, and ∇2f(x)v\nabla^2 f(x)v∇2f(x)v is the Fréchet derivative of the gradient map applied to vvv.
  • The classes FL1\mathcal F^1_LFL1​ and FL2\mathcal F^2_LFL2​ are stated in the first-order form printed on p. 8. The Hessian's Lipschitz constant is existential, since the paper fixes none.
  • The minimizer x⋆x^\starx⋆ is a hypothesis f(x⋆)≤f(z)f(x^\star)\le f(z)f(x⋆)≤f(z) for all zzz. The paper presupposes it exists.
  • The step size is any s>0s>0s>0; there is no condition s≤1/Ls\le1/Ls≤1/L.
  • A solution of (1.12) is a pair (X,V)(X,V)(X,V) with X(t0)=x0X(t_0)=x_0X(t0​)=x0​ and V(t0)=−s ∇f(x0)V(t_0)=-\sqrt s\,\nabla f(x_0)V(t0​)=−s​∇f(x0​). For every t≥t0t\ge t_0t≥t0​, XXX has derivative V(t)V(t)V(t) and VVV has the derivative prescribed by (1.12), both relative to [t0,∞)[t_0,\infty)[t0​,∞).
  • Every statement quantifies over all solutions. Existence and uniqueness (the paper's Proposition 2.2) are not assumed.
  • The infimum inf⁡t0≤u≤t\inf_{t_0\le u\le t}inft0​≤u≤t​ ranges over the points of the interval [t0,t][t_0,t][t0​,t]. Statements involving it hold for t>t0t>t_0t>t0​, as on the page.
  • Derivative bounds assert that the derivative exists.
  • The integral bound asserts integrability of its integrand.

Ruled out. A formalization would hold for junk reasons in any of these cases: the infimum is written as a bounded infimum over all reals (in Lean this is ≤0\le 0≤0); the velocity is not tied to X˙\dot XX˙; the goal is stated at t=t0t=t_0t=t0​ (where Lean divides by 000); or derivatives are written with deriv, which is 000 where a function is not differentiable. The statements here avoid all of these.

Infrastructure. A complete development needs:

  • the chain rule for ∇f∘X\nabla f\circ X∇f∘X along a path;
  • the co-coercivity inequality for LLL-smooth convex functions;
  • the fundamental theorem of calculus for one-sided derivatives on [t0,t][t_0,t][t0​,t];
  • the mean-value comparison of an infimum with a weighted average.

The co-coercivity inequality and the interval-integral comparison are reusable beyond this mission. Proofs of the milestones in any order are welcome, as are independent proofs of the goal.

Selected references

  • B. Shi, S. S. Du, M. I. Jordan, W. J. Su, Understanding the Acceleration Phenomenon via High-Resolution Differential Equations, arXiv:1810.08907v3, 2018; Math. Program. (2021), DOI 10.1007/s10107-021-01681-8. https://arxiv.org/abs/1810.08907
  • W. Su, S. Boyd, E. J. Candès, A Differential Equation for Modeling Nesterov's Accelerated Gradient Method: Theory and Insights, J. Mach. Learn. Res. 17(153), 2016. https://arxiv.org/abs/1503.01243
  • Y. Nesterov, A method of solving a convex programming problem with convergence rate O(1/k²), Soviet Math. Dokl. 27, 1983. https://www.mathnet.ru/eng/dan46009
  • Y. Nesterov, How to make the gradients small, Optima 88, 2012. http://www.mathopt.org/Optima-Issues/optima88.pdf
  • S. Ghadimi, G. Lan, Accelerated gradient methods for nonconvex nonlinear and stochastic programming, Math. Program. 156, 2016. https://arxiv.org/abs/1310.3787
  • H. Attouch, Z. Chbani, J. Fadili, H. Riahi, First-order optimization algorithms via inertial systems with Hessian driven damping, Math. Program., 2020. https://arxiv.org/abs/1907.10536
9 thms2 active usersReviewed
Control TheoryGraph TheoryLinear algebra·Captain: mikedeng1

Synchronization via Pinning Control on General Complex Networks II: Componentwise LMIs on the Strongly Connected Components Globally Synchronize a Pinned Network with a Directed Spanning TreeResearch Paper

Motivation

Networks of identical dynamical systems coupled along a directed graph model power grids, sensor and robot swarms, neural populations and coupled oscillators. A basic control question is how to steer every node of such a network onto a prescribed reference trajectory by acting directly on only a few nodes. This is pinning control: feedback is injected at a small set of pinned vertices, and the coupling has to carry the reference signal to the rest of the network.

For undirected or strongly connected networks, criteria for pinning synchronization go back to Wang and Chen (2002) and Chen, Liu and Lu (2007), and the first mission of this series treats the strongly connected case of Yu, Chen, Lü and Kurths (2013). Many networks of interest are not strongly connected: information flows down a hierarchy of groups, and the minimal requirement for the reference to reach every node is that the network, with the reference added as a virtual leader, contains a directed spanning tree rooted at the leader. Section 4 of that paper gives a criterion for this general case that splits into one condition per strongly connected component. This mission formalizes that criterion, Theorem 4.5, with the lemmas its proof uses and three corollaries.

Setting

There are NNN vertices with states xi(t)∈Rnx_i(t)\in\mathbb R^nxi​(t)∈Rn. The coupling configuration matrix G∈RN×NG\in\mathbb R^{N\times N}G∈RN×N has Gij≥0G_{ij}\ge0Gij​≥0 for i≠ji\ne ji=j, where Gij>0G_{ij}>0Gij​>0 records a connection from vertex jjj to vertex iii, and zero row sums, Gii=−∑j≠iGijG_{ii}=-\sum_{j\ne i}G_{ij}Gii​=−∑j=i​Gij​. Given a function f:Rn×R+→Rnf:\mathbb R^n\times\mathbb R_+\to\mathbb R^nf:Rn×R+​→Rn, a coupling strength ccc, an inner coupling matrix Γ∈Rn×n\Gamma\in\mathbb R^{n\times n}Γ∈Rn×n and pinning gains di≥0d_i\ge0di​≥0 (vertex iii is pinned when di>0d_i>0di​>0), the controlled network is

x˙i=f(xi,t)+c∑j=1NGijΓxj−c di Γ(xi−s),i=1,…,N,\dot x_i=f(x_i,t)+c\sum_{j=1}^N G_{ij}\Gamma x_j-c\,d_i\,\Gamma(x_i-s),\qquad i=1,\dots,N,x˙i​=f(xi​,t)+cj=1∑N​Gij​Γxj​−cdi​Γ(xi​−s),i=1,…,N,

where the reference sss solves s˙=f(s,t)\dot s=f(s,t)s˙=f(s,t). The network is globally synchronized when xi(t)−s(t)→0x_i(t)-s(t)\to0xi​(t)−s(t)→0 for every vertex and every pair of solutions.

The nonlinearity is controlled by Assumption 1: there is a matrix KKK with (x−y)T(f(x,t)−f(y,t))≤(x−y)TKΓ(x−y)(x-y)^{\mathsf T}(f(x,t)-f(y,t))\le(x-y)^{\mathsf T}K\Gamma(x-y)(x−y)T(f(x,t)−f(y,t))≤(x−y)TKΓ(x−y) for all x,yx,yx,y and t≥0t\ge0t≥0. Throughout §4 the paper also assumes that KKK and Γ\GammaΓ commute, that Γ\GammaΓ is positive definite, and puts θ=λmax⁡((K+KT)/2)≥0\theta=\lambda_{\max}((K+K^{\mathsf T})/2)\ge0θ=λmax​((K+KT)/2)≥0.

The vertices split into strongly connected components V1,…,VMV_1,\dots,V_MV1​,…,VM​. In the Frobenius normal form the components are ordered so that no edge goes from a later component to an earlier one, which makes GGG block lower triangular. For each component jjj the mission uses three matrices:

  • G~j\widetilde G_jGj​, the diagonal block of G−diag(d)G-\mathrm{diag}(d)G−diag(d) on VjV_jVj​;
  • AjA_jAj​, the within-component part of GGG with zero row sums;
  • Π~j=diag(Πj)\widetilde\Pi_j=\mathrm{diag}(\Pi_j)Πj​=diag(Πj​), where Πj\Pi_jΠj​ is a positive vector with ΠjTAj=0\Pi_j^{\mathsf T}A_j=0ΠjT​Aj​=0.

In Lean, component membership is a map blk : Fin N → Fin M, and Fin M carries the Frobenius order.

Formalization targets

Goal: Theorem 4.5

If, for every component jjj,

2θΠ~j+c(Π~jG~j+G~jTΠ~j)<0,(4.8)2\theta\widetilde\Pi_j+c\bigl(\widetilde\Pi_j\widetilde G_j+\widetilde G_j^{\mathsf T}\widetilde\Pi_j\bigr)<0, \tag{4.8}2θΠj​+c(Πj​Gj​+GjT​Πj​)<0,(4.8)

then the controlled network with a directed spanning tree is globally synchronized.

Milestones

  1. The θ bound (p. 1402). Commutation and Γ>0\Gamma>0Γ>0 turn Assumption 1 into (x−y)T(f(x,t)−f(y,t))≤θ(x−y)TΓ(x−y)(x-y)^{\mathsf T}(f(x,t)-f(y,t))\le\theta(x-y)^{\mathsf T}\Gamma(x-y)(x−y)T(f(x,t)−f(y,t))≤θ(x−y)TΓ(x−y).
  2. Lemma 2.13. The strict Schur complement test for a symmetric block matrix.
  3. Lemma 4.4. If Π~jG~j+G~jTΠ~j<0\widetilde\Pi_j\widetilde G_j+\widetilde G_j^{\mathsf T}\widetilde\Pi_j<0Πj​Gj​+GjT​Πj​<0 on every diagonal block of a block lower-triangular G‾\overline GG, then positive block weights Δj\Delta_jΔj​ exist with ΔΠ~G‾+G‾TΠ~Δ<0\Delta\widetilde\Pi\overline G+\overline G^{\mathsf T}\widetilde\Pi\Delta<0ΔΠG+GTΠΔ<0.
  4. (4.10). Along solutions, V=∑jΔje~jTΠ~je~jV=\sum_j\Delta_j\widetilde e_j^{\mathsf T}\widetilde\Pi_j\widetilde e_jV=∑j​Δj​ejT​Πj​ej​ satisfies V˙≤eT{[ΔΠ~(cG‾+θIN)+(cG‾+θIN)TΠ~Δ]⊗Γ}e\dot V\le e^{\mathsf T}\{[\Delta\widetilde\Pi(c\overline G+\theta I_N)+(c\overline G+\theta I_N)^{\mathsf T}\widetilde\Pi\Delta]\otimes\Gamma\}eV˙≤eT{[ΔΠ(cG+θIN​)+(cG+θIN​)TΠΔ]⊗Γ}e.

Companions

  • Corollary 4.7: the same conclusion under θΠ~j+c(A‾j−Π~jCj−Π~jD‾j)<0\theta\widetilde\Pi_j+c(\overline A_j-\widetilde\Pi_jC_j-\widetilde\Pi_j\overline D_j)<0θΠj​+c(Aj​−Πj​Cj​−Πj​Dj​)<0, which separates the outer in-degrees CjC_jCj​ from the pinning gains D‾j\overline D_jDj​.
  • Corollary 4.8 (i): an explicit coupling-strength threshold under Assumption 2.
  • Corollary 4.9: partial synchronization of the first components.

Significance

Theorem 4.5 replaces a single Nn×NnNn\times NnNn×Nn matrix inequality for the whole network with MMM inequalities, one of the size of each component. In practice the test runs component by component down the Frobenius order: decide which components need pinning, choose gains for each one separately, and get synchronization of the whole network. Corollary 4.7 makes this explicit in terms of the outer in-degrees: a component with no incoming edges from earlier components has to be pinned (Remark 4), while a component that receives enough weight from upstream needs no control. These conditions underlie the pinning scheme algorithm of §5 of the paper.

On the formal side, as far as a search of the platform and of Mathlib shows, none of these results is machine-checked. Mathlib has the positive semidefinite Schur complement and irreducible nonnegative matrices, but not the strict Schur complement, block-diagonal Lyapunov scaling, or Lyapunov arguments for networked ODEs with Kronecker-structured couplings. The mission produces, beyond the paper's theorem:

  • a reusable strict Schur complement lemma;
  • a block-triangular diagonal-stability lemma;
  • a template for Lyapunov estimates on coupled networks in Lean.

Difficulty

The obvious argument is to take one Lyapunov function weighted by a positive left null vector of the whole coupling matrix, as in the strongly connected case. Here it fails: the coupling matrix of a network that is not strongly connected has no positive left null vector, and condition (4.8) is local to each component. The central step is the passage from blockwise to global negative definiteness (Lemma 4.4). Condition (4.8) says nothing about the off-diagonal blocks that couple a component to earlier ones, and a block lower-triangular matrix whose symmetrized diagonal blocks are negative definite need not have a negative definite symmetric part; the component weights Δj\Delta_jΔj​ have to be found so that those couplings are dominated, which is a quantitative statement about Schur complements. Turning the resulting matrix inequality into convergence of the trajectories then needs a differential inequality on [0,∞)[0,\infty)[0,∞), a Kronecker-product definiteness argument with Γ\GammaΓ, and the commutation of KKK and Γ\GammaΓ to reach the θ bound.

Formalization scope

States are Fin n → ℝ and matrices are indexed by Fin N, Fin n, or the subtype of one component's vertices. Solutions are functions on ℝ that satisfy their ODE on [0,∞)[0,\infty)[0,∞) through HasDerivWithinAt … (Set.Ici 0). "For any initial conditions" means for every pair of solutions (s,x)(s,x)(s,x); existence of solutions is not claimed. Convergence is componentwise, which agrees with every norm on Rn\mathbb R^nRn. "Positive definite" is Mathlib's Matrix.PosDef, which includes symmetry, and X<0X<0X<0 is (-X).PosDef. λmax⁡\lambda_{\max}λmax​ is the least Rayleigh bound, IsLamMax, never a supremum of a possibly empty set.

The vertices are not permuted into Frobenius form. The hypotheses say instead that:

  • every component is nonempty;
  • every component is strongly connected inside itself;
  • every edge between components points forward in the order;
  • every vertex is reachable from a pinned vertex.

The weights Πj\Pi_jΠj​ are tied to the paper's object by ΠjTAj=0\Pi_j^{\mathsf T}A_j=0ΠjT​Aj​=0. The standing assumptions of p. 1402 (Assumption 1, KΓ=ΓKK\Gamma=\Gamma KKΓ=ΓK, θ=λmax⁡((K+KT)/2)≥0\theta=\lambda_{\max}((K+K^{\mathsf T})/2)\ge0θ=λmax​((K+KT)/2)≥0, Γ>0\Gamma>0Γ>0) are hypotheses of every goal-level statement. The goal does not assume the weights Δj\Delta_jΔj​, the bound (4.10), or definiteness of a whole-network matrix; it assumes only (4.8) on each component, so it cannot be trivialized by assuming its own conclusion. For n=0n=0n=0 the λmax⁡\lambda_{\max}λmax​ hypothesis cannot be met, so that degenerate dimension is excluded.

The pages contain three misprints. (4.10) has "−c-c−c" in its third line and "++++++" in its last; the last line, with a single +++, is formalized. Corollary 4.9 ranges "i=1,…,Ni=1,\dots,Ni=1,…,N" where the component range is meant.

A complete development needs a Gronwall-type decay lemma on [0,∞)[0,\infty)[0,∞), the strict Schur complement, definiteness of Kronecker products, and the square root of a positive definite matrix commuting with matrices that commute with it. Each of these is reusable well beyond this mission, and contributions to any of them are welcome, as are proofs of the milestones in any order.

Selected references

  • W. Yu, G. Chen, J. Lü, J. Kurths, Synchronization via pinning control on general complex networks, SIAM J. Control Optim. 51(2) (2013), 1395–1416. https://doi.org/10.1137/100781699
  • X. F. Wang, G. Chen, Pinning control of scale-free dynamical networks, Physica A 310 (2002), 521–531. https://doi.org/10.1016/S0378-4371(02)00772-0
  • T. Chen, X. Liu, W. Lu, Pinning complex networks by a single controller, IEEE Trans. Circuits Syst. I 54(6) (2007), 1317–1326. https://doi.org/10.1109/TCSI.2007.895383
  • S. Boyd, L. El Ghaoui, E. Feron, V. Balakrishnan, Linear Matrix Inequalities in System and Control Theory, SIAM, 1994. https://doi.org/10.1137/1.9781611970777
  • R. A. Brualdi, H. J. Ryser, Combinatorial Matrix Theory, Cambridge University Press, 1991. https://doi.org/10.1017/CBO9781107325708
7 thms2 active usersReviewed
AnalysisConvex OptimizationOptimization·Captain: mikedeng1

A Differential Equation for Modeling Nesterov's Accelerated Gradient Method: Theory and Insights I: The ODE Ẍ + (3/t)Ẋ + ∇f(X) = 0 with X(0) = x₀, Ẋ(0) = 0 Has a Unique Global SolutionResearch Paper

Why this ODE needs a well-posedness theorem

Nesterov’s accelerated gradient method is a discrete procedure for minimizing a smooth convex function. Its iterates use both a gradient step and a momentum term, so the position at the next step depends on recent motion as well as on the current gradient. Su, Boyd, and Candès study a continuous-time model of that behavior: a trajectory whose acceleration is driven by the negative gradient and opposed by a time-dependent damping term. The model is useful only if its prescribed starting point determines an actual trajectory. The first theorem of the paper supplies that guarantee for the damping coefficient 3/t3/t3/t. Su, Boyd, and Candès, 2015, Theorem 1.

The coefficient 3/t3/t3/t is undefined at the stated initial time t=0t=0t=0. Standard results for differential equations with a continuous right-hand side at the initial time therefore cannot be applied directly. The existence and uniqueness claim is substantive: it makes the trajectory used in the paper’s later rate and restart theorems a defined mathematical object, including its behavior at the singular endpoint. The source proves the result; this mission asks for a machine-checked formalization of its statement and its supporting appendix lemmas.

The setting

Fix a dimension nnn, a starting point x0∈Rnx_0\in\mathbb R^nx0​∈Rn, and a real-valued objective fff. For a constant L>0L>0L>0, the paper’s class FL\mathcal F_LFL​ consists of functions that are convex, continuously differentiable, and have an LLL-Lipschitz gradient:

∥∇f(x)−∇f(y)∥≤L∥x−y∥for all x,y∈Rn.\|\nabla f(x)-\nabla f(y)\|\le L\|x-y\| \qquad\text{for all }x,y\in\mathbb R^n.∥∇f(x)−∇f(y)∥≤L∥x−y∥for all x,y∈Rn.

The larger class F∞\mathcal F_\inftyF∞​ is the union of these classes over positive LLL. In particular, the objective need not be strongly convex and need not have a minimizer for this mission.

A solution is a position X:[0,∞)→RnX:[0,\infty)\to\mathbb R^nX:[0,∞)→Rn and its velocity V=X˙V=\dot XV=X˙, starting at X(0)=x0X(0)=x_0X(0)=x0​ and V(0)=0V(0)=0V(0)=0, that satisfy equation (3) at every positive time:

V˙(t)+3tV(t)+∇f(X(t))=0,t>0.\dot V(t)+\frac{3}{t}V(t)+\nabla f(X(t))=0,\qquad t>0.V˙(t)+t3​V(t)+∇f(X(t))=0,t>0.

The trajectory is continuously differentiable through the initial endpoint, with a right derivative there, and twice continuously differentiable for t>0t>0t>0. The paper also uses a smoothed equation indexed by δ>0\delta>0δ>0, replacing 3/t3/t3/t with 3/max⁡(δ,t)3/\max(\delta,t)3/max(δ,t). Its solutions are denoted XδX_\deltaXδ​, and its velocity-growth quantity is

Mδ(t)=sup⁡0<u≤t∥X˙δ(u)∥u.M_\delta(t)=\sup_{0<u\le t}\frac{\|\dot X_\delta(u)\|}{u}.Mδ​(t)=0<u≤tsup​u∥X˙δ​(u)∥​.

For local uniqueness, two solutions X,YX,YX,Y on [0,a)[0,a)[0,a) are compared using M~(t)=sup⁡0≤u<t∥X˙(u)−Y˙(u)∥\widetilde M(t)=\sup_{0\le u<t}\|\dot X(u)-\dot Y(u)\|M(t)=sup0≤u<t​∥X˙(u)−Y˙(u)∥. These quantities appear in the appendix lemmas and are represented by pointwise bounds in the formal statements.

Formalization targets

The goal is Theorem 1, the well-posedness of equation (3). For every f∈F∞f\in\mathcal F_\inftyf∈F∞​ and every x0x_0x0​, it asserts both existence of a global trajectory with the regularity above and uniqueness on nonnegative time:

∃X solving (3) from (x0,0),X,Y both solve (3) from (x0,0)⟹X(t)=Y(t)(t≥0).\exists X\ \text{solving (3) from }(x_0,0), \qquad X,Y\ \text{both solve (3) from }(x_0,0) \Longrightarrow X(t)=Y(t)\quad(t\ge0).∃X solving (3) from (x0​,0),X,Y both solve (3) from (x0​,0)⟹X(t)=Y(t)(t≥0).

The milestone list follows the numbered statements in Appendix A. Lemma 16 controls the change in ∇f\nabla f∇f along a smoothed trajectory. Lemmas 15 and 17 bound MδM_\deltaMδ​ on the initial smoothing interval and beyond it, with the explicit thresholds δ<6/L\delta<\sqrt{6/L}δ<6/L​ and t<12/Lt<\sqrt{12/L}t<12/L​. Lemma 18 states that the family of smoothed trajectories with δ=3/L/2m\delta=\sqrt{3/L}/2^mδ=3/L​/2m is uniformly bounded and equicontinuous on [0,6/L][0,\sqrt{6/L}][0,6/L​]. Lemma 14 gives existence for equation (3). Lemma 20 bounds the difference between gradients along two local solutions, and Lemma 19 gives uniqueness in a neighborhood of zero. The goal and milestones preserve the source’s domains, constants, and order of dependence.

What the result provides

Theorem 1 permits the rest of the paper to refer to “the” trajectory of equation (3) from a specified initial point. In particular, statements about its objective value, energy, and restarts need an actual trajectory, and uniqueness makes those statements independent of a choice of solution. The appendix estimates also provide reusable facts about this singular second-order equation: quantitative control of smoothed velocities and local agreement at the singular time.

The paper proves Theorem 1 and the seven listed lemmas on pp. 6 and 28–32. This mission does not claim a new analytical result. Its output would be checked Lean statements and, when solvers finish the proofs, a machine-checked development of the singular initial-value problem. The formal definitions are shared by all items in this mission; the lemmas can be reused in later formal work on accelerated gradient trajectories. No machine-checked proof of these particular statements is being claimed by the draft proposal.

The central difficulty

The initial time is precisely where the damping 3/t3/t3/t has no finite value. Treating the problem as an ordinary initial-value problem at t=0t=0t=0 leaves the differential equation undefined there. Imposing the equation at t=0t=0t=0 after Lean’s total division would instead change it: Lean assigns a value to division by zero, while the paper imposes equation (3) only for t>0t>0t>0. The demanded derivative at zero is one-sided, and control of the behavior as t↓0t\downarrow0t↓0 is part of the result.

The smoothed equations are regular at zero, but a statement about each smoothed trajectory does not by itself give a solution of the original singular equation. The appendix’s uniform bounds and equicontinuity are formulated on a common compact interval for a specified sequence of smoothing parameters. Uniqueness has a second boundary issue: local agreement near zero must be connected to ordinary uniqueness at positive time to obtain agreement for every t≥0t\ge0t≥0.

Formalization scope

The Lean space is EuclideanSpace R (Fin n)\mathrm{EuclideanSpace}\ \mathbb R\ (\mathrm{Fin}\ n)EuclideanSpace R (Fin n), with its Euclidean norm; nnn is arbitrary. The objective class includes convexity, C1C^1C1 regularity, a positive Lipschitz constant, and a globally Lipschitz gradient. A solution is encoded as a pair (X,V)(X,V)(X,V), so V=X˙V=\dot XV=X˙ is witnessed by derivative assertions rather than by a total derivative operator. The initial conditions specify X(0)=x0X(0)=x_0X(0)=x0​, V(0)=0V(0)=0V(0)=0, a right derivative of XXX, and right continuity of VVV. The differential equation and ordinary derivatives are required only at positive times. For the smoothed equation, δ>0\delta>0δ>0 is part of the solution predicate.

These choices rule out a vacuous solution predicate and prevent division by zero from defining a different equation. Lean functions are represented on all real times, but the source’s solution lives on [0,∞)[0,\infty)[0,∞); uniqueness is therefore equality on that half-line. At negative times the formal representatives are unrestricted. The paper’s real suprema MδM_\deltaMδ​ and M~\widetilde MM are expressed as bounds on every member of their defining ranges, so an empty or unbounded real supremum cannot acquire a misleading default value. Every denominator in Lemmas 15 and 17 has the paper’s strict threshold in its hypotheses.

A full proof development needs ordinary differential equation existence and uniqueness at positive time, continuity and derivative facts at the right endpoint, and compactness of uniformly bounded equicontinuous families. The definitions of the objective class and solution predicates, the quantitative estimates, and the local uniqueness statement are welcome solver contributions. The target is the source theorem with its stated hypotheses and conclusion; a special objective, a weakened time interval, or a proof by an impossible hypothesis does not close it.

Selected references

  • Weijie Su, Stephen Boyd, and Emmanuel J. Candès, A Differential Equation for Modeling Nesterov’s Accelerated Gradient Method: Theory and Insights, arXiv:1503.01243v2, 2015; published in Journal of Machine Learning Research 17(153), 2016. Preprint.
9 thms2 active usersReviewed
Markov ChainProbabilityStochastic Systems·Captain: mikedeng1

Coexistence and Extinction for Stochastic Kolmogorov Systems 1: If Every Boundary Ergodic Measure Repels, X Converges Exponentially Fast in Total Variation to a Unique Interior Stationary LawResearch Paper

Motivation

Whether interacting species can coexist in a fluctuating environment is one of the basic questions of mathematical ecology. Deterministic models (Lotka–Volterra competition, predator–prey systems, food chains) answer it through invasion criteria: a population persists if, whenever it is rare, it grows. In a random environment the analogous criterion is phrased through Lyapunov exponents (long-run per-capita growth rates) computed against stationary distributions of the subcommunities in which some species are absent. Schreiber, Benaïm and Atchadé ([SBA11], J. Math. Biol. 62 (2011), MR 2786721) proved such a criterion for stochastic differential equations on a compact state space; A. Hening and D. H. Nguyen (arXiv:1704.06984, Ann. Appl. Probab. 2018) extended it to the non-compact orthant R+n\mathbb R^n_+R+n​, which is where population sizes actually live, and added an exponential rate of convergence.

Timeline. [SBA11] (2011) gave the compact-state SDE criterion via a minimax principle; Hening and Nguyen (2017/2018) removed compactness, proved convergence in total variation at a geometric rate, and in the same paper gave matching extinction results (the second and third missions of this series).

Setting

Let n≥1n\ge1n≥1 be the number of populations and X(t)=(X1(t),…,Xn(t))∈R+n=[0,∞)nX(t)=(X_1(t),\dots,X_n(t))\in\mathbb R^n_+=[0,\infty)^nX(t)=(X1​(t),…,Xn​(t))∈R+n​=[0,∞)n their sizes. The stochastic Kolmogorov system is

dXi(t)=Xi(t)fi(X(t)) dt+Xi(t)gi(X(t)) dEi(t),i=1,…,n,dX_i(t)=X_i(t)f_i(X(t))\,dt+X_i(t)g_i(X(t))\,dE_i(t),\qquad i=1,\dots,n,dXi​(t)=Xi​(t)fi​(X(t))dt+Xi​(t)gi​(X(t))dEi​(t),i=1,…,n,

where fif_ifi​ are per-capita growth rates, gig_igi​ noise intensities, and E(t)=Γ⊤B(t)E(t)=\Gamma^\top B(t)E(t)=Γ⊤B(t) with BBB an nnn-dimensional standard Brownian motion and Σ=Γ⊤Γ=(σij)\Sigma=\Gamma^\top\Gamma=(\sigma_{ij})Σ=Γ⊤Γ=(σij​). Write R+n,∘=(0,∞)n\mathbb R^{n,\circ}_+=(0,\infty)^nR+n,∘​=(0,∞)n for the states with all species present, ∂R+n\partial\mathbb R^n_+∂R+n​ for its complement (some species absent) and ∥x∥=∑i∣xi∣\|x\|=\sum_i|x_i|∥x∥=∑i​∣xi​∣.

Assumption 1.1 (standing) requires: the matrix (gi(x)gj(x)σij)(g_i(x)g_j(x)\sigma_{ij})(gi​(x)gj​(x)σij​) is positive definite on R+n\mathbb R^n_+R+n​; fi,gif_i,g_ifi​,gi​ are locally Lipschitz; and for some c∈R+n,∘c\in\mathbb R^{n,\circ}_+c∈R+n,∘​, γb>0\gamma_b>0γb​>0,

lim sup⁡∥x∥→∞[∑icixifi(x)1+c⊤x−12∑i,jσijcicjxixjgi(x)gj(x)(1+c⊤x)2+γb(1+∑i(∣fi(x)∣+gi2(x)))]<0,\limsup_{\|x\|\to\infty}\Big[\frac{\sum_ic_ix_if_i(x)}{1+c^\top x}-\frac12\frac{\sum_{i,j}\sigma_{ij}c_ic_jx_ix_jg_i(x)g_j(x)}{(1+c^\top x)^2}+\gamma_b\Big(1+\sum_i(|f_i(x)|+g_i^2(x))\Big)\Big]<0,∥x∥→∞limsup​[1+c⊤x∑i​ci​xi​fi​(x)​−21​(1+c⊤x)2∑i,j​σij​ci​cj​xi​xj​gi​(x)gj​(x)​+γb​(1+i∑​(∣fi​(x)∣+gi2​(x)))]<0,

a dissipativity condition satisfied by logistic and competitive Lotka–Volterra models.

PX(t,x,⋅)P_X(t,x,\cdot)PX​(t,x,⋅) is the law of X(t)X(t)X(t) started at xxx. A probability measure μ\muμ is invariant if ∫PX(t,x,⋅) μ(dx)=μ\int P_X(t,x,\cdot)\,\mu(dx)=\mu∫PX​(t,x,⋅)μ(dx)=μ for all ttt; ergodic invariant measures are the extreme points of that convex set. M\mathcal MM is the set of ergodic invariant probability measures supported on ∂R+n\partial\mathbb R^n_+∂R+n​ (it contains the Dirac mass δ∗\delta^*δ∗ at 000), and Conv(M)\mathrm{Conv}(\mathcal M)Conv(M) its finite convex combinations. The Lyapunov exponent of species iii at μ\muμ is

λi(μ)=∫(fi(x)−σiigi2(x)2)μ(dx).\lambda_i(\mu)=\int\Big(f_i(x)-\frac{\sigma_{ii}g_i^2(x)}{2}\Big)\mu(dx).λi​(μ)=∫(fi​(x)−2σii​gi2​(x)​)μ(dx).

Assumption 1.2: max⁡iλi(μ)>0\max_i\lambda_i(\mu)>0maxi​λi​(μ)>0 for every μ∈Conv(M)\mu\in\mathrm{Conv}(\mathcal M)μ∈Conv(M) — every boundary state is invadable by some missing species.

Formalization targets

Goal: Theorem 1.1 (p. 6)

Under Assumptions 1.1 and 1.2 there is an invariant probability measure π∗\pi^*π∗ with π∗(R+n,∘)=1\pi^*(\mathbb R^{n,\circ}_+)=1π∗(R+n,∘​)=1, it is the only invariant probability measure concentrated on R+n,∘\mathbb R^{n,\circ}_+R+n,∘​, and for some r∈(0,1)r\in(0,1)r∈(0,1) and every x∈R+n,∘x\in\mathbb R^{n,\circ}_+x∈R+n,∘​ there is CxC_xCx​ with

∥PX(t,x,⋅)−π∗∥TV≤Cx rt,t≥0.\|P_X(t,x,\cdot)-\pi^*\|_{TV}\le C_x\,r^t,\qquad t\ge0.∥PX​(t,x,⋅)−π∗∥TV​≤Cx​rt,t≥0.

This is strong stochastic persistence (Definition 1.1) with an exponential rate; it leaves the rate rrr and the constants unspecified, as the paper does.

Milestones

The milestones follow the proof: well-posedness, invariant faces and the moment bound (3.6) (Lemma 3.1); uniform moment bounds and the Feller property (Lemma 3.2); integrability under invariant measures (Lemma 3.3); δ∗∈M\delta^*\in\mathcal Mδ∗∈M; convergence of occupation-measure integrals (Lemma 3.4); the log-Laplace bound (Lemma 3.5); irreducibility, aperiodicity and petite compacts for the skeleton chain (Lemma 3.6); the weighted invasion rate (4.1); boundary repulsion on average (Lemma 4.1); the Lyapunov contraction near the boundary (Proposition 4.1); the geometric drift (4.18); geometric ergodicity of the skeleton chain (4.26).

Significance

The result. Theorem 1.1 turns coexistence into a checkable condition on boundary subcommunities: one computes invasion rates of missing species against the stationary laws of the smaller systems. It is the persistence half of a dichotomy whose extinction half (Theorems 1.2–1.3) uses the same exponents, and it underlies the classification of stochastic food chains in the paper's own §2 (Theorem 2.1). The exponential rate gives quantitative mixing and supports further limit theorems for time averages.

Formalizing it. The theorem is proved in the paper but no machine-checked proof is recorded in this mission. A formalization exercises a chain of tools largely absent from current libraries: strong solutions of SDEs with locally Lipschitz coefficients on a closed orthant, the Feller property, tightness and weak limits of occupation measures, invariant and ergodic measures of diffusions, Meyn–Tweedie theory for skeleton chains, and log-Laplace (cumulant) estimates. Each milestone is a self-contained target; several (Lemma 3.5, the Meyn–Tweedie step) are independent of the population model.

Difficulty

The naive argument — positive invasion rates at each boundary ergodic measure imply that the process is pushed away from the boundary — fails twice. First, the state space is non-compact, so occupation measures need not be tight and the growth-rate functionals are unbounded; Assumption 1.1(3) and the moment bounds of Lemmas 3.2–3.4 are what replace compactness. Second, invasion rates are averages along the boundary dynamics, not pointwise drifts: the Lyapunov function V(x)=(1+c⊤x)/∏ixipiV(x)=(1+c^\top x)/\prod_ix_i^{p_i}V(x)=(1+c⊤x)/∏i​xipi​​ decreases only on average over a time window of length T∗T^*T∗, and turning this into a uniform contraction of VθV^\thetaVθ requires controlling the full log-Laplace transform of the increment ln⁡V(X(T))−ln⁡V(x)\ln V(X(T))-\ln V(x)lnV(X(T))−lnV(x) (Proposition 4.1), not just its mean. Uniformity of all constants in the starting point is the delicate part.

Formalization scope

The process is a family X x of strong solutions, one from each x∈R+nx\in\mathbb R^n_+x∈R+n​, on one probability space driven by one Brownian motion, using the published Ethier–Kurtz definitions SolvesBrownianSDE and IsStandardBrownian on Rn=\mathbb R^n=Rn= SDEState n. Coordinates are Fin n; n≥1n\ge1n≥1. The coefficients are functions on Rn\mathbb R^nRn read at the positive part x+x^+x+, which agrees with the model on R+n\mathbb R^n_+R+n​. The norm is ℓ1\ell^1ℓ1. Invariance is stated through the transition probabilities PX(t,x,⋅)=P_X(t,x,\cdot)=PX​(t,x,⋅)= law of Xx(t)X^x(t)Xx(t); ergodic means extremal invariant. The lim sup⁡<0\limsup<0limsup<0 of (1.2) is written as "≤−ε\le-\varepsilon≤−ε for ∥x∥≥R\|x\|\ge R∥x∥≥R". Total variation is the published MarkovChainCLT.tvDist, sup⁡A∣μ(A)−ν(A)∣\sup_A|\mu(A)-\nu(A)|supA​∣μ(A)−ν(A)∣; the paper does not fix the factor 222, and geometric convergence is insensitive to it. The constants M>0,δ0M>0,\delta_0M>0,δ0​ of §3 are data satisfying (3.1), (3.2); HHH is the supremum (3.5).

Deviations, all disclosed in the items: aperiodicity is the Meyn–Tweedie notion (no cycle of d≥2d\ge2d≥2 nonempty disjoint sets), because the literal definition on p. 15 makes every chain aperiodic; (4.1), cited from [SBA11, Lemma 4], retains the attained minimum 2ρ∗2\rho^*2ρ∗ and is stated only in the direction used. Lemma 3.5 allows K2K_2K2​ to depend on the fixed θ0\theta_0θ0​ as its proof requires, despite the page saying “only on K1K_1K1​”. Expectations of nonnegative quantities are lower Lebesgue integrals; wherever a Bochner integral appears, its integrability is part of the conclusion.

Trivializing readings are excluded: uniqueness is among invariant measures on R+n,∘\mathbb R^{n,\circ}_+R+n,∘​ only (boundary invariant measures always exist), M\mathcal MM is nonempty (δ∗∈M\delta^*\in\mathcal Mδ∗∈M is a milestone, so Assumption 1.2 is never vacuous), and every existential constant is quantified before the points it must be uniform in. The logistic model on p. 4 gives a nonvacuous instance of Assumption 1.1.

Contributions welcome: general SDE well-posedness on invariant closed sets, Feller and tightness results for diffusions, Meyn–Tweedie geometric ergodicity for kernels, and cumulant-generating-function bounds, all reusable beyond this mission.

Selected references

  • A. Hening, D. H. Nguyen, Coexistence and extinction for stochastic Kolmogorov systems, Ann. Appl. Probab. 28(3), 2018. arXiv:1704.06984v1. https://arxiv.org/abs/1704.06984
  • S. J. Schreiber, M. Benaïm, K. A. S. Atchadé, Persistence in fluctuating environments, J. Math. Biol. 62(5), 655–683, 2011. MR 2786721, https://mathscinet.ams.org/mathscinet-getitem?mr=2786721
  • S. P. Meyn, R. L. Tweedie, Stability of Markovian processes I: criteria for discrete-time chains, Adv. Appl. Probab. 24(3), 542–574, 1992. MR 1174380, https://mathscinet.ams.org/mathscinet-getitem?mr=1174380
  • R. Khasminskii, Stochastic Stability of Differential Equations, 2nd ed., Springer, 2012. MR 2894052, https://mathscinet.ams.org/mathscinet-getitem?mr=2894052
20 thms2 active usersReviewed
Harmonic AnalysisMachine LearningProbability·Captain: mikedeng1

Approximation Bounds for Random Neural Networks and Reservoir Systems II: Echo State Networks with Random Weights Approximate Regular Functionals with an Explicit L² Error Bound (Theorem 2)Research Paper

Motivation

Reservoir computing learns an input/output system from data in two stages. A dynamical system, the reservoir, is driven by the input sequence and its state is recorded; then only a linear readout of that state is trained, by least squares. The echo state network (ESN) is the most widely used reservoir: its state evolves by xt=σ(Axt−1+Czt+ζ)x_t = \sigma(Ax_{t-1} + Cz_t + \zeta)xt​=σ(Axt−1​+Czt​+ζ), with the matrices A,CA, CA,C and the vector ζ\zetaζ drawn at random and never trained. ESNs predict chaotic systems well in practice (Jaeger & Haas, Science 2004), and they are known to be universal: for every fading-memory input/output map some ESN approximates it (Grigoryeva & Ortega, Neural Netw. 2018). Universality does not explain the practice, where the reservoir weights are random and fixed in advance. Gonon, Grigoryeva & Ortega (Ann. Appl. Probab. 2023) prove that an ESN whose weights are drawn from an explicit distribution that does not depend on the target approximates every sufficiently regular target, with an explicit L2L^2L2 error bound. This mission formalizes that result, Theorem 2, and the chain of results its proof rests on.

Setting

Time runs over Z−={0,−1,−2,… }\mathbb Z_- = \{0, -1, -2, \dots\}Z−​={0,−1,−2,…}. Inputs take values in a set DdD_dDd​ with 0∈Dd⊂BM⊂Rd0 \in D_d \subset B_M \subset \mathbb R^d0∈Dd​⊂BM​⊂Rd, where BMB_MBM​ is the closed Euclidean ball of radius M>0M > 0M>0. The input Z=(Zt)t∈Z−Z = (Z_t)_{t \in \mathbb Z_-}Z=(Zt​)t∈Z−​​ is a DdD_dDd​-valued process with law μZ\mu_ZμZ​. The target is a functional H∗:(Dd)Z−→RH^* : (D_d)^{\mathbb Z_-} \to \mathbb RH∗:(Dd​)Z−​→R, the present output as a function of the whole input history. All norms are Euclidean.

Regularity. Fix weights w−i>0w_{-i} > 0w−i​>0 with ∑ii w−i<∞\sum_i i\, w_{-i} < \infty∑i​iw−i​<∞. H∗H^*H∗ is www-Lipschitz with constant L>0L > 0L>0 if ∣H∗(u)−H∗(v)∣≤L∑i≥0w−i∥u−i−v−i∥|H^*(u) - H^*(v)| \le L\sum_{i \ge 0} w_{-i}\|u_{-i} - v_{-i}\|∣H∗(u)−H∗(v)∣≤L∑i≥0​w−i​∥u−i​−v−i​∥. Assumption 1 asks, in addition, for every T≥1T \ge 1T≥1: with q=d(T+1)q = d(T+1)q=d(T+1), the truncation HT∗(z0,…,z−T)=H∗(…,0,z−T,…,z0)H^*_T(z_0, \dots, z_{-T}) = H^*(\dots, 0, z_{-T}, \dots, z_0)HT∗​(z0​,…,z−T​)=H∗(…,0,z−T​,…,z0​) has a Fourier representation HT∗(u)=∫Rqei⟨w,u⟩gT(w) dwH^*_T(u) = \int_{\mathbb R^q} e^{i\langle w, u\rangle} g_T(w)\,dwHT∗​(u)=∫Rq​ei⟨w,u⟩gT​(w)dw on (Dd)T+1(D_d)^{T+1}(Dd​)T+1, with gT∈L1g_T \in L^1gT​∈L1 and ∫max⁡(1,∥w∥3)∣gT(w)∣2 dw<∞\int \max(1, \|w\|^3)|g_T(w)|^2\,dw < \infty∫max(1,∥w∥3)∣gT​(w)∣2dw<∞.

The random ESN. Fix T,N≥1T, N \ge 1T,N≥1, R>0R > 0R>0, and a bound MTM_TMT​ with ∥(Z0,…,Z−T)∥≤MT\|(Z_0, \dots, Z_{-T})\| \le M_T∥(Z0​,…,Z−T​)∥≤MT​ almost surely. Draw A1,…,ANA_1, \dots, A_NA1​,…,AN​ i.i.d. uniform on BR⊂RqB_R \subset \mathbb R^qBR​⊂Rq and, independently, ζ1,…,ζN\zeta_1, \dots, \zeta_Nζ1​,…,ζN​ i.i.d. uniform on [−max⁡(MTR,1),max⁡(MTR,1)][-\max(M_TR,1), \max(M_TR,1)][−max(MT​R,1),max(MT​R,1)]. With SSS the block shift on Rq\mathbb R^qRq and ccc the embedding of Rd\mathbb R^dRd into the first block, and aaa the matrix with rows Ai⊤A_i^\topAi⊤​, put

Aˉ=(S0aS0),Cˉ=(cac),ζˉ=(0ζ),A=(Aˉ−Aˉ−AˉAˉ),C=(Cˉ−Cˉ),ζ=(ζˉ−ζˉ).\bar A = \begin{pmatrix} S & 0\\ aS & 0\end{pmatrix},\quad \bar C = \begin{pmatrix} c\\ ac\end{pmatrix},\quad \bar\zeta = \begin{pmatrix} 0\\ \zeta\end{pmatrix},\quad A = \begin{pmatrix}\bar A & -\bar A\\ -\bar A & \bar A\end{pmatrix},\quad C = \begin{pmatrix}\bar C\\ -\bar C\end{pmatrix},\quad \zeta = \begin{pmatrix}\bar\zeta\\ -\bar\zeta\end{pmatrix}.Aˉ=(SaS​00​),Cˉ=(cac​),ζˉ​=(0ζ​),A=(Aˉ−Aˉ​−AˉAˉ​),C=(Cˉ−Cˉ​),ζ=(ζˉ​−ζˉ​​).

The ESN is Xt=σ(AXt−1+CZt+ζ)X_t = \sigma(AX_{t-1} + CZ_t + \zeta)Xt​=σ(AXt−1​+CZt​+ζ), Yt=WXtY_t = WX_tYt​=WXt​, with σ(x)=max⁡(x,0)\sigma(x) = \max(x, 0)σ(x)=max(x,0) and state space R2(N+d(T+1))\mathbb R^{2(N+d(T+1))}R2(N+d(T+1)).

Formalization targets

Goal: Theorem 2 (p. 54)

For every H∗H^*H∗ satisfying Assumption 1 there is a readout WWW, a function of the random weights alone, such that the ESN has the echo state property (a unique state sequence for every input) and

E[∣Y0−H∗(Z)∣2]1/2≤CT,RN+∫Rq∖BR∣gT(u)∣ du+LM∑i>Tw−i,\mathbb E\big[|Y_0 - H^*(Z)|^2\big]^{1/2} \le \frac{\sqrt{C_{T,R}}}{\sqrt N} + \int_{\mathbb R^q \setminus B_R}|g_T(u)|\,du + LM\sum_{i > T} w_{-i},E[∣Y0​−H∗(Z)∣2]1/2≤N​CT,R​​​+∫Rq∖BR​​∣gT​(u)∣du+LMi>T∑​w−i​,

with CT,R=16max⁡(MTR,1)Volq(BR)(MT+1)2(MT3+MT+16)∫BRmax⁡(1,∥u∥3)∣gT(u)∣2 duC_{T,R} = 16\max(M_TR,1)\mathrm{Vol}_q(B_R)(M_T+1)^2(M_T^3+M_T+16)\int_{B_R}\max(1,\|u\|^3)|g_T(u)|^2\,duCT,R​=16max(MT​R,1)Volq​(BR​)(MT​+1)2(MT3​+MT​+16)∫BR​​max(1,∥u∥3)∣gT​(u)∣2du.

Milestones

  1. (8), p. 33: a scalar identity expressing eiz−iz−1e^{iz} - iz - 1eiz−iz−1 as an integral of ReLU ramps.
  2. Proposition 2, pp. 31–32: under a Fourier condition, fff is an integral of ReLU ridge functions with a compactly supported, square-integrable weight π\piπ.
  3. Proposition 3, pp. 41–42: a static ReLU network with uniformly sampled inner weights achieves mean-square error C∗/NC^*/NC∗/N.
  4. Corollary 1, p. 43: the same with a dimension-free integrability condition and a truncation term.
  5. Remark 10, p. 53: the shift reservoir is nilpotent, has K=IK = IK=I and stores the last T+1T+1T+1 inputs.
  6. Proposition 6, p. 51: a linear reservoir with a random ReLU readout satisfies the bound (54).
  7. (64)–(66), pp. 55–56: every solution of the ESN reduces to the linear shift reservoir, which gives uniqueness.

Significance

Theorem 2 is the first approximation bound for echo state networks whose recurrent and input weights are sampled from a generic distribution rather than constructed from the target. The bound separates three error sources: a Monte Carlo term decaying like N−1/2N^{-1/2}N−1/2, a truncation term in the sampling radius RRR, and a memory term in the window length TTT. Because the readout can be taken to be the least-squares readout, the bound also controls the trained networks used in practice, and it is the input to the paper's rate and universality corollaries (Corollaries 4 and 5).

Status: the result is proved on paper. No part of it is formalized; the only reservoir-computing material on the platform is the published definition ReservoirESN (the state equation), which this mission reuses. A formal proof would supply the first machine-checked random-feature approximation bound with explicit constants.

Difficulty

The obvious argument fails in two places. First, the classical integral representations of Barron type place the inner weights on unbounded sets, which cannot be sampled uniformly; Proposition 2 needs a change of variables that makes the weight compactly supported while keeping it square integrable, and this costs the factor R−(2q+2)R^{-(2q+2)}R−(2q+2) and the condition (5). Second, a ReLU network is not contractive, so the echo state property of the ESN cannot be taken from the standard contraction criterion; it has to be derived from the block structure of AAA, which makes the difference of the two state halves follow a nilpotent linear recursion.

Formalization scope

Rq\mathbb R^qRq is EuclideanSpace ℝ (Fin (T+1) × Fin d), block kkk holding z−kz_{-k}z−k​; input sequences are ℕ → EuclideanSpace ℝ (Fin d) with index k=−tk = -tk=−t, and xt=F(xt−1,zt)x_t = F(x_{t-1}, z_t)xt​=F(xt−1​,zt​) is the published ReservoirESN.IsSolution. Points of Rq+1\mathbb R^{q+1}Rq+1 are pairs with norm (∥w∥2+u2)1/2(\|w\|^2 + u^2)^{1/2}(∥w∥2+u2)1/2. The uniform laws are Lebesgue measure conditioned on the ball or interval; NNN i.i.d. rows have the product law. The input is independent of the weights (§4.1) and DdD_dDd​-valued with 0∈Dd⊂BM0 \in D_d \subset B_M0∈Dd​⊂BM​ (§5.1): expectations are iterated lower Lebesgue integrals over μZ\mu_ZμZ​ and the product law, and probability-(1−δ)(1-\delta)(1−δ) statements bound the product measure of the bad set. The scalar output case m=1m = 1m=1 is used, as in the paper. Assumption 1 is required for every T≥1T \ge 1T≥1, as printed.

A readout allowed to depend on the input would make every bound trivial; in every statement the readout is a measurable function of the inner weights alone.

Departures from the print, each disclosed in the item: the last term of Proposition 6 is the L2(μZ)L^2(\mu_Z)L2(μZ​) norm of ∥K−1ST+1X−T−1∥\|K^{-1}S^{T+1}X_{-T-1}\|∥K−1ST+1X−T−1​∥, which the page prints outside the expectation; the state space of the linear reservoir (52) is a parameter DND_NDN​, as in §2.1, and its solution is assumed to be a random process; Proposition 3 omits "C∗>0C^* > 0C∗>0" (the explicit value (33) is used); measurability of the Fourier density ggg is stated where the page leaves it implicit.

A complete development needs Fourier integrals on Euclidean spaces, change of variables under linear maps, product measures and Fubini–Tonelli, and an importance-sampling variance bound. The static results (Propositions 2, 3, Corollary 1) are reusable for random-feature models beyond reservoir computing. Proofs of any milestone, and alternative arguments, are welcome.

Selected references

  • L. Gonon, L. Grigoryeva, J.-P. Ortega, Approximation bounds for random neural networks and reservoir systems, Ann. Appl. Probab. 33(1), 28–69, 2023. https://doi.org/10.1214/22-AAP1806
  • L. Grigoryeva, J.-P. Ortega, Echo state networks are universal, Neural Netw. 108, 495–508, 2018. https://doi.org/10.1016/j.neunet.2018.08.025
  • H. Jaeger, H. Haas, Harnessing nonlinearity: predicting chaotic systems and saving energy in wireless communication, Science 304, 78–80, 2004. https://doi.org/10.1126/science.1091277
  • A. R. Barron, Universal approximation bounds for superpositions of a sigmoidal function, IEEE Trans. Inf. Theory 39, 930–945, 1993. https://doi.org/10.1109/18.256500
  • J. M. Klusowski, A. R. Barron, Approximation by combinations of ReLU and squared ReLU ridge functions with ℓ1 and ℓ0 controls, IEEE Trans. Inf. Theory 64, 7649–7656, 2018. https://doi.org/10.1109/tit.2018.2874447
  • C. Cuchiero, L. Gonon, L. Grigoryeva, J.-P. Ortega, J. Teichmann, Discrete-time signatures and randomness in reservoir computing, IEEE Trans. Neural Netw. Learn. Syst., 2021. https://doi.org/10.1109/TNNLS.2021.3076777
11 thms2 active usersReviewed
Machine LearningProbability·Captain: mikedeng1

Approximation Bounds for Random Neural Networks and Reservoir Systems III: Echo State Networks with Output Feedback and Random Weights Approximate Contracting Reservoirs (Theorem 4)Research Paper

Motivation

An echo state network with output feedback is a recurrent model whose previous output is fed back into its next hidden-state update. In reservoir computing only the linear output weights are trained, while the internal weights are fixed, typically after being drawn at random. This raises a quantitative question: if the internal rows are sampled from a fixed law, can a network with NNN blocks of random rows and a suitable linear readout approximate a given input–output rule, and at what rate in NNN? Gonon, Grigoryeva and Ortega answer this for targets generated by contracting reservoir systems. Their Theorem 4 (p. 63) gives, with explicit constants, a probability bound and an excess-risk bound of order 1/N1/\sqrt N1/N​, plus a term decaying geometrically in the length TTT of the observation window. The input set is not required to be bounded: the bound depends on the input process only through E[max⁡t∥Zt∥]\mathbb E[\max_{t}\|Z_t\|]E[maxt​∥Zt​∥] over the window.

Setting

Inputs are vectors in a set Dd⊆RdD_d\subseteq\mathbb R^dDd​⊆Rd and an input history is z=(zt)t∈Z−z=(z_t)_{t\in\mathbb Z_-}z=(zt​)t∈Z−​​, with Z−={0,−1,−2,… }\mathbb Z_-=\{0,-1,-2,\dots\}Z−​={0,−1,−2,…}. A target reservoir is a map F∗:RN∗×Dd→BMF^*:\mathbb R^{N^*}\times D_d\to B_MF∗:RN∗×Dd​→BM​, with BMB_MBM​ the closed Euclidean ball of radius MMM, such that F∗(⋅,v)F^*(\cdot,v)F∗(⋅,v) is an rrr-contraction for every v∈Ddv\in D_dv∈Dd​, with r∈(0,1)r\in(0,1)r∈(0,1). Its reservoir functional is H∗(z)=x0∗H^*(z)=x^*_0H∗(z)=x0∗​, where xt∗=F∗(xt−1∗,zt)x^*_t=F^*(x^*_{t-1},z_t)xt∗​=F∗(xt−1∗​,zt​) for all t∈Z−t\in\mathbb Z_-t∈Z−​. The output dimension is m=N∗m=N^*m=N∗.

The approximating network has NNN blocks of N∗N^*N∗ rows. Each row is a vector ω=(a,c,ζ)∈RN∗+d+1\omega=(a,c,\zeta)\in\mathbb R^{N^*+d+1}ω=(a,c,ζ)∈RN∗+d+1, and the Nˉ=NN∗\bar N=NN^*Nˉ=NN∗ rows Uj(i)U_j^{(i)}Uj(i)​ of [A,C,ζ][A,C,\zeta][A,C,ζ] are i.i.d. with law π\piπ. With an activation σ\sigmaσ and a readout matrix W∈Mm,NˉW\in\mathbb M_{m,\bar N}W∈Mm,Nˉ​, the system is

xt=σ(Ayt−1+Czt+ζ),yt=Wxt,t=−T,…,0,y−T−1=Ξ,x_t=\sigma(Ay_{t-1}+Cz_t+\zeta),\qquad y_t=Wx_t,\qquad t=-T,\dots,0,\qquad y_{-T-1}=\Xi,xt​=σ(Ayt−1​+Czt​+ζ),yt​=Wxt​,t=−T,…,0,y−T−1​=Ξ,

with T≥1T\ge1T≥1 and ∥Ξ∥≤M\|\Xi\|\le M∥Ξ∥≤M; its functional is HWA,C,ζ(z)=y0H^{A,C,\zeta}_W(z)=y_0HWA,C,ζ​(z)=y0​. For each k≥1k\ge1k≥1 and j=1,…,N∗j=1,\dots,N^*j=1,…,N∗ a signed measure πjk≪π\pi_j^k\ll\piπjk​≪π defines the integral map

Fj∗,N(x,v)=∫σ((x,v,1)⋅ω) πjN(dω).F_j^{*,N}(x,v)=\int\sigma((x,v,1)\cdot\omega)\,\pi_j^N(d\omega).Fj∗,N​(x,v)=∫σ((x,v,1)⋅ω)πjN​(dω).

The constant C∗=43Lσsup⁡k∑j(∫∥ω∥2(dπjk/dπ)2dπ)1/2C_*=4\sqrt3L_\sigma\sup_{k}\sum_j(\int\|\omega\|^2(d\pi_j^k/d\pi)^2d\pi)^{1/2}C∗​=43​Lσ​supk​∑j​(∫∥ω∥2(dπjk​/dπ)2dπ)1/2 measures the size of these densities, and sN=E[max⁡t∈{0,…,−T}sup⁡x∈BM+1∥F∗,N(x,Zt)−F∗(x,Zt)∥]s_N=\mathbb E[\max_{t\in\{0,\dots,-T\}}\sup_{x\in B_{M+1}}\|F^{*,N}(x,Z_t)-F^*(x,Z_t)\|]sN​=E[maxt∈{0,…,−T}​supx∈BM+1​​∥F∗,N(x,Zt​)−F∗(x,Zt​)∥] is the approximation error of F∗,NF^{*,N}F∗,N. The input process ZZZ is independent of (A,C,ζ)(A,C,\zeta)(A,C,ζ), Y0Y_0Y0​ is an integrable target, and the loss L≥0L\ge0L≥0 is Lipschitz with constant LLL_LLL​. The echo state event ΩESP\Omega_{\mathrm{ESP}}ΩESP​ of (87) is the event that ∥WFA,C,ζ(x,Zt)∥≤M+1\|WF^{A,C,\zeta}(x,Z_t)\|\le M+1∥WFA,C,ζ(x,Zt​)∥≤M+1 for all x∈BM+1x\in B_{M+1}x∈BM+1​ and t∈{0,…,−T}t\in\{0,\dots,-T\}t∈{0,…,−T}, where FA,C,ζ(x,v)=σ(Ax+Cv+ζ)F^{A,C,\zeta}(x,v)=\sigma(Ax+Cv+\zeta)FA,C,ζ(x,v)=σ(Ax+Cv+ζ).

Formalization targets

Steps of the proof

The milestones are the displayed estimates of the proof, in attack order:

  1. (89): one step of the error recursion on ΩESP\Omega_{\mathrm{ESP}}ΩESP​, E[∥Yt−Xt∗∥1ΩESP]≤E[sup⁡y∥⋯∥]+sN+r E[∥Yt−1−Xt−1∗∥1ΩESP]\mathbb E[\|Y_t-X^*_t\|\mathbb 1_{\Omega_{\mathrm{ESP}}}]\le\mathbb E[\sup_{y}\|\cdots\|]+s_N+r\,\mathbb E[\|Y_{t-1}-X^*_{t-1}\|\mathbb 1_{\Omega_{\mathrm{ESP}}}]E[∥Yt​−Xt∗​∥1ΩESP​​]≤E[supy​∥⋯∥]+sN​+rE[∥Yt−1​−Xt−1∗​∥1ΩESP​​];
  2. (90): splitting into coordinates and symmetrization of the uniform error of the random map;
  3. (91): a deterministic bound on Rademacher averages,
Eεsup⁡y∈BM+1∣∑i=1Nviεiσ((y,z,1)⋅ui)∣≤2Lσ((M+1)(∑ivi2∥ai∥2)1/2+∥z∥(∑ivi2∥ci∥2)1/2+(∑ivi2ζi2)1/2);\mathbb E_\varepsilon\sup_{y\in B_{M+1}}\Big|\sum_{i=1}^N v_i\varepsilon_i\sigma((y,z,1)\cdot u_i)\Big|\le2L_\sigma\Big((M+1)\big(\textstyle\sum_iv_i^2\|a_i\|^2\big)^{1/2}+\|z\|\big(\sum_iv_i^2\|c_i\|^2\big)^{1/2}+\big(\sum_iv_i^2\zeta_i^2\big)^{1/2}\Big);Eε​y∈BM+1​sup​​i=1∑N​vi​εi​σ((y,z,1)⋅ui​)​≤2Lσ​((M+1)(∑i​vi2​∥ai​∥2)1/2+∥z∥(∑i​vi2​∥ci​∥2)1/2+(∑i​vi2​ζi2​)1/2);
  1. (92)–(93): for each fixed input z∈Ddz\in D_dz∈Dd​,
Esup⁡y∈BM+1∥1N∑i=1NWiσ(A(i)y+C(i)z+ζ(i))−F∗,N(y,z)∥≤(M+2+∥z∥)C∗N;\mathbb E\sup_{y\in B_{M+1}}\Big\|\frac1N\sum_{i=1}^NW_i\sigma(A^{(i)}y+C^{(i)}z+\zeta^{(i)})-F^{*,N}(y,z)\Big\|\le\frac{(M+2+\|z\|)C_*}{\sqrt N};Ey∈BM+1​sup​​N1​i=1∑N​Wi​σ(A(i)y+C(i)z+ζ(i))−F∗,N(y,z)​≤N​(M+2+∥z∥)C∗​​;
  1. (96): P(Ω∖ΩESP)≤2(M+2+E[max⁡t∥Zt∥])C∗/N+2sN\mathbb P(\Omega\setminus\Omega_{\mathrm{ESP}})\le2(M+2+\mathbb E[\max_t\|Z_t\|])C_*/\sqrt N+2s_NP(Ω∖ΩESP​)≤2(M+2+E[maxt​∥Zt​∥])C∗​/N​+2sN​.

Goal: Theorem 4

There is a readout WWW, a function of (A,C,ζ)(A,C,\zeta)(A,C,ζ) alone, such that for every δ∈(0,1)\delta\in(0,1)δ∈(0,1) and every ∥Ξ∥≤M\|\Xi\|\le M∥Ξ∥≤M, with probability at least max⁡(1−δ−2C∗(M+2+E[max⁡t∥Zt∥])/N−2sN,0)\max(1-\delta-2C_*(M+2+\mathbb E[\max_t\|Z_t\|])/\sqrt N-2s_N,0)max(1−δ−2C∗​(M+2+E[maxt​∥Zt​∥])/N​−2sN​,0), the event ΩESP\Omega_{\mathrm{ESP}}ΩESP​ holds and

∣R(HWA,C,ζ)−R(H∗)∣≤LLδ[(M+2+max⁡tE∥Zt∥)C∗(1−r)N+sN1−r+2(M+1)rT+1],|\mathcal R(H^{A,C,\zeta}_W)-\mathcal R(H^*)|\le \frac{L_L}{\delta}\Big[\frac{(M+2+\max_t\mathbb E\|Z_t\|)C_*}{(1-r)\sqrt N}+\frac{s_N}{1-r}+2(M+1)r^{T+1}\Big],∣R(HWA,C,ζ​)−R(H∗)∣≤δLL​​[(1−r)N​(M+2+maxt​E∥Zt​∥)C∗​​+1−rsN​​+2(M+1)rT+1],

where R(H)=E[L(H(Z),Y0)]\mathcal R(H)=\mathbb E[L(H(Z),Y_0)]R(H)=E[L(H(Z),Y0​)] is evaluated at fixed network weights.

Significance

The bound separates three sources of error: sampling NNN blocks of random rows (rate 1/N1/\sqrt N1/N​), the approximation of F∗F^*F∗ by the integral map F∗,NF^{*,N}F∗,N (sNs_NsN​), and the finite initialization of the feedback recursion (rT+1r^{T+1}rT+1). Only the readout depends on the target; the internal weights are generated without it. The theorem also bounds the probability that the random feedback map leaves the state ball on which the recursion is controlled, which is the form in which the echo state property enters. Via Theorem 3 (p. 62), which specializes the densities through the paper's Proposition 2, it gives approximation rates for ReLU output-feedback networks.

The paper proves the result on pp. 63–68. No part of it is formalized. A complete development would give machine-checked Rademacher symmetrization and contraction estimates for random features, uniform-over-a-ball bounds for sampled integral maps, and a treatment of finite feedback recursions on product probability spaces, all reusable outside reservoir computing.

Difficulty

A pointwise approximation of F∗F^*F∗ by the sampled map does not control the feedback system, because the next feedback value is itself the random output of the previous update. The comparison must hold uniformly over the state ball BM+1B_{M+1}BM+1​ and over the whole input window, and the event that the recursion leaves the ball must be charged to an explicit probability. The uniform bound requires symmetrization and the Ledoux–Talagrand contraction principle for a supremum over a continuum of states, with per-index contractions; Lipschitz continuity of σ\sigmaσ alone does not supply the vanishing at zero that principle needs. The input is unbounded, so the input dependence must be tracked through ∥z∥\|z\|∥z∥ and integrated at the end.

Formalization scope

States, inputs, outputs and rows are Euclidean spaces (EuclideanSpace); a row is indexed by ({1..N∗}⊔{1..d})⊔{∗}(\{1..N^*\}\sqcup\{1..d\})\sqcup\{\ast\}({1..N∗}⊔{1..d})⊔{∗} and the rows by {1..N}×{1..N∗}\{1..N\}\times\{1..N^*\}{1..N}×{1..N∗}. Time t∈Z−t\in\mathbb Z_-t∈Z−​ is the index −t∈N-t\in\mathbb N−t∈N; the equation (78) is the published ReservoirESN.IsSolution. The rows have law π⊗NN∗\pi^{\otimes NN^*}π⊗NN∗ on their own space and (Z,Y0)(Z,Y_0)(Z,Y0​) lives on a separate probability space; the probability is under the product law, which encodes the independence of §6.1. Signed measures πjk\pi_j^kπjk​ are their Radon–Nikodym densities with respect to π\piπ, with integrability and first-moment hypotheses. C∗C_*C∗​, sNs_NsN​ and E[max⁡t∥Zt∥]\mathbb E[\max_t\|Z_t\|]E[maxt​∥Zt​∥] are extended nonnegative integrals and suprema, converted to reals only under their finiteness hypotheses; the risk integrals are finite under the loss Lipschitz bound, integrable target and input-moment assumption; the supremum in (87) is unfolded. F∗F^*F∗ is assumed jointly measurable, the standing convention that makes sNs_NsN​ and H∗(Z)H^*(Z)H∗(Z) random variables; the standing assumptions d,N∗≥1d,N^*\ge1d,N∗≥1 and M>0M>0M>0 (p. 30) and T≥1T\ge1T≥1 (§6.1) are hypotheses.

Trivialization ruled out. The readout is a measurable function of the rows only and is chosen before δ\deltaδ and Ξ\XiΞ. A readout allowed to look at the input ZZZ would make the claim a different and much weaker statement.

Correction of the print. The goal and milestones (91), (93), (96) assume σ(0)=0\sigma(0)=0σ(0)=0: the contraction principle cited at (91) needs contractions vanishing at zero, while the printed theorem states only that σ\sigmaσ is Lipschitz. ReLU, the paper's application, satisfies it. The goal retains the printed full risk difference. Its proof passes through (88), where an indicator depending on ZZZ is moved inside a risk integral; this step needs further justification. The milestone quotations keep the printed text.

Contributions are welcome on each milestone, on general Rademacher symmetrization and contraction lemmas for suprema over compact parameter sets, on measurability of suprema of continuous random fields, and on the printed form of the risk bound.

Selected references

  • L. Gonon, L. Grigoryeva and J.-P. Ortega, Approximation bounds for random neural networks and reservoir systems, The Annals of Applied Probability 33(1), 2023, 28–69. https://doi.org/10.1214/22-AAP1806
  • M. Ledoux and M. Talagrand, Probability in Banach Spaces: Isoperimetry and Processes, Springer, 1991 (Theorem 4.12, the contraction principle). https://doi.org/10.1007/978-3-642-20212-4
8 thms2 active usersReviewed
Control Theory·Captain: mikedeng1

Input-to-State Stability of Nonlinear Impulsive Systems 2: An Exponential ISS-Lyapunov Function Makes an Impulsive System Uniformly ISS under the Generalized Average Dwell-Time ConditionResearch Paper

Motivation

An impulsive system evolves continuously most of the time and changes state instantaneously at specified impulse times. Reset controllers, sampled interventions, and hybrid models have this shape. A stability estimate for the continuous dynamics alone can fail after many jumps: a jump may enlarge the state, and even a contracting jump can be too sparse to offset an expanding flow. Dashkovskiy and Mironchenko study how a condition on the timing of impulses combines the two effects to yield input-to-state stability (ISS) for nonlinear systems on Banach spaces. Their Theorem 5 treats a generalized average dwell-time condition and asks for one stability estimate shared by every admissible impulse schedule Dashkovskiy and Mironchenko, §3.1, Theorem 5.

The source is the 2012 arXiv v1 preprint, which was subsequently published in SIAM Journal on Control and Optimization in 2013. This mission uses the preprint's page and equation numbers throughout. The goal is posed with a documented correction to the jump hypothesis because the theorem as printed is false under its own Definition 4; the correction is the max-form condition displayed in Proposition 3.2 of the same paper.

Setting

The state xxx lies in a real Banach space XXX, and the input value ξ\xiξ lies in another real Banach space UUU. The continuous transition map ϕc(t,x,u)\phi_c(t,x,u)ϕc​(t,x,u) gives the state after flowing for t≥0t\ge0t≥0 from xxx under an input function uuu. A jump map J(x,ξ)J(x,\xi)J(x,ξ) gives the new state when an impulse occurs. An impulse schedule T=(t1,t2,…)T=(t_1,t_2,\ldots)T=(t1​,t2​,…) is strictly increasing and has no finite accumulation point. Between impulses the trajectory follows ϕc\phi_cϕc​; at tit_iti​ it takes the value J(x(ti−),u(ti−))J(x(t_i^-),u(t_i^-))J(x(ti−​),u(ti−​)). Inputs are bounded and piecewise right-continuous. This is the transition-map view used by the source when it defines the Lie derivative; it does not require an explicit generator of a C0C_0C0​ semigroup in the mission interface Dashkovskiy and Mironchenko, pp. 3–5.

A comparison function in K∞\mathcal K_\inftyK∞​ is continuous, strictly increasing, zero at zero, and unbounded. A function in L\mathcal LL is continuous, strictly decreasing, and tends to zero at infinite time. A function in KL\mathcal{KL}KL is of class K\mathcal KK in its first argument and of class L\mathcal LL in its second argument for every positive first argument. The nonnegative Lyapunov function VVV measures the state through two functions ψ1,ψ2∈K∞\psi_1,\psi_2\in\mathcal K_\inftyψ1​,ψ2​∈K∞​:

ψ1(∥x∥)≤V(x)≤ψ2(∥x∥).\psi_1(\|x\|)\le V(x)\le\psi_2(\|x\|).ψ1​(∥x∥)≤V(x)≤ψ2​(∥x∥).

The continuous rate c∈Rc\in\mathbb Rc∈R and jump rate d∈Rd\in\mathbb Rd∈R enter through V˙u(x)≤−cV(x)\dot V_u(x)\le-cV(x)V˙u​(x)≤−cV(x) whenever V(x)≥γ(∥u(0)∥)V(x)\ge\gamma(\|u(0)\|)V(x)≥γ(∥u(0)∥), and through the max-form jump bound V(J(x,ξ))≤max⁡{e−dV(x),γ(∥ξ∥)}V(J(x,\xi))\le\max\{e^{-d}V(x),\gamma(\|\xi\|)\}V(J(x,ξ))≤max{e−dV(x),γ(∥ξ∥)} for every state and input value. The Lie derivative V˙u\dot V_uV˙u​ is an upper-right Dini derivative, so it can exist as an extended real even where an ordinary derivative does not Dashkovskiy and Mironchenko, (3.3)–(3.6), Proposition 3.2.

For a schedule TTT, let N(t,s)N(t,s)N(t,s) count impulses in (s,t](s,t](s,t]. Given a positive function hhh dominated by some g∈Lg\in\mathcal Lg∈L, the generalized average dwell-time class S[h]S[h]S[h] consists of schedules satisfying

−dN(t,s)−c(t−s)≤log⁡h(t−s)(t≥s≥0).-dN(t,s)-c(t-s)\le\log h(t-s)\qquad(t\ge s\ge0).−dN(t,s)−c(t−s)≤logh(t−s)(t≥s≥0).

This condition permits the schedule to reflect the actual rates ccc and ddd, including cases where one mode is destabilizing Dashkovskiy and Mironchenko, (3.29).

Formalization targets

Corrected Theorem 5

The goal asserts uniform ISS over S[h]S[h]S[h]. One pair β∈KL\beta\in\mathcal{KL}β∈KL and γ′∈K∞\gamma'\in\mathcal K_\inftyγ′∈K∞​ must work for all schedules T∈S[h]T\in S[h]T∈S[h], all initial states, and all admissible inputs bounded by MMM:

∥x(t)∥≤β(∥x0∥,t)+γ′(M)(t≥0).\|x(t)\|\le\beta(\|x_0\|,t)+\gamma'(M)\qquad(t\ge0).∥x(t)∥≤β(∥x0​∥,t)+γ′(M)(t≥0).

The theorem assumes d≠0d\ne0d=0, as printed. The draft goal uses Proposition 3.2's max-form jump bound. Its four milestones retain the source's estimates on an impulse-free flow piece, on an above-threshold excursion, before the first threshold visit, and after such a visit. The source displays are quoted in the milestone list with the preprint's page and equation numbers Dashkovskiy and Mironchenko, pp. 11–13.

Significance

The result gives a common quantitative stability claim for a family of impulse schedules, rather than a separate estimate chosen after seeing each schedule. The common comparison functions matter when a controller or system class permits many possible reset times. The source's generalized condition also records both continuous and jump rates directly, so it covers more than a fixed minimum separation between impulses Dashkovskiy and Mironchenko, §3.1–3.2.

The theorem and its four supporting estimates are currently draft statements, without machine-checked proofs. Completing the mission would formalize the known corrected argument and produce reusable definitions for piecewise inputs, impulse counts, right-continuous trajectories, and upper Dini Lyapunov conditions. Existing published platform definitions supply the comparison classes K\mathcal KK, K∞\mathcal K_\inftyK∞​, and positive-definite functions, and the extended-real upper-right Dini derivative. The mission adds the dynamics and dwell-time layer needed to state this paper's result.

Difficulty

An interval with no impulse supports an exponential flow estimate only while the Lyapunov value stays above the input threshold. A jump can change both the state and which side of that threshold the trajectory occupies. The printed split into V≥γ(M)V\ge\gamma(M)V≥γ(M) and V<γ(M)V<\gamma(M)V<γ(M) has a boundary case: a jump can land exactly at V=γ(M)V=\gamma(M)V=γ(M) without satisfying the multiplicative part of the max-form jump estimate. The excursion milestone therefore uses a strict above-threshold condition after its starting time, and the threshold-visit milestone covers the boundary. Uniformity adds another requirement: the final comparison functions must be chosen before the impulse schedule Dashkovskiy and Mironchenko, proof of Theorem 5, pp. 11–13.

Formalization scope

Lean represents time by real numbers and nonnegative comparison values by R≥0\mathbb R_{\ge0}R≥0​. The state and input spaces are real Banach spaces. The system is encoded by (ϕc,J)(\phi_c,J)(ϕc​,J) with identity, shifted-cocycle, flow-continuity, and zero-equilibrium properties; its solutions are the trajectories assembled from those maps. Initial time is fixed at 000, and the first impulse must occur strictly afterward. This removes an undefined left input limit at the initial instant. The input size is stated by a uniform bound MMM on t≥0t\ge0t≥0, equivalent to the source's supremum norm for monotone gains. The upper-right Dini derivative lives in the extended reals, and N(t,s)N(t,s)N(t,s) counts the left-open, right-closed interval (s,t](s,t](s,t].

The max-form jump hypothesis is a necessary correction: under the printed implication-form clause, take x˙=−x\dot x=-xx˙=−x, V(x)=∣x∣V(x)=|x|V(x)=∣x∣, and a jump that sends x=0x=0x=0 to 111 under any small positive input while satisfying the clause outside the threshold region. Every schedule can satisfy (3.29), yet ISS fails as the input tends to zero. The nontrivial scalar system x˙=−x\dot x=-xx˙=−x with jump x↦x/2x\mapsto x/2x↦x/2 satisfies the chosen system axioms in a sorry-free sanity file. The goal's existential β,γ′\beta,\gamma'β,γ′ precede the quantifier over schedules; the input bound is not an unbounded real supremum, and the derivative is not a junk-valued real limit.

Reusable contributions include analysis of the extended-real Dini derivative along a cocycle, finite impulse counting, and comparison lemmas for the four source estimates. The source's local Theorem 6 and the relations among dwell-time classes are outside this mission.

Selected references

  • S. Dashkovskiy and A. Mironchenko, Input-to-State Stability of Nonlinear Impulsive Systems, arXiv:1212.5481v1, 2012; SIAM Journal on Control and Optimization 51(3), 2013. Preprint; DOI.
  • S. Dashkovskiy, B. S. Rüffer, and F. R. Wirth, Small Gain Theorems for Large Scale Systems and Construction of ISS Lyapunov Functions, arXiv:0901.1842v2, 2009. Preprint.
9 thms2 active usersReviewed
Control Theory·Captain: mikedeng1

Input-to-State Stability of Nonlinear Impulsive Systems 1: An ISS-Lyapunov Function Makes an Impulsive System ISS for Every Impulse Sequence Satisfying the Nonlinear Fixed Dwell-Time ConditionResearch Paper

Motivation

Impulsive systems evolve continuously most of the time and change their state abruptly at isolated instants. They model sampled-data and networked control loops, where a controller acts at transmission times; population and epidemic models with periodic harvesting or vaccination; and mechanical systems with impacts. Their inputs are disturbances, measurement errors or exogenous signals, and the natural robustness notion is input-to-state stability (ISS): the state is bounded by a decaying function of the initial state plus a gain of the input size.

For impulsive systems ISS depends on when the jumps occur. A flow that contracts and jumps that expand (or the reverse) can be stable or unstable depending on how dense the impulse times are. Dwell-time conditions, which restrict the impulse-time sequences, are the standard tool.

S. Dashkovskiy and A. Mironchenko, Input-to-state stability of nonlinear impulsive systems (SIAM J. Control Optim. 51(3), 2013), establish Lyapunov-type sufficient conditions for ISS of nonlinear impulsive systems on Banach spaces. This mission formalizes the first of them, Theorem 1: a nonlinear fixed dwell-time condition, attributed in the paper to Samoilenko and Perestyuk’s monograph on impulsive differential equations, together with an ISS-Lyapunov function, gives ISS for every impulse sequence whose impulses are at least θ\thetaθ apart.

Timeline. Hespanha, Liberzon and Teel (Automatica 2008) proved ISS of finite-dimensional impulsive systems under average dwell-time conditions with exponential ISS-Lyapunov functions. Dashkovskiy and Mironchenko (arXiv 2012, SICON 2013) extended Lyapunov criteria to infinite-dimensional systems and to non-exponential Lyapunov functions (Theorem 1), and to a generalized average dwell-time condition (Theorem 5, the second mission of this series).

Setting

Let XXX (states) and UUU (input values) be Banach spaces. The system is

x˙(t)=Ax(t)+f(x(t),u(t)),t∉T,x(t)=g(x−(t),u−(t)),t∈T,\dot x(t)=Ax(t)+f(x(t),u(t)),\quad t\notin T,\qquad x(t)=g(x^-(t),u^-(t)),\quad t\in T,x˙(t)=Ax(t)+f(x(t),u(t)),t∈/T,x(t)=g(x−(t),u−(t)),t∈T,

where T={t1<t2<⋯ }T=\{t_1<t_2<\cdots\}T={t1​<t2​<⋯} is the sequence of impulse times (no finite accumulation point), x−(t)x^-(t)x−(t) and u−(t)u^-(t)u−(t) are left limits, and inputs uuu belong to Uc=PC([t0,∞),U)U_c=PC([t_0,\infty),U)Uc​=PC([t0​,∞),U), the piecewise right-continuous bounded functions with ∥u∥Uc=sup⁡t≥t0∥u(t)∥\|u\|_{U_c}=\sup_{t\ge t_0}\|u(t)\|∥u∥Uc​​=supt≥t0​​∥u(t)∥. Solutions are assumed to exist and be unique, and f(0,0)=g(0,0)=0f(0,0)=g(0,0)=0f(0,0)=g(0,0)=0.

The transition map ϕc(t,0,x,u)\phi_c(t,0,x,u)ϕc​(t,0,x,u) of the continuous part is the state at time ttt when the state at time 000 was xxx, the input uuu was applied and there were no impulses. The trajectory x(t)=ϕ(t,t0,x0,u)x(t)=\phi(t,t_0,x_0,u)x(t)=ϕ(t,t0​,x0​,u) follows ϕc\phi_cϕc​ between impulses and jumps by ggg at each tkt_ktk​.

Comparison functions: P\mathcal PP (continuous, zero exactly at 000), K\mathcal KK (in P\mathcal PP and strictly increasing), K∞\mathcal K_\inftyK∞​ (unbounded K\mathcal KK), L\mathcal LL (continuous, strictly decreasing to 000), and KL\mathcal{KL}KL. The system is ISS for TTT if, for some β∈KL\beta\in\mathcal{KL}β∈KL and γ∈K∞\gamma\in\mathcal K_\inftyγ∈K∞​,

∥x(t)∥≤β(∥x0∥,t−t0)+γ(∥u∥Uc)for all x0, u, t≥t0.\|x(t)\|\le\beta(\|x_0\|,t-t_0)+\gamma(\|u\|_{U_c})\qquad\text{for all }x_0,\ u,\ t\ge t_0 .∥x(t)∥≤β(∥x0​∥,t−t0​)+γ(∥u∥Uc​​)for all x0​, u, t≥t0​.

The Lie derivative of V:X→R+V:X\to\mathbb R_+V:X→R+​ is the upper right Dini derivative V˙u(x)=lim sup⁡t→+01t(V(ϕc(t,0,x,u))−V(x))\dot V_u(x)=\limsup_{t\to+0}\frac1t\big(V(\phi_c(t,0,x,u))-V(x)\big)V˙u​(x)=limsupt→+0​t1​(V(ϕc​(t,0,x,u))−V(x)). An ISS-Lyapunov function in max form (Proposition 3.1 of the paper) is a continuous VVV with ψ1(∥x∥)≤V(x)≤ψ2(∥x∥)\psi_1(\|x\|)\le V(x)\le\psi_2(\|x\|)ψ1​(∥x∥)≤V(x)≤ψ2​(∥x∥), ψ1,ψ2∈K∞\psi_1,\psi_2\in\mathcal K_\inftyψ1​,ψ2​∈K∞​, and γ∈K∞\gamma\in\mathcal K_\inftyγ∈K∞​, α∈P\alpha\in\mathcal Pα∈P and a flow rate φ\varphiφ such that

V(x)≥γ(∥u(0)∥) ⇒ V˙u(x)≤−φ(V(x)),V(g(x,ξ))≤max⁡{α(V(x)),γ(∥ξ∥)}.V(x)\ge\gamma(\|u(0)\|)\ \Rightarrow\ \dot V_u(x)\le-\varphi(V(x)),\qquad V(g(x,\xi))\le\max\{\alpha(V(x)),\gamma(\|\xi\|)\}.V(x)≥γ(∥u(0)∥) ⇒ V˙u​(x)≤−φ(V(x)),V(g(x,ξ))≤max{α(V(x)),γ(∥ξ∥)}.

The class SθS_\thetaSθ​ consists of impulse sequences with ti+1−ti≥θt_{i+1}-t_i\ge\thetati+1​−ti​≥θ for all iii.

Formalization targets

Goal: Theorem 1 (p. 6), corrected

Let VVV be an ISS-Lyapunov function in max form with φ∈P\varphi\in\mathcal Pφ∈P, and suppose that for some θ,δ>0\theta,\delta>0θ,δ>0

∫aα(a)dsφ(s)≤θ−δfor all a>0.(3.7)\int_a^{\alpha(a)}\frac{ds}{\varphi(s)}\le\theta-\delta\qquad\text{for all }a>0. \tag{3.7}∫aα(a)​φ(s)ds​≤θ−δfor all a>0.(3.7)

Then the system is ISS for every T∈SθT\in S_\thetaT∈Sθ​, with β\betaβ allowed to depend on TTT.

Milestones (proof of Theorem 1, pp. 7–9)

  1. (3.11): on a flow piece with y=V(x(⋅))>0y=V(x(\cdot))>0y=V(x(⋅))>0 and D+y≤−φ(y)D^+y\le-\varphi(y)D+y≤−φ(y), the function F(q)=∫rqds/φ(s)F(q)=\int_r^q ds/\varphi(s)F(q)=∫rq​ds/φ(s) satisfies F(y(t))−F(y(ti))≤−(t−ti)F(y(t))-F(y(t_i))\le-(t-t_i)F(y(t))−F(y(ti​))≤−(t−ti​).
  2. (3.14): for u≡0u\equiv0u≡0, one dwell interval gives F(y(ti+1))−F(y(ti))≤−δF(y(t_{i+1}))-F(y(t_i))\le-\deltaF(y(ti+1​))−F(y(ti​))≤−δ.
  3. zr(ti)→0z_r(t_i)\to0zr​(ti​)→0 (p. 8): a positive sequence along which FFF drops by δ\deltaδ per step tends to 000.
  4. Zero-input decay (p. 8): for u≡0u\equiv0u≡0, V(x(t))≤β2(V(x0),t)V(x(t))\le\beta_2(V(x_0),t)V(x(t))≤β2​(V(x0​),t) with β2∈KL\beta_2\in\mathcal{KL}β2​∈KL.
  5. Invariance of I2I_2I2​ (p. 9): once V(x(t))≤γ(∥u∥)V(x(t))\le\gamma(\|u\|)V(x(t))≤γ(∥u∥), afterwards V(x(t))≤α~(∥u∥)V(x(t))\le\tilde\alpha(\|u\|)V(x(t))≤α~(∥u∥) with α~(r)=max⁡{max⁡0≤s≤γ(r)α(s),γ(r)}\tilde\alpha(r)=\max\{\max_{0\le s\le\gamma(r)}\alpha(s),\gamma(r)\}α~(r)=max{max0≤s≤γ(r)​α(s),γ(r)}.

Significance

The result. Condition (3.7) allows jumps that increase VVV (α(a)>a\alpha(a)>aα(a)>a), provided the flow has time θ\thetaθ to compensate, and it allows any decay rate φ∈P\varphi\in\mathcal Pφ∈P, not only exponential ones. The theorem therefore covers systems with polynomially or more slowly decaying Lyapunov functions, such as the paper's Example 1 (x˙=−x3+u\dot x=-x^3+ux˙=−x3+u with cubic jumps), for which exponential average dwell-time results do not apply. It is also the base of the paper's Remark 3: if jumps do not increase VVV, the system is ISS for every impulse sequence without finite accumulation points.

Formalizing it. The result is proved on paper; no machine-checked version exists. The printed statement is not correct as written (see Formalization scope), so a formal proof also certifies the repaired hypothesis set. The development produces reusable infrastructure: a trajectory semantics for impulsive systems with inputs, a Dini-derivative comparison lemma for D+y≤−φ(y)D^+y\le-\varphi(y)D+y≤−φ(y), and constructions of KL\mathcal{KL}KL bounds from sampled decay estimates.

Difficulty

The decay along the flow is not exponential, so the estimate is carried by the nonlinear time change FFF, and the comparison step (3.11) must be derived from an upper Dini derivative of a merely continuous function, not from a classical derivative. The KL\mathcal{KL}KL bound is built from estimates at the impulse times only; it must be continuous, strictly monotone in both arguments and uniform over all initial states with the same Lyapunov value, and FFF may be bounded below near 000, in which case the trajectory reaches 000 in finite time and F−1F^{-1}F−1 is undefined there. With inputs, the trajectory can leave the sublevel set {V≤γ(∥u∥)}\{V\le\gamma(\|u\|)\}{V≤γ(∥u∥)} only by a jump, and after such a jump the decay of VVV is guaranteed only at the following impulse times, not immediately.

Formalization scope

The system is modelled abstractly by the pair (ϕc,g)(\phi_c,g)(ϕc​,g): a structure with fields flow (ϕc\phi_cϕc​) and jump (ggg), subject to ϕc(0,0,x,u)=x\phi_c(0,0,x,u)=xϕc​(0,0,x,u)=x, the cocycle property under input shifts, continuity in time, and the equilibrium at 000. Mathlib has no C0C_0C0​-semigroups, and every statement of the paper uses AAA and fff only through ϕc\phi_cϕc​. The initial time is t0=0t_0=0t0​=0 (the paper's own reduction (2.2)), and the first impulse is strictly after t0t_0t0​. Impulse times are τ : ℕ → ℝ, 0-based (τ i is ti+1t_{i+1}ti+1​). Comparison functions are maps R≥0→R≥0\mathbb R_{\ge0}\to\mathbb R_{\ge0}R≥0​→R≥0​; P\mathcal PP, K\mathcal KK, K∞\mathcal K_\inftyK∞​ come from the published definition SmallGainISS.Lyapunov.Gains, and the Dini derivative from ProcessingNetworks.LyapunovCriteria.DiniDerivative, valued in extended reals. The ISS estimate uses any bound M≥∥u(t)∥M\ge\|u(t)\|M≥∥u(t)∥ in place of ∥u∥Uc\|u\|_{U_c}∥u∥Uc​​.

Corrected statement. The goal uses the max-form jump bound (3.6) of Proposition 3.1 for all x,ξx,\xix,ξ, which is what the proof uses, instead of Definition 4's implication form: as printed the theorem is false (x˙=−x\dot x=-xx˙=−x, g(x,ξ)=x/2g(x,\xi)=x/2g(x,ξ)=x/2 if ∣ξ∣≤∣x∣|\xi|\le|x|∣ξ∣≤∣x∣ and 111 otherwise, V=∣x∣V=|x|V=∣x∣, x0=0x_0=0x0​=0, u≡εu\equiv\varepsilonu≡ε reaches 111 at the first jump for every ε>0\varepsilon>0ε>0).

Trivializing formalizations are ruled out: β\betaβ and γ\gammaγ are existentially quantified before the initial state and the input, and after the impulse sequence only, as the theorem is non-uniform over SθS_\thetaSθ​ (Remark 2); the Lie derivative is an extended-real lim sup⁡\limsuplimsup, not a real-valued one or a classical derivative; the input norm is a bound, never a supremum; the integral in (3.7) is taken only over segments inside (0,∞)(0,\infty)(0,∞), where 1/φ1/\varphi1/φ is continuous; and a verification file shows that x˙=−x\dot x=-xx˙=−x, g=x/2g=x/2g=x/2, V=∣x∣V=|x|V=∣x∣ and ti=θit_i=\theta iti​=θi satisfy every hypothesis.

Contributions welcome: proofs of any milestone, a general Dini comparison lemma, and the construction of KL\mathcal{KL}KL functions from sampled bounds, which the paper only sketches.

Selected references

  • S. Dashkovskiy, A. Mironchenko, Input-to-state stability of nonlinear impulsive systems, SIAM J. Control Optim. 51(3), 1962–1987, 2013; preprint arXiv:1212.5481v1, 2012. https://arxiv.org/abs/1212.5481
  • J. P. Hespanha, D. Liberzon, A. R. Teel, Lyapunov conditions for input-to-state stability of impulsive systems, Automatica 44(11), 2735–2744, 2008. https://doi.org/10.1016/j.automatica.2008.03.006
  • S. Dashkovskiy, A. Mironchenko, Input-to-state stability of infinite-dimensional control systems, Math. Control Signals Systems 25, 1–35, 2013. https://doi.org/10.1007/s00498-012-0090-2
9 thms2 active usersReviewed
Control Theory·Captain: mikedeng1

Input-to-State Stability of Nonlinear Impulsive Systems 3: Small-Gain Theorem: max_i σ_i⁻¹(V_i(x_i)) Is an ISS-Lyapunov Function for an Interconnection of Impulsive SystemsResearch Paper

Motivation

Large control systems are rarely analysed as a whole. A power grid, a logistics network or a chemical plant is a network of subsystems, each with its own model, coupled through their states. Input-to-state stability (ISS) is the standard notion of robustness for such systems: the state is bounded by a decaying function of the initial state plus a gain of the size of the input. Small-gain theorems give conditions under which ISS of the subsystems, together with a smallness condition on the gains with which the subsystems influence one another, yields ISS of the interconnection. In Lyapunov form they do more: they assemble an ISS-Lyapunov function of the whole network from those of its parts (Jiang, Mareels and Wang 1996; Dashkovskiy, Rüffer and Wirth 2010).

Many networks are also impulsive: their state evolves continuously most of the time and jumps at isolated instants (resets, switching, sampling, batch arrivals in logistics). Dashkovskiy and Mironchenko (arXiv:1212.5481v1, SIAM J. Control Optim. 51(3), 2013, DOI) develop a Lyapunov ISS theory for impulsive systems on Banach spaces. Their Theorem 8 is the small-gain theorem for interconnections of impulsive systems that jump at common times.

Timeline. Jiang, Mareels and Wang (1996) gave the Lyapunov small-gain theorem for two ordinary differential systems. Dashkovskiy, Rüffer and Wirth (2010) extended it to nnn subsystems, with the gain operator Γ\GammaΓ, the small-gain condition and the Ω\OmegaΩ-path through which V=max⁡iσi−1(Vi)V=\max_i\sigma_i^{-1}(V_i)V=maxi​σi−1​(Vi​) is built. Nešić and Teel (CDC 2008) treated hybrid systems, Dashkovskiy and Mironchenko (MCSS 2012) treated infinite-dimensional systems, and Theorem 8 combines both settings for impulsive systems.

Setting

An impulsive system has state space XXX and input values in UUU, both Banach spaces. It is described by two maps:

  • the transition map ϕc(t,0,x,u)\phi_c(t,0,x,u)ϕc​(t,0,x,u) of its continuous part, i.e. the state at time ttt when the system starts at xxx under the input uuu and no jumps occur;
  • the jump map g:X×U→Xg:X\times U\to Xg:X×U→X.

The paper derives ϕc\phi_cϕc​ from x˙=Ax+f(x,u)\dot x=Ax+f(x,u)x˙=Ax+f(x,u) with AAA the generator of a C0C_0C0​-semigroup, but every statement of this mission uses only ϕc\phi_cϕc​ and ggg. Inputs are piecewise right-continuous and bounded. For a function V:X→R+V:X\to\mathbb R_+V:X→R+​, the Lie derivative is the upper right Dini derivative

V˙u(x)=lim⁡t→+0‾ 1t(V(ϕc(t,0,x,u))−V(x)).\dot V_u(x)=\overline{\lim_{t\to+0}}\ \frac1t\big(V(\phi_c(t,0,x,u))-V(x)\big).V˙u​(x)=t→+0lim​​ t1​(V(ϕc​(t,0,x,u))−V(x)).

An interconnection consists of nnn subsystems with state spaces XiX_iXi​. It is one impulsive system on X=X1×⋯×XnX=X_1\times\dots\times X_nX=X1​×⋯×Xn​ with ∥x∥X=∑i∥xi∥\|x\|_X=\sum_i\|x_i\|∥x∥X​=∑i​∥xi​∥. Each subsystem has an ISS-Lyapunov function ViV_iVi​:

  • ψi1(∥xi∥)≤Vi(xi)≤ψi2(∥xi∥)\psi_{i1}(\|x_i\|)\le V_i(x_i)\le\psi_{i2}(\|x_i\|)ψi1​(∥xi​∥)≤Vi​(xi​)≤ψi2​(∥xi​∥);
  • along the flow, ViV_iVi​ decreases at rate φi(Vi)\varphi_i(V_i)φi​(Vi​) whenever Vi(xi)≥max⁡{max⁡jχij(Vj(xj)),χi(∥ξ∥)}V_i(x_i)\ge\max\{\max_j\chi_{ij}(V_j(x_j)),\chi_i(\|\xi\|)\}Vi​(xi​)≥max{maxj​χij​(Vj​(xj​)),χi​(∥ξ∥)};
  • at a jump, Vi(gi(x,ξ))≤max⁡{αi(Vi(xi)),max⁡jχij(Vj(xj)),χi(∥ξ∥)}V_i(g_i(x,\xi))\le\max\{\alpha_i(V_i(x_i)),\max_j\chi_{ij}(V_j(x_j)),\chi_i(\|\xi\|)\}Vi​(gi​(x,ξ))≤max{αi​(Vi​(xi​)),maxj​χij​(Vj​(xj​)),χi​(∥ξ∥)}.

The gains χij\chi_{ij}χij​ form the gain operator Γ(s)i=max⁡jχij(sj)\Gamma(s)_i=\max_j\chi_{ij}(s_j)Γ(s)i​=maxj​χij​(sj​) on R+n\mathbb R^n_+R+n​. The small-gain condition is Γ(s)≱s\Gamma(s)\not\ge sΓ(s)≥s for s≠0s\ne0s=0. An Ω\OmegaΩ-path is a curve σ=(σ1,…,σn)\sigma=(\sigma_1,\dots,\sigma_n)σ=(σ1​,…,σn​) of K∞\mathcal K_\inftyK∞​ functions with Γ(σ(r))<σ(r)\Gamma(\sigma(r))<\sigma(r)Γ(σ(r))<σ(r) componentwise for r>0r>0r>0, whose inverses σi−1\sigma_i^{-1}σi−1​ are locally Lipschitz with derivative bounds on compacts.

Formalization targets

Goal: Theorem 8 in the form of Proposition 3.1

With V(x)=max⁡iσi−1(Vi(xi))V(x)=\max_i\sigma_i^{-1}(V_i(x_i))V(x)=maxi​σi−1​(Vi​(xi​)) and χ(r)=max⁡iσi−1(χi(r))\chi(r)=\max_i\sigma_i^{-1}(\chi_i(r))χ(r)=maxi​σi−1​(χi​(r)):

ψ1(∥x∥X)≤V(x)≤ψ2(∥x∥X),V(x)≥χ(∥ξ∥)⇒V˙u(x)≤−φ(V(x)) (x≠0),\psi_1(\|x\|_X)\le V(x)\le\psi_2(\|x\|_X),\qquad V(x)\ge\chi(\|\xi\|)\Rightarrow\dot V_u(x)\le-\varphi(V(x))\ (x\ne0),ψ1​(∥x∥X​)≤V(x)≤ψ2​(∥x∥X​),V(x)≥χ(∥ξ∥)⇒V˙u​(x)≤−φ(V(x)) (x=0), V(g(x,ξ))≤max⁡{α(V(x)),χ(∥ξ∥)},V(g(x,\xi))\le\max\{\alpha(V(x)),\chi(\|\xi\|)\},V(g(x,ξ))≤max{α(V(x)),χ(∥ξ∥)},

for some ψ1,ψ2∈K∞\psi_1,\psi_2\in\mathcal K_\inftyψ1​,ψ2​∈K∞​ and φ,α∈P\varphi,\alpha\in\mathcal Pφ,α∈P. The rates are existential, so no constant is fixed.

Milestones (proof order)

  1. The continuous part (4.12): the flow estimate above.
  2. α~=max⁡iσi−1∘αi∘σi\tilde\alpha=\max_i\sigma_i^{-1}\circ\alpha_i\circ\sigma_iα~=maxi​σi−1​∘αi​∘σi​ is positive definite.
  3. η=max⁡i,j≠iσi−1∘χij∘σj\eta=\max_{i,j\ne i}\sigma_i^{-1}\circ\chi_{ij}\circ\sigma_jη=maxi,j=i​σi−1​∘χij​∘σj​ satisfies η(r)<r\eta(r)<rη(r)<r for r>0r>0r>0.
  4. The jump estimate: V(g(x,ξ))≤max⁡{α∗(V(x)),η(V(x)),χ(∥ξ∥)}V(g(x,\xi))\le\max\{\alpha^*(V(x)),\eta(V(x)),\chi(\|\xi\|)\}V(g(x,ξ))≤max{α∗(V(x)),η(V(x)),χ(∥ξ∥)} for every α∗∈K\alpha^*\in\mathcal Kα∗∈K with α∗≥α~\alpha^*\ge\tilde\alphaα∗≥α~.

A companion item states Proposition 3.1 (⇒\Rightarrow⇒): the max form of the jump condition, with a gain in K∞\mathcal K_\inftyK∞​, gives an ISS-Lyapunov function in the implication form of Definition 4.

Significance

The theorem reduces a question about a network to questions about its parts and their gains. Together with the dwell-time theorems of the same paper (Theorems 1 and 5), it yields ISS of an impulsive interconnection for classes of impulse sequences, using only Lyapunov functions of the subsystems and the gain matrix. It is also the starting point of the paper's exponential small-gain theorem (Theorem 9).

The result is proved on paper. Its continuous half is quoted from MCSS 2012, whose proof follows Dashkovskiy, Rüffer and Wirth 2010. To our knowledge none of it is machine-checked. A formal proof would provide:

  • Dini-derivative calculus for maxima of finitely many functions composed with locally Lipschitz increasing maps;
  • a reusable interface for comparison functions and Ω\OmegaΩ-paths;
  • a precise statement of what the theorem delivers. Two points of the printed statement need correction (see Formalization scope).

Difficulty

The jump half is order-theoretic and short. The continuous half is the obstacle. VVV is a maximum of compositions σi−1∘Vi\sigma_i^{-1}\circ V_iσi−1​∘Vi​, and σi−1\sigma_i^{-1}σi−1​ is only locally Lipschitz, differentiable almost everywhere. The page's formula φ(r)=min⁡i(σi−1)′(σi(r))φi(σi(r))\varphi(r)=\min_i(\sigma_i^{-1})'(\sigma_i(r))\varphi_i(\sigma_i(r))φ(r)=mini​(σi−1​)′(σi​(r))φi​(σi​(r)) evaluates a derivative that may not exist, and even where it does exist it need not be continuous in rrr.

The obvious argument, "differentiate the active component", does not work as stated. The Dini derivative of a maximum is controlled by the active indices only once one shows that inactive indices stay inactive for short times. That step needs continuity of the flow, and a rate φ\varphiφ that is continuous and positive has to be extracted from derivative bounds that hold only on compacts. Near the origin the compositions can fail to be Lipschitz, which is why the flow estimate is asserted away from x=0x=0x=0.

Formalization scope

  • The system is the pair (ϕc,g)(\phi_c,g)(ϕc​,g), with these axioms: the flow starts at its initial state, satisfies the cocycle law for piecewise-continuous inputs, is continuous in time, and fixes the origin, and g(0,0)=0g(0,0)=0g(0,0)=0. The initial time is 000. Inputs are functions R→U\mathbb R\to UR→U, right-continuous with left limits, finitely many discontinuities on bounded intervals, and bounded on [0,∞)[0,\infty)[0,∞).
  • Values. Comparison functions are maps R≥0→R≥0\mathbb R_{\ge0}\to\mathbb R_{\ge0}R≥0​→R≥0​ from the published SmallGainISS.Lyapunov.Gains definition, which also supplies the Ω\OmegaΩ-path. The Dini derivative is the published diniUpperRight, valued in the extended reals.
  • The product space. XXX is the Pi type over Fin n. Its built-in sup norm is never used; the sum norm is explicit.
  • Hypothesis (4.5) is stated along the components of the interconnection's own flow, which is the instance the proof uses.
  • Corrections to the printed statement, each disclosed in the items:
    • The conclusion is in the max form of Proposition 3.1 (Remark 8), not Definition 4, because χ\chiχ of (4.11) is in K\mathcal KK but not necessarily in K∞\mathcal K_\inftyK∞​.
    • The flow estimate is asserted for x≠0x\ne0x=0. With n=1n=1n=1, x˙=−x+u\dot x=-x+ux˙=−x+u, V1=∣x∣V_1=|x|V1​=∣x∣, σ1(r)=r2\sigma_1(r)=r^2σ1​(r)=r2 and u(t)=min⁡(t,1)u(t)=\min(t,1)u(t)=min(t,1), one gets V˙u(0)=1/2>0\dot V_u(0)=1/\sqrt2>0V˙u​(0)=1/2​>0, so the printed claim at the origin fails.
    • The milestone jump estimate uses the page's monotone majorant α∗≥α~\alpha^*\ge\tilde\alphaα∗≥α~, since α~\tilde\alphaα~ itself need not be increasing.
  • Trivializations ruled out. The Lie derivative is a Dini derivative in the extended reals, not a real-valued limit with junk values. No supremum norm of inputs appears. The system and subsystem predicates are satisfiable by a nontrivial example (two decoupled copies of x˙=−x\dot x=-xx˙=−x with g=x/2g=x/2g=x/2, Vi=∣xi∣V_i=|x_i|Vi​=∣xi​∣, cross gains r/2r/2r/2, σ=id\sigma=\mathrm{id}σ=id), checked in Lean. The rates φ,α\varphi,\alphaφ,α are quantified after the data, as on the page.
  • Contributions welcome: a Dini max rule for finitely many continuous functions; a chain rule for the upper Dini derivative through a locally Lipschitz increasing map; and the construction of a continuous positive minorant of a locally positive function.

Selected references

  • S. Dashkovskiy, A. Mironchenko, Input-to-state stability of nonlinear impulsive systems, arXiv:1212.5481v1, 2012; SIAM J. Control Optim. 51(3), 2013. https://arxiv.org/abs/1212.5481, https://doi.org/10.1137/120881993
  • S. Dashkovskiy, A. Mironchenko, Input-to-state stability of infinite-dimensional control systems, Math. Control Signals Systems, 2012. https://doi.org/10.1007/s00498-012-0090-2
  • S. N. Dashkovskiy, B. S. Rüffer, F. R. Wirth, Small gain theorems for large scale systems and construction of ISS Lyapunov functions, SIAM J. Control Optim. 48(6), 2010. https://arxiv.org/abs/0901.1842
  • Z.-P. Jiang, I. M. Y. Mareels, Y. Wang, A Lyapunov formulation of the nonlinear small-gain theorem for interconnected ISS systems, Automatica 32(8), 1996. https://doi.org/10.1016/0005-1098(96)00051-9
  • D. Nešić, A. R. Teel, A Lyapunov-based small-gain theorem for hybrid ISS systems, Proc. 47th IEEE CDC, 2008 (cited by the paper as [19]; no resolvable link verified).
9 thms2 active usersReviewed
🏆Completed
Control TheoryLinear algebra·Captain: mikedeng1

Lyapunov Equations, Energy Functionals, and Model Order Reduction of Bilinear and Stochastic Systems 2: An Explicit Bilinear System Whose Field x ↦ P̃(x)⁻¹x Is Not a Gradient, So (3.8) FailsResearch Paper

Motivation

Balanced truncation reduces a large control system to a small one by discarding the states that are both hard to reach and hard to observe. For linear systems "hard to reach" is measured exactly by the controllability Gramian PPP: the minimal input energy needed to steer the system from 000 to x0x_0x0​ is x0TP−1x0x_0^T P^{-1} x_0x0T​P−1x0​. For bilinear systems, in which the input also multiplies the state, no such exact formula is known, and several papers have tried to describe the nonlinear controllability energy functional EcE_cEc​ through state-dependent Gramians.

Gray and Mesko ([25] in the paper, 1998) and Condon and Ivanov ([11], 2005) stated that, for x≠0x \neq 0x=0 with ∥x∥\|x\|∥x∥ sufficiently small, the gradient of EcE_cEc​ is given by a state-dependent Gramian P~(x)\tilde P(x)P~(x) of the linearization, ∇Ec(x)=P~(x)−1x\nabla E_c(x) = \tilde P(x)^{-1}x∇Ec​(x)=P~(x)−1x, and derived from this comparison inequalities between EcE_cEc​ and the algebraic Gramian. Benner and Damm (SIAM J. Control Optim. 49(2), 2011, doi:10.1137/09075041X) observed that this formula needs an integrability condition that is not automatic, and gave an explicit two-dimensional system for which it fails (Example 3.3, pp. 697–698). This mission formalizes that counterexample.

Setting

A bilinear control system with state x(t)∈Rnx(t) \in \mathbb R^nx(t)∈Rn and input u(t)∈Rmu(t) \in \mathbb R^mu(t)∈Rm is

x˙=Ax+∑j=1mNjx uj+Bu,\dot x = Ax + \sum_{j=1}^m N_j x\, u_j + Bu,x˙=Ax+j=1∑m​Nj​xuj​+Bu,

with real matrices A,N1,…,Nm∈Rn×nA, N_1, \dots, N_m \in \mathbb R^{n\times n}A,N1​,…,Nm​∈Rn×n and B∈Rn×mB \in \mathbb R^{n \times m}B∈Rn×m; write bjb_jbj​ for the jjj-th column of BBB. The system is locally controllable if the pair (A,B)(A, B)(A,B) is controllable, that is, the Kalman matrix [B,AB,…,An−1B][B, AB, \dots, A^{n-1}B][B,AB,…,An−1B] has rank nnn.

Linearizing the system at a state xxx and the input u=0u = 0u=0 gives a linear system whose input matrix has columns Njx+bjN_j x + b_jNj​x+bj​. Its controllability Gramian P~(x)\tilde P(x)P~(x) is the solution of the Lyapunov equation

AP~(x)+P~(x)AT=−∑j=1m(Njx+bj)(Njx+bj)T.(3.9)A \tilde P(x) + \tilde P(x) A^T = -\sum_{j=1}^m (N_j x + b_j)(N_j x + b_j)^T. \tag{3.9}AP~(x)+P~(x)AT=−j=1∑m​(Nj​x+bj​)(Nj​x+bj​)T.(3.9)

When AAA is stable, (3.9) has exactly one solution for every xxx, and it is symmetric. The claim under test is

∇Ec(x)=P~(x)−1xfor x≠0, ∥x∥ sufficiently small.(3.8)\nabla E_c(x) = \tilde P(x)^{-1} x \qquad \text{for } x \neq 0,\ \|x\| \text{ sufficiently small.} \tag{3.8}∇Ec​(x)=P~(x)−1xfor x=0, ∥x∥ sufficiently small.(3.8)

A vector field FFF on an open set is integrable (a gradient field) if F=∇EF = \nabla EF=∇E for some real function EEE.

Example 3.3 is the single-input system (n=2n = 2n=2, m=1m = 1m=1) with

A=[−100−2],N=ν[0110],b=[11],A = \begin{bmatrix} -1 & 0 \\ 0 & -2 \end{bmatrix}, \qquad N = \nu \begin{bmatrix} 0 & 1 \\ 1 & 0 \end{bmatrix}, \qquad b = \begin{bmatrix} 1 \\ 1 \end{bmatrix},A=[−10​0−2​],N=ν[01​10​],b=[11​],

and a real parameter ν\nuν. In Lean these are exA, exN ν and exb (with exB the 2×12\times 12×1 matrix [b][b][b]), equation (3.9) is IsLinGramian, and controllability is IsControllable.

Formalization targets

Goal: Example 3.3

For every ν≠0\nu \neq 0ν=0, with P~(x)\tilde P(x)P~(x) solving (3.9) for every x∈R2x \in \mathbb R^2x∈R2: the pair (A,b)(A, b)(A,b) is controllable, and for every ε>0\varepsilon > 0ε>0 there is no E:R2→RE : \mathbb R^2 \to \mathbb RE:R2→R with

∇E(x)=P~(x)−1xfor all 0<∥x∥<ε.\nabla E(x) = \tilde P(x)^{-1}x \qquad \text{for all } 0 < \|x\| < \varepsilon .∇E(x)=P~(x)−1xfor all 0<∥x∥<ε.

The goal refutes every potential EEE, not only EcE_cEc​, so it does not depend on how EcE_cEc​ is defined; it is exactly the statement that the field is not integrable on any punctured neighbourhood of the origin, which is how (3.8) is claimed.

Milestones, in the order the example uses them

  1. Local controllability: (A,b)(A, b)(A,b) is controllable.
  2. The derivative of F(x)=P~(x)−1xF(x) = \tilde P(x)^{-1}xF(x)=P~(x)−1x (general nnn, mmm): where P~(x)\tilde P(x)P~(x) is invertible,
F′(x)h=P~(x)−1h−P~(x)−1P~x′(h)P~(x)−1x,AP~x′(h)+P~x′(h)AT=−∑j(Njh(Njx+bj)T+(Njx+bj)hTNjT).F'(x)h = \tilde P(x)^{-1}h - \tilde P(x)^{-1}\tilde P'_x(h)\tilde P(x)^{-1}x, \qquad A\tilde P'_x(h) + \tilde P'_x(h)A^T = -\sum_{j}\big(N_j h (N_j x + b_j)^T + (N_j x + b_j)h^TN_j^T\big).F′(x)h=P~(x)−1h−P~(x)−1P~x′​(h)P~(x)−1x,AP~x′​(h)+P~x′​(h)AT=−j∑​(Nj​h(Nj​x+bj​)T+(Nj​x+bj​)hTNjT​).
  1. The explicit Gramian at x=ξ(1,1)Tx = \xi(1,1)^Tx=ξ(1,1)T, 1+νξ≠01 + \nu\xi \neq 01+νξ=0:
P~(x)=(1+νξ)2[1/21/31/31/4],P~(x)−1=6(1+νξ)2[3−4−46].\tilde P(x) = (1+\nu\xi)^2\begin{bmatrix} 1/2 & 1/3 \\ 1/3 & 1/4\end{bmatrix}, \qquad \tilde P(x)^{-1} = \frac{6}{(1+\nu\xi)^2}\begin{bmatrix} 3 & -4 \\ -4 & 6\end{bmatrix}.P~(x)=(1+νξ)2[1/21/3​1/31/4​],P~(x)−1=(1+νξ)26​[3−4​−46​].
  1. The non-symmetric Jacobian at x=ξ(1,1)Tx = \xi(1,1)^Tx=ξ(1,1)T, νξ≠0\nu\xi \neq 0νξ=0, 1+νξ≠01+\nu\xi \neq 01+νξ=0:
F′(x)=P~(x)−1+12νξ(1+νξ)3[2−1−42],not symmetric.F'(x) = \tilde P(x)^{-1} + \frac{12\nu\xi}{(1+\nu\xi)^3}\begin{bmatrix} 2 & -1 \\ -4 & 2\end{bmatrix}, \quad \text{not symmetric.}F′(x)=P~(x)−1+(1+νξ)312νξ​[2−4​−12​],not symmetric.

Significance

The result. The example shows that the state-dependent Gramian P~(x)\tilde P(x)P~(x) of the linearization does not, in general, describe the controllability energy of a bilinear system through (3.8), even for a locally controllable system and arbitrarily close to the origin. As a consequence, the inequalities Ec(x0)>x0TP−1x0E_c(x_0) > x_0^TP^{-1}x_0Ec​(x0​)>x0T​P−1x0​ and Eo(x0)<x0TQx0E_o(x_0) < x_0^TQx_0Eo​(x0​)<x0T​Qx0​ derived in [25, 11] from (3.8) lose their justification, and the comparison of EcE_cEc​ with the algebraic Gramian requires the different argument the paper develops in its later sections. The example is a minimal one: two states, one input, one coupling parameter.

Formalizing it. The counterexample is proved in the paper by a hand computation through Kronecker products, and that computation contains a sign slip (see below); a machine-checked version settles the claim independently of it. The result is proved in the paper and, to our knowledge, has not been formalized anywhere. The general derivative formula (milestone 2) is reusable for any parametric Lyapunov equation.

Difficulty

The obvious route is to compute the Jacobian of FFF at one point and observe that it is not symmetric. Two steps of this route need care. First, P~(x)\tilde P(x)P~(x) is defined only implicitly, through (3.9) at every point, so its differentiability in xxx, and that of its inverse, must be derived from the invertibility of the Lyapunov operator X↦AX+XATX \mapsto AX + XA^TX↦AX+XAT and of P~(x)\tilde P(x)P~(x) near the point. Second, passing from "the Jacobian of FFF is not symmetric" to "FFF is not a gradient" requires the symmetry of second derivatives of a function that is only assumed differentiable with gradient FFF on a punctured ball; the regularity of EEE is inherited from that of FFF, not assumed. The goal is also not a statement about a single point: it must hold for every radius ε\varepsilonε, so the asymmetry must be exhibited at points arbitrarily close to the origin, where it is of order νξ\nu\xiνξ.

Formalization scope

  • Scalars are real; states are Fin n → ℝ, matrices Matrix (Fin n) (Fin n) ℝ, the paper's indices j=1,…,mj = 1, \dots, mj=1,…,m are Fin m. In the goal the plane is EuclideanSpace ℝ (Fin 2) and the potential is required to satisfy HasGradientAt at each point of the punctured ball 0<∥x∥<ε0 < \|x\| < \varepsilon0<∥x∥<ε, with no further regularity.
  • P~\tilde PP~ enters as an arbitrary function satisfying (3.9) at every point. For the example data (3.9) has exactly one solution at every xxx, so this is the paper's "defined by (3.9)", and the hypothesis is satisfiable.
  • Added hypothesis ν≠0\nu \neq 0ν=0. The paper says ν\nuν is "irrelevant for the computation", but its asymmetry term is proportional to νξ\nu\xiνξ; at ν=0\nu = 0ν=0 the Gramian is constant and the field is a gradient.
  • Repaired sign. The equation for P~x′(h)\tilde P'_x(h)P~x′​(h) on p. 697 is printed without parentheses after the minus sign, and the Kronecker formula for vec⁡P~x′(h)\operatorname{vec}\tilde P'_x(h)vecP~x′​(h) drops the minus sign of (3.9). Milestone 2 places the minus sign on both terms. The matrix 12νξ(1+νξ)3[2−1−42]\frac{12\nu\xi}{(1+\nu\xi)^3}\left[\begin{smallmatrix} 2 & -1 \\ -4 & 2\end{smallmatrix}\right](1+νξ)312νξ​[2−4​−12​] of the paper is, with the sign restored, the matrix of h↦−P~−1P~x′(h)P~−1xh \mapsto -\tilde P^{-1}\tilde P'_x(h)\tilde P^{-1}xh↦−P~−1P~x′​(h)P~−1x; milestone 4 therefore states F′(x)=P~(x)−1F'(x) = \tilde P(x)^{-1}F′(x)=P~(x)−1 plus this matrix. The non-symmetry conclusion is unchanged.
  • Matrix inverses are Mathlib's Matrix.inv, which returns 000 at singular matrices; P~(x)\tilde P(x)P~(x) is invertible near the origin, and milestones 2–4 assume invertibility (or 1+νξ≠01 + \nu\xi \neq 01+νξ=0) where they use it.
  • The observability half of (3.8), ∇Eo(x)=Q~(x)x\nabla E_o(x) = \tilde Q(x)x∇Eo​(x)=Q~​(x)x, which the paper says "can be argued similarly" without a proof, is not part of the mission.
  • A trivializing formalization is ruled out: P~\tilde PP~ is pinned by (3.9) at every point (a free P~\tilde PP~ would make the claim meaningless), and non-integrability is stated as the non-existence of a potential, not as the non-symmetry of some matrix.

Contributions welcome: proofs of the four milestones, in particular the smooth dependence of the solution of a Lyapunov equation on its right-hand side (milestone 2), which is general and reusable.

Selected references

  • P. Benner, T. Damm, Lyapunov Equations, Energy Functionals, and Model Order Reduction of Bilinear and Stochastic Systems, SIAM J. Control Optim. 49(2), 686–711, 2011. https://doi.org/10.1137/09075041X
  • W. S. Gray, J. Mesko, Energy functions and algebraic Gramians for bilinear systems, Proc. 4th IFAC Nonlinear Control Systems Design Symposium, Enschede, 1998, pp. 103–108.
  • M. Condon, R. Ivanov, Nonlinear systems — algebraic Gramians and model reduction, COMPEL 24, 202–219, 2005.
  • E. I. Verriest, Time variant balancing and nonlinear balanced realizations, in Model Order Reduction: Theory, Research Aspects and Applications, Mathematics in Industry 13, Springer, 2008, pp. 203–222.
7 thms2 active usersReviewed
Machine LearningOptimizationProbability·Captain: mikedeng1

Convergence and Dynamical Behavior of the ADAM Algorithm for Nonconvex Stochastic Optimization 5: Decreasing-Step Adam Converges Almost Surely to the Critical Points of FResearch Paper

Motivation

Adam (Kingma and Ba, 2015) is the default optimizer for training neural networks: a stochastic gradient method that keeps an exponential moving average mnm_nmn​ of past gradients and an exponential moving average vnv_nvn​ of their coordinatewise squares, and divides the first by the square root of the second. Its practical success came well before any convergence theory for nonconvex objectives. Reddi, Kale and Kumar (2018) showed that Adam with constant momentum parameters can fail to converge even on convex problems, which made the question of under which parameter schedules Adam provably converges a live one.

Barakat and Bianchi (arXiv:1810.02263, SIAM J. Math. Data Sci. 2021) answer it through the ODE method of stochastic approximation (Benaïm, 1999). This mission takes the paper's almost-sure convergence theorem for Adam with decreasing stepsizes, Theorem 5.2. Under a stepsize schedule in which 1−αn1 - \alpha_n1−αn​ and 1−βn1 - \beta_n1−βn​ shrink in proportion to the stepsize γn\gamma_nγn​, the iterates converge almost surely to the critical points of the objective, provided they stay bounded.

Setting

Let ξ\xiξ be a random variable on a measurable space Ξ\XiΞ with law μ\muμ, let f:Rd×Ξ→Rf : \mathbb R^d \times \Xi \to \mathbb Rf:Rd×Ξ→R be an integrand with gradient ∇f(x,ξ)\nabla f(x, \xi)∇f(x,ξ) in xxx, and set

F(x)=Ef(x,ξ),S(x)=E(∇f(x,ξ)⊙2),S=∇F−1({0}),F(x) = \mathbb E f(x, \xi), \qquad S(x) = \mathbb E\big(\nabla f(x,\xi)^{\odot 2}\big), \qquad \mathcal S = \nabla F^{-1}(\{0\}),F(x)=Ef(x,ξ),S(x)=E(∇f(x,ξ)⊙2),S=∇F−1({0}),

where ⊙2\odot 2⊙2 is the coordinatewise square and S\mathcal SS is the critical set. Let ξ1,ξ2,…\xi_1, \xi_2, \dotsξ1​,ξ2​,… be iid copies of ξ\xiξ on a probability space (Ω,F,P)(\Omega, \mathcal F, \mathbb P)(Ω,F,P).

Algorithm 5.1 takes stepsizes γn>0\gamma_n > 0γn​>0, weights αn,βn∈[0,1]\alpha_n, \beta_n \in [0,1]αn​,βn​∈[0,1] and a constant ε>0\varepsilon > 0ε>0. Starting from x0∈Rdx_0 \in \mathbb R^dx0​∈Rd, m0=v0=0m_0 = v_0 = 0m0​=v0​=0 and r0=rˉ0=0r_0 = \bar r_0 = 0r0​=rˉ0​=0, it computes for n≥1n \ge 1n≥1, with all vector operations coordinatewise:

mn=αnmn−1+(1−αn)∇f(xn−1,ξn),vn=βnvn−1+(1−βn)∇f(xn−1,ξn)⊙2,rn=αnrn−1+(1−αn),rˉn=βnrˉn−1+(1−βn),xn=xn−1−γnm^nε+v^n,m^n=mn/rn,v^n=vn/rˉn.\begin{aligned} m_n &= \alpha_n m_{n-1} + (1-\alpha_n)\nabla f(x_{n-1}, \xi_n), & v_n &= \beta_n v_{n-1} + (1-\beta_n)\nabla f(x_{n-1}, \xi_n)^{\odot 2},\\ r_n &= \alpha_n r_{n-1} + (1 - \alpha_n), & \bar r_n &= \beta_n \bar r_{n-1} + (1 - \beta_n),\\ x_n &= x_{n-1} - \gamma_n \frac{\hat m_n}{\varepsilon + \sqrt{\hat v_n}}, & \hat m_n &= m_n / r_n,\quad \hat v_n = v_n / \bar r_n . \end{aligned}mn​rn​xn​​=αn​mn−1​+(1−αn​)∇f(xn−1​,ξn​),=αn​rn−1​+(1−αn​),=xn−1​−γn​ε+v^n​​m^n​​,​vn​rˉn​m^n​​=βn​vn−1​+(1−βn​)∇f(xn−1​,ξn​)⊙2,=βn​rˉn−1​+(1−βn​),=mn​/rn​,v^n​=vn​/rˉn​.​

The divisions by rnr_nrn​, rˉn\bar r_nrˉn​ are the bias correction.

The stepsizes satisfy Assumption 5.1: γn+1/γn→1\gamma_{n+1}/\gamma_n \to 1γn+1​/γn​→1, ∑nγn=+∞\sum_n \gamma_n = +\infty∑n​γn​=+∞, ∑nγn2<+∞\sum_n \gamma_n^2 < +\infty∑n​γn2​<+∞, and there are a,ba, ba,b with 0<b<4a0 < b < 4a0<b<4a, (1−αn)/γn→a(1-\alpha_n)/\gamma_n \to a(1−αn​)/γn​→a and (1−βn)/γn→b(1-\beta_n)/\gamma_n \to b(1−βn​)/γn​→b. The limiting dynamics is the autonomous ODE z˙=h∞(z)\dot z = h_\infty(z)z˙=h∞​(z) on Z+=Rd×Rd×[0,∞)d\mathcal Z_+ = \mathbb R^d \times \mathbb R^d \times [0,\infty)^dZ+​=Rd×Rd×[0,∞)d, written (ODE∞)(\mathrm{ODE}_\infty)(ODE∞​), with

h∞(x,m,v)=(−mε+v, a(∇F(x)−m), b(S(x)−v)).h_\infty(x, m, v) = \Big( -\frac{m}{\varepsilon + \sqrt v},\ a(\nabla F(x) - m),\ b(S(x) - v) \Big).h∞​(x,m,v)=(−ε+v​m​, a(∇F(x)−m), b(S(x)−v)).

Formalization targets

Goal: Theorem 5.2

Assume Assumption 2.2 (regularity and moments of fff), FFF coercive (2.3), S(x)>0S(x) > 0S(x)>0 coordinatewise (2.4), iid samples (4.1), Assumption 5.1, sup⁡x∈KE∥∇f(x,ξ)∥4<∞\sup_{x\in K}\mathbb E\|\nabla f(x,\xi)\|^4 < \inftysupx∈K​E∥∇f(x,ξ)∥4<∞ on compacts (4.2 i) with p=4p = 4p=4), that F(S)F(\mathcal S)F(S) has empty interior, and that (xn,mn,vn)(x_n, m_n, v_n)(xn​,mn​,vn​) is bounded with probability one. Then, almost surely,

d(xn,S)→0,mn→0,S(xn)−vn→0,d(x_n, \mathcal S) \to 0, \qquad m_n \to 0, \qquad S(x_n) - v_n \to 0,d(xn​,S)→0,mn​→0,S(xn​)−vn​→0,

and if S\mathcal SS is countable, almost surely (xn,mn,vn)→(x∗,0,S(x∗))(x_n, m_n, v_n) \to (x^*, 0, S(x^*))(xn​,mn​,vn​)→(x∗,0,S(x∗)) for some x∗∈Sx^* \in \mathcal Sx∗∈S.

Milestones

  1. Lemma 9.1 i)–ii): rn=1−∏i=1nαir_n = 1 - \prod_{i=1}^n \alpha_irn​=1−∏i=1n​αi​, and rnr_nrn​ increases to 111.
  2. §9.1: in the decomposition zˉn+1=zˉn+γn+1h∞(zˉn)+γn+1χn+1+γn+1ςn+1\bar z_{n+1} = \bar z_n + \gamma_{n+1} h_\infty(\bar z_n) + \gamma_{n+1}\chi_{n+1} + \gamma_{n+1}\varsigma_{n+1}zˉn+1​=zˉn​+γn+1​h∞​(zˉn​)+γn+1​χn+1​+γn+1​ςn+1​ of zˉn=(xn−1,mn,vn)\bar z_n = (x_{n-1}, m_n, v_n)zˉn​=(xn−1​,mn​,vn​), the remainder satisfies ςn→0\varsigma_n \to 0ςn​→0 almost surely.
  3. §9.1: the piecewise-affine interpolation of (zˉn)(\bar z_n)(zˉn​) on the times τn=∑k≤nγk\tau_n = \sum_{k\le n}\gamma_kτn​=∑k≤n​γk​ is almost surely a bounded asymptotic pseudotrajectory of the semiflow of (ODE∞)(\mathrm{ODE}_\infty)(ODE∞​).
  4. Proposition 7.13: (ODE∞)(\mathrm{ODE}_\infty)(ODE∞​) is well posed on Z+\mathcal Z_+Z+​ and defines a semiflow Φ\PhiΦ.
  5. Proposition 7.14 (after Benaïm): the limit set of a relatively compact asymptotic pseudotrajectory of a semiflow with a strict Lyapunov function lies in the set of equilibria.
  6. Proposition 7.15: on the closed hull of the orbits of a compact set, Wδ=V∞−δ⟨∇F(x),m⟩+δ∥S(x)−v∥2W_\delta = V_\infty - \delta\langle\nabla F(x), m\rangle + \delta\|S(x) - v\|^2Wδ​=V∞​−δ⟨∇F(x),m⟩+δ∥S(x)−v∥2 is a strict Lyapunov function for some δ>0\delta > 0δ>0.

Significance

The theorem identifies a regime of Adam's hyperparameters, 1−αn∼aγn1 - \alpha_n \sim a\gamma_n1−αn​∼aγn​ and 1−βn∼bγn1 - \beta_n \sim b\gamma_n1−βn​∼bγn​ with b<4ab < 4ab<4a, in which the algorithm behaves like a gradient method with vanishing noise: the iterates approach critical points, the momentum dies out, and the second-moment estimate converges to S(xn)S(x_n)S(xn​). The condition b<4ab < 4ab<4a ties the two averaging rates together. It is the condition under which the paper's Lyapunov function for the continuous dynamics decreases (Lemma 7.5). The argument structure is also a template for other adaptive methods: once the limiting ODE has a strict Lyapunov function, almost-sure convergence of the iterates follows from the same steps.

The paper proves the result on paper; none of it is machine-checked. A formal proof would also be the first formal instance on Prove2Me of the full ODE method for a concrete stochastic algorithm. That pipeline runs from the iterates to a perturbed Euler scheme, then to an asymptotic pseudotrajectory and a limit-set theorem, and finally to convergence. Benaïm's general results are being formalized separately on the platform (the asymptotic-pseudotrajectory definition this mission reuses comes from that effort), so the two developments meet in milestone 3.

Difficulty

The obvious approach is to treat Adam as stochastic gradient descent with a preconditioner and run a descent-lemma argument on F(xn)F(x_n)F(xn​). This fails because the update direction m^n/(ε+v^n)\hat m_n/(\varepsilon + \sqrt{\hat v_n})m^n​/(ε+v^n​​) is not a descent direction for FFF: mnm_nmn​ lags behind ∇F(xn)\nabla F(x_n)∇F(xn​). Any Lyapunov function has to involve the momentum, and FFF alone does not decrease. The continuous-time energy V∞V_\inftyV∞​ decreases only weakly, and only its perturbation WδW_\deltaWδ​ is strict, and only on compact sets. A second difficulty is that the stepsize-dependent coefficients (1−αn+1)/γn+1(1-\alpha_{n+1})/\gamma_{n+1}(1−αn+1​)/γn+1​ and the bias corrections rnr_nrn​, rˉn\bar r_nrˉn​ make the recursion a non-autonomous perturbation of the Euler scheme of h∞h_\inftyh∞​. The remainder must be shown to vanish along almost every path before the general theory applies. Finally, the abstract limit-set theorem needs the semiflow to be well defined on the closed set Z+\mathcal Z_+Z+​, where h∞h_\inftyh∞​ involves v\sqrt vv​ and is not Lipschitz at v=0v = 0v=0.

Formalization scope

Rd\mathbb R^dRd is EuclideanSpace ℝ (Fin d). The state space Z\mathcal ZZ is the product of three copies with Mathlib's max-of-factors norm, which is equivalent to the Euclidean norm of R3d\mathbb R^{3d}R3d and leaves boundedness and limits unchanged. FFF and SSS are Bochner integrals against the law μ\muμ. Assumption 2.2 makes the integrands integrable, so they are the true expectations. Moments are lower Lebesgue integrals. Algorithm 5.1 is a pathwise recursion adamIter, driven by a random sequence ξ:N→Ω→Ξ\xi : \mathbb N \to \Omega \to \Xiξ:N→Ω→Ξ whose index 000 is unused. The iid hypothesis is iIndepFun with every ξn+1\xi_{n+1}ξn+1​ of law μ\muμ.

Two hypotheses are left implicit on the page and are added explicitly. The first is ε>0\varepsilon > 0ε>0. The second is α1<1\alpha_1 < 1α1​<1 and β1<1\beta_1 < 1β1​<1: Assumption 5.1 iii) permits α1=1\alpha_1 = 1α1​=1, which gives r1=0r_1 = 0r1​=0, and Lean's division by zero returns 000. Lemma 9.1 is stated with γn>0\gamma_n > 0γn​>0 and ∑γn=∞\sum\gamma_n = \infty∑γn​=∞, which its convergence claim needs. Semiflows are Flow ℝ≥0 on the subtype Z+\mathcal Z_+Z+​, and the asymptotic pseudotrajectory and limit set are the published StochApproxDyn.LimitSet definitions. The ODE milestones 4–6 hold for abstract FFF, SSS under Assumptions 7.1–7.2 with 0<b≤4a0 < b \le 4a0<b≤4a, as in the paper's §7.

The goal concerns the iterates of Algorithm 5.1 itself. A statement about trajectories of (ODE∞)(\mathrm{ODE}_\infty)(ODE∞​), or one that replaces almost-sure boundedness by a bound uniform in ω\omegaω together with deterministic gradients, is a different and much weaker theorem and is ruled out. The interior condition on F(S)F(\mathcal S)F(S) and the countability of S\mathcal SS enter exactly as on the page.

A complete development needs the following:

  • well-posedness of the ODE on a closed set with a non-Lipschitz field;
  • the Benaïm machinery: martingale-noise control via Doob's convergence theorem, and the passage from vanishing perturbations to asymptotic pseudotrajectories;
  • the limit-set theorem for strict Lyapunov functions.

The last two are reusable for any stochastic approximation scheme, and contributions to them are welcome independently of Adam.

Selected references

  • A. Barakat, P. Bianchi, Convergence and Dynamical Behavior of the ADAM Algorithm for Nonconvex Stochastic Optimization, SIAM J. Math. Data Sci. 3(1), 2021; arXiv:1810.02263v4. https://arxiv.org/abs/1810.02263
  • M. Benaïm, Dynamics of stochastic approximation algorithms, Séminaire de Probabilités XXXIII, LNM 1709, Springer, 1999. https://doi.org/10.1007/BFb0096509
  • D. P. Kingma, J. Ba, Adam: A Method for Stochastic Optimization, ICLR 2015. https://arxiv.org/abs/1412.6980
  • S. J. Reddi, S. Kale, S. Kumar, On the Convergence of Adam and Beyond, ICLR 2018. https://arxiv.org/abs/1904.09237
16 thms2 active usersReviewed
Convex OptimizationFunctional AnalysisOperations Research+1·Captain: mikedeng1

Tikhonov Regularization of a Second Order Dynamical System with Hessian Driven Damping 1: For α > 3 and ∫ tε(t) dt < +∞ the Trajectory Converges Weakly to a Minimizer of gResearch Paper

Motivation

Minimizing a convex function ggg on a real Hilbert space H\mathcal HH by first-order methods has a continuous-time counterpart: second-order differential equations whose trajectories descend ggg. Su, Boyd and Candès (20) showed that Nesterov's accelerated gradient method is a discretization of x¨+αtx˙+∇g(x)=0\ddot x+\frac{\alpha}{t}\dot x+\nabla g(x)=0x¨+tα​x˙+∇g(x)=0 with α=3\alpha=3α=3, along which g(x(t))−min⁡g=O(1/t2)g(x(t))-\min g=O(1/t^2)g(x(t))−ming=O(1/t2). Two modifications of this equation have been studied separately because each adds a property the plain system lacks.

  • A Hessian-driven damping term β∇2g(x(t))x˙(t)\beta\nabla^2g(x(t))\dot x(t)β∇2g(x(t))x˙(t) (Attouch, Peypouquet, Redont, J. Differential Equations 2016) damps oscillations and, for β>0\beta>0β>0, makes t2∥∇g(x(t))∥2t^2\|\nabla g(x(t))\|^2t2∥∇g(x(t))∥2 integrable, while keeping fast values and weak convergence of trajectories.
  • A Tikhonov regularization term ϵ(t)x(t)\epsilon(t)x(t)ϵ(t)x(t) with ϵ(t)↓0\epsilon(t)\downarrow0ϵ(t)↓0 (Attouch, Chbani, Riahi, J. Math. Anal. Appl. 2018) can steer trajectories to the minimum-norm minimizer.

Boţ, Csetnek and László (arXiv:1911.12845v2, 2020) combine both terms and ask which properties of the two parent systems survive. This mission covers the first of their answers: when ϵ\epsilonϵ decays fast enough, the fast rates and the weak convergence of trajectories are preserved.

Timeline. 2016 (published 2018): weak convergence of trajectories of x¨+αtx˙+∇g(x)=0\ddot x+\frac\alpha t\dot x+\nabla g(x)=0x¨+tα​x˙+∇g(x)=0 for α>3\alpha>3α>3 (Attouch, Chbani, Peypouquet, Redont, Math. Program. 168). 2016: the same with Hessian-driven damping, β>0\beta>0β>0 (Attouch, Peypouquet, Redont). 2018: Tikhonov regularization of that system, with the O(1/t2)O(1/t^2)O(1/t2) rate kept and strong convergence to the minimum-norm minimizer under slow decay of ϵ\epsilonϵ (Attouch, Chbani, Riahi). 2020: both terms together (Boţ, Csetnek, László, this paper).

Setting

Fix a real Hilbert space H\mathcal HH, a starting time t0>0t_0>0t0​>0, parameters α≥3\alpha\ge3α≥3 and β≥0\beta\ge0β≥0, and initial data u0,v0∈Hu_0,v_0\in\mathcal Hu0​,v0​∈H. The General assumption of the paper is:

  • g:H→Rg:\mathcal H\to\mathbb Rg:H→R is convex and twice Fréchet differentiable, ∇g\nabla g∇g is Lipschitz continuous on bounded sets, and argmin⁡g≠∅\operatorname{argmin} g\ne\emptysetargming=∅; min⁡g\min gming denotes its minimal value;
  • ϵ:[t0,+∞)→[0,+∞)\epsilon:[t_0,+\infty)\to[0,+\infty)ϵ:[t0​,+∞)→[0,+∞) is nonincreasing, of class C1C^1C1, and ϵ(t)→0\epsilon(t)\to0ϵ(t)→0 as t→+∞t\to+\inftyt→+∞.

The dynamical system is

x¨(t)+αtx˙(t)+β∇2g(x(t))x˙(t)+∇g(x(t))+ϵ(t)x(t)=0,t≥t0,x(t0)=u0, x˙(t0)=v0.(5)\ddot x(t)+\frac{\alpha}{t}\dot x(t)+\beta\nabla^2g(x(t))\dot x(t)+\nabla g(x(t))+\epsilon(t)x(t)=0,\quad t\ge t_0,\quad x(t_0)=u_0,\ \dot x(t_0)=v_0. \tag{5}x¨(t)+tα​x˙(t)+β∇2g(x(t))x˙(t)+∇g(x(t))+ϵ(t)x(t)=0,t≥t0​,x(t0​)=u0​, x˙(t0​)=v0​.(5)

A global C2C^2C2-solution is a twice continuously differentiable x:[t0,+∞)→Hx:[t_0,+\infty)\to\mathcal Hx:[t0​,+∞)→H satisfying (5) for every t≥t0t\ge t_0t≥t0​. The decay of ϵ\epsilonϵ is controlled by ∫t0+∞tϵ(t) dt<+∞\int_{t_0}^{+\infty}t\epsilon(t)\,dt<+\infty∫t0​+∞​tϵ(t)dt<+∞ together with one of two conditions:

  • (a) there exist a>1a>1a>1 and t1≥t0t_1\ge t_0t1​≥t0​ with ϵ˙(t)≤−aβ2ϵ2(t)\dot\epsilon(t)\le-\frac{a\beta}{2}\epsilon^2(t)ϵ˙(t)≤−2aβ​ϵ2(t) for all t≥t1t\ge t_1t≥t1​;
  • (b) there exist a>0a>0a>0 and t1≥t0t_1\ge t_0t1​≥t0​ with ϵ(t)≤at\epsilon(t)\le\frac atϵ(t)≤ta​ for all t≥t1t\ge t_1t≥t1​.

A curve x(t)x(t)x(t) converges weakly to xˉ\bar xxˉ if ⟨x(t),v⟩→⟨xˉ,v⟩\langle x(t),v\rangle\to\langle\bar x,v\rangle⟨x(t),v⟩→⟨xˉ,v⟩ for every v∈Hv\in\mathcal Hv∈H. The Lean development lives in the namespace TikhonovHDD.Weak, with IsSolution, GenAssumptionG, GenAssumptionEps, CondA, CondB, argmin, minVal and WeakTendstoAtTop for these objects.

Formalization targets

Goal: Theorem 3.5 (p. 15)

Under the General assumption, ∫t0+∞tϵ(t) dt<+∞\int_{t_0}^{+\infty}t\epsilon(t)\,dt<+\infty∫t0​+∞​tϵ(t)dt<+∞ and (a) or (b), if α>3\alpha>3α>3 then every global C2C^2C2-solution of (5) satisfies

∃ xˉ∈argmin⁡g:x(t)⇀xˉ(t→+∞).\exists\,\bar x\in\operatorname{argmin} g:\qquad x(t)\rightharpoonup\bar x\quad(t\to+\infty).∃xˉ∈argming:x(t)⇀xˉ(t→+∞).

Milestones

In the order the argument uses them:

  1. Theorem 2.1 (p. 4): existence and uniqueness of a global C2C^2C2-solution of (5).
  2. Lemma A.2 (p. 29): a bounded-below, locally absolutely continuous FFF with F˙≤G∈L1\dot F\le G\in L^1F˙≤G∈L1 a.e. has a finite limit.
  3. Theorem 3.3 (p. 11), split three ways: for α≥3\alpha\ge3α≥3, g(x(t))−min⁡g=O(1/t2)g(x(t))-\min g=O(1/t^2)g(x(t))−ming=O(1/t2); for α>3\alpha>3α>3, xxx is bounded and t(g(x(t))−min⁡g)t(g(x(t))-\min g)t(g(x(t))−ming), t∥x˙∥2t\|\dot x\|^2t∥x˙∥2, tϵ∥x−x∗∥2t\epsilon\|x-x^*\|^2tϵ∥x−x∗∥2, tϵ∥x∥2∈L1t\epsilon\|x\|^2\in L^1tϵ∥x∥2∈L1; and separately t2∥∇g(x(t))∥2∈L1t^2\|\nabla g(x(t))\|^2\in L^1t2∥∇g(x(t))∥2∈L1.
  4. Lemma A.3 (p. 30): u(t)+tαu˙(t)→uˉu(t)+\frac t\alpha\dot u(t)\to\bar uu(t)+αt​u˙(t)→uˉ with α>0\alpha>0α>0 implies u(t)→uˉu(t)\to\bar uu(t)→uˉ.
  5. Theorem 3.4 (p. 12): for α>3\alpha>3α>3 and every x∗∈argmin⁡gx^*\in\operatorname{argmin} gx∗∈argming, t⟨∇g(x),x−x∗⟩∈L1t\langle\nabla g(x),x-x^*\rangle\in L^1t⟨∇g(x),x−x∗⟩∈L1, lim⁡∥x(t)−x∗∥\lim\|x(t)-x^*\|lim∥x(t)−x∗∥ and lim⁡t⟨x˙+β∇g(x),x−x∗⟩\lim t\langle\dot x+\beta\nabla g(x),x-x^*\ranglelimt⟨x˙+β∇g(x),x−x∗⟩ exist, g(x(t))−min⁡g=o(1/t2)g(x(t))-\min g=o(1/t^2)g(x(t))−ming=o(1/t2), ∥x˙+β∇g(x)∥=o(1/t)\|\dot x+\beta\nabla g(x)\|=o(1/t)∥x˙+β∇g(x)∥=o(1/t), and t2ϵ(t)∥x(t)∥2→0t^2\epsilon(t)\|x(t)\|^2\to0t2ϵ(t)∥x(t)∥2→0.

Significance

The result. Theorem 3.5 shows that the Tikhonov term, when it decays at least as fast as ∫tϵ<∞\int t\epsilon<\infty∫tϵ<∞ requires, does not disturb the asymptotics of the Hessian-damped system: values converge at rate o(1/t2)o(1/t^2)o(1/t2) and trajectories converge weakly to a minimizer. With β=0\beta=0β=0 it recovers the corresponding results for the regularized system without Hessian damping, and with ϵ≡0\epsilon\equiv0ϵ≡0 those for the Hessian-damped system. It is also the boundary case of the paper's second half, where slower decay of ϵ\epsilonϵ is shown to give strong convergence to the minimum-norm minimizer instead.

Formalizing it. The results are proved in the paper; none of them is machine-checked. A formal development would produce reusable pieces: a Lyapunov-energy analysis of second-order systems with time-dependent coefficients, the asymptotic Lemmas A.2 and A.3, and the bridge from "the distance to every minimizer converges and weak cluster points are minimizers" to weak convergence of a curve (the continuous Opial lemma).

Difficulty

The obvious approach, a single Lyapunov function that decreases along trajectories, fails here: the Tikhonov term makes the natural energy Eb\mathcal E_bEb​ only almost nonincreasing, with an error ∝tϵ(t)∥x∗∥2\propto t\epsilon(t)\|x^*\|^2∝tϵ(t)∥x∗∥2 that must be integrated, and the Hessian term produces a cross term −βϵ(t)t2⟨∇g(x),x⟩-\beta\epsilon(t)t^2\langle\nabla g(x),x\rangle−βϵ(t)t2⟨∇g(x),x⟩ that is controlled only by condition (a) or (b). The step from O(1/t2)O(1/t^2)O(1/t2) to o(1/t2)o(1/t^2)o(1/t2) and to the existence of lim⁡∥x(t)−x∗∥\lim\|x(t)-x^*\|lim∥x(t)−x∗∥ cannot be read off a single bounded energy: boundedness of Eb\mathcal E_bEb​ gives rates in OOO, not in ooo, and says nothing directly about ∥x(t)−x∗∥\|x(t)-x^*\|∥x(t)−x∗∥. Weak convergence then requires Opial's lemma, which is not in Mathlib in continuous form. Existence of solutions is itself nontrivial in infinite dimension: the right-hand side involves ∇2g\nabla^2g∇2g, so the system has to be rewritten as a first-order system before the Cauchy–Lipschitz theorem applies.

Formalization scope

  • H\mathcal HH is any real Hilbert space (InnerProductSpace ℝ H, CompleteSpace H); nothing is finite-dimensional, so weak convergence is genuinely weaker than norm convergence. It is stated through inner products with every v∈Hv\in\mathcal Hv∈H; stating it as norm convergence, or testing only some vvv, would change the theorem.
  • Trajectories are maps R→H\mathbb R\to\mathcal HR→H with velocity and acceleration maps; derivatives are one-sided at t0t_0t0​ and values before t0t_0t0​ play no role. Every theorem is stated for every C2C^2C2-solution; Theorem 2.1 shows this class is a singleton, so the hypothesis is not vacuous. A sorry-free check that the hypotheses of the goal can be met (g=0g=0g=0, ϵ=0\epsilon=0ϵ=0, x=0x=0x=0) accompanies the drafts.
  • ∇2g(x)v\nabla^2g(x)v∇2g(x)v is the derivative of ∇g\nabla g∇g at xxx applied to vvv; ϵ˙\dot\epsilonϵ˙ is a derivative map tied to ϵ\epsilonϵ on [t0,+∞)[t_0,+\infty)[t0​,+∞); min⁡g=inf⁡g\min g=\inf gming=infg, attained since argmin⁡g≠∅\operatorname{argmin} g\ne\emptysetargming=∅; L1L^1L1 membership is Lebesgue integrability on [t0,+∞)[t_0,+\infty)[t0​,+∞) (never a comparison of a Bochner integral with a number); OOO, ooo are Asymptotics relations at +∞+\infty+∞.
  • Repair. Theorem 2.1 carries the extra hypothesis "β=0\beta=0β=0 or g∈C2g\in C^2g∈C2". As printed (only twice differentiable ggg) it is false for β>0\beta>0β>0: on R\mathbb RR, g′(x)=2x+x2sin⁡(1/x)g'(x)=2x+x^2\sin(1/x)g′(x)=2x+x2sin(1/x) gives a strongly convex ggg with bounded but discontinuous g′′g''g′′, and the solution from u0=0u_0=0u0​=0, v0=1v_0=1v0​=1 is not C2C^2C2. The paper's own proof uses continuity of ∇2g\nabla^2 g∇2g.
  • Flagged, not repaired. The last claim of Theorem 3.3, t2∥∇g(x(t))∥2∈L1t^2\|\nabla g(x(t))\|^2\in L^1t2∥∇g(x(t))∥2∈L1, is its own item: the paper's argument for it uses a term proportional to β\betaβ, so for β=0\beta=0β=0 the paper gives no proof. No counterexample is known, and the statement is drafted as printed.
  • Referenced, not re-posed. Lemma A.4 (continuous Opial lemma, p. 30), the last step of the goal's proof, is the published InertialAVD.Traj.lemma_A_2 (same hypotheses: SSS nonempty, lim⁡∥x(t)−z∥\lim\|x(t)-z\|lim∥x(t)−z∥ exists for every z∈Sz\in Sz∈S, every weak sequential limit point lies in SSS; same conclusion). It is a reference milestone of this mission; its weak convergence InertialAVD.Traj.WeakTendstoAtTop has the same body as TikhonovHDD.Weak.WeakTendstoAtTop.
  • The model is defined from scratch: the published HessianDamping.DINAVD.Setting concerns a different equation (no ϵx\epsilon xϵx term) and is not reused.
  • Welcome contributions: a general Cauchy–Lipschitz existence theorem for locally Lipschitz first-order systems in Banach spaces on [t0,+∞)[t_0,+\infty)[t0​,+∞) with a blow-up alternative, the continuous Opial lemma, and Lemma A.2 for absolutely continuous functions.

Selected references

  • R.I. Boţ, E.R. Csetnek, S.C. László, Tikhonov regularization of a second order dynamical system with Hessian driven damping, arXiv:1911.12845v2, 2020; published in Math. Program., https://doi.org/10.1007/s10107-020-01528-8. https://arxiv.org/abs/1911.12845v2
  • H. Attouch, J. Peypouquet, P. Redont, Fast convex optimization via inertial dynamics with Hessian driven damping, J. Differential Equations 261(10), 5734–5783, 2016. https://doi.org/10.1016/j.jde.2016.08.020
  • H. Attouch, Z. Chbani, H. Riahi, Combining fast inertial dynamics for convex optimization with Tikhonov regularization, J. Math. Anal. Appl. 457(2), 1065–1094, 2018. https://doi.org/10.1016/j.jmaa.2016.12.017
  • H. Attouch, Z. Chbani, J. Peypouquet, P. Redont, Fast convergence of inertial dynamics and algorithms with asymptotic vanishing viscosity, Math. Program. 168, 123–175, 2018. https://doi.org/10.1007/s10107-016-0992-8
  • W. Su, S. Boyd, E.J. Candès, A differential equation for modeling Nesterov's accelerated gradient method: theory and insights, J. Mach. Learn. Res. 17(153), 1–43, 2016. https://jmlr.org/papers/v17/15-084.html
10 thms2 active usersReviewed
Convex OptimizationFunctional AnalysisOperations Research+1·Captain: mikedeng1

Tikhonov Regularization of a Second Order Dynamical System with Hessian Driven Damping 2: lim inf ‖x(t) − x*‖ = 0 at the Minimum-Norm Minimizer, and x(t) → x* If x(t) Ends In or Out of B(0, ‖x*‖)Research Paper

Motivation

Many methods for minimizing a smooth convex function ggg on a Hilbert space can be read as discretizations of second order ordinary differential equations, and the asymptotic behaviour of the continuous trajectories predicts the behaviour of the iterates. The inertial system with vanishing damping x¨+αtx˙+∇g(x)=0\ddot x+\frac{\alpha}{t}\dot x+\nabla g(x)=0x¨+tα​x˙+∇g(x)=0 is the continuous counterpart of Nesterov's accelerated gradient method (Su, Boyd, Candès 2016); for α>3\alpha>3α>3 its trajectories converge weakly to some minimizer of ggg (Attouch, Chbani, Peypouquet, Redont 2018). Two modifications of this system have been studied separately. A Hessian driven damping term β∇2g(x)x˙\beta\nabla^2g(x)\dot xβ∇2g(x)x˙ reduces oscillations while keeping the fast rate of the values (Attouch, Peypouquet, Redont 2016). A Tikhonov regularization term ϵ(t)x\epsilon(t)xϵ(t)x with ϵ(t)→0\epsilon(t)\to 0ϵ(t)→0 selects a particular minimizer: under suitable decay of ϵ\epsilonϵ, trajectories approach the minimizer of minimum norm in the strong (norm) topology (Attouch, Chbani, Riahi 2018).

Boţ, Csetnek and László (arXiv:1911.12845v2, published in Mathematical Programming 2021) combine both terms and ask which properties of the two separate systems survive. This mission formalizes their strong convergence result, Theorem 4.4.

Setting

Let H\mathcal HH be a real Hilbert space, t0>0t_0>0t0​>0, α≥3\alpha\ge 3α≥3, β≥0\beta\ge0β≥0, and u0,v0∈Hu_0,v_0\in\mathcal Hu0​,v0​∈H. The General assumption of the paper (p. 2) is:

  • g:H→Rg:\mathcal H\to\mathbb Rg:H→R is convex and twice Fréchet differentiable, ∇g\nabla g∇g is Lipschitz continuous on bounded sets, and argmin⁡g≠∅\operatorname{argmin} g\neq\emptysetargming=∅;
  • ϵ:[t0,+∞)→[0,+∞)\epsilon:[t_0,+\infty)\to[0,+\infty)ϵ:[t0​,+∞)→[0,+∞) is nonincreasing, of class C1C^1C1, and lim⁡t→+∞ϵ(t)=0\lim_{t\to+\infty}\epsilon(t)=0limt→+∞​ϵ(t)=0.

A global C2C^2C2-solution of the system

x¨(t)+αtx˙(t)+β∇2g(x(t))x˙(t)+∇g(x(t))+ϵ(t)x(t)=0,t≥t0,x(t0)=u0, x˙(t0)=v0,(5)\ddot x(t)+\frac{\alpha}{t}\dot x(t)+\beta\nabla^2g(x(t))\dot x(t)+\nabla g(x(t))+\epsilon(t)x(t)=0,\quad t\ge t_0,\qquad x(t_0)=u_0,\ \dot x(t_0)=v_0, \tag{5}x¨(t)+tα​x˙(t)+β∇2g(x(t))x˙(t)+∇g(x(t))+ϵ(t)x(t)=0,t≥t0​,x(t0​)=u0​, x˙(t0​)=v0​,(5)

is a twice continuously differentiable curve x:[t0,+∞)→Hx:[t_0,+\infty)\to\mathcal Hx:[t0​,+∞)→H satisfying (5) at every t≥t0t\ge t_0t≥t0​. The set argmin⁡g\operatorname{argmin} gargming is nonempty, closed and convex, so it has a unique element of minimum norm, denoted x∗x^*x∗. The open ball B(0,∥x∗∥)B(0,\|x^*\|)B(0,∥x∗∥) is {y:∥y∥<∥x∗∥}\{y:\|y\|<\|x^*\|\}{y:∥y∥<∥x∗∥}. In the Lean development these objects are GeneralAssumption g t₀ ε ε', IsSolution g α β t₀ ε u₀ v₀ x xd xdd and IsMinNormMinimizer g xstar in the namespace TikhonovHDD.Strong, with min⁡g\min gming written minValue g.

Formalization targets

Goal: Theorem 4.4 (p. 21)

Assume, in addition to the above,

∫t0+∞ϵ(t)t dt<+∞,lim⁡t→+∞βϵ(t)tα3+1∫t0tϵ2(s)sα3+1 ds=0,\int_{t_0}^{+\infty}\frac{\epsilon(t)}{t}\,dt<+\infty,\qquad \lim_{t\to+\infty}\frac{\beta}{\epsilon(t)t^{\frac{\alpha}{3}+1}}\int_{t_0}^{t}\epsilon^2(s)s^{\frac{\alpha}{3}+1}\,ds=0,∫t0​+∞​tϵ(t)​dt<+∞,t→+∞lim​ϵ(t)t3α​+1β​∫t0​t​ϵ2(s)s3α​+1ds=0,

that ϵ˙(t)≤−aβ2ϵ2(t)\dot\epsilon(t)\le-\frac{a\beta}{2}\epsilon^2(t)ϵ˙(t)≤−2aβ​ϵ2(t) for all t≥t1t\ge t_1t≥t1​, for some a>1a>1a>1 and t1≥t0t_1\ge t_0t1​≥t0​, and that lim⁡t→+∞t2ϵ(t)=+∞\lim_{t\to+\infty}t^2\epsilon(t)=+\inftylimt→+∞​t2ϵ(t)=+∞ if α=3\alpha=3α=3, while t2ϵ(t)≥23α(13α−1+βc2)t^2\epsilon(t)\ge\frac23\alpha\left(\frac13\alpha-1+\beta c^2\right)t2ϵ(t)≥32​α(31​α−1+βc2) for large ttt, for some c>0c>0c>0, if α>3\alpha>3α>3. Then

lim inf⁡t→+∞∥x(t)−x∗∥=0,\liminf_{t\to+\infty}\|x(t)-x^*\|=0,t→+∞liminf​∥x(t)−x∗∥=0,

and

lim⁡t→+∞∥x(t)−x∗∥=0\lim_{t\to+\infty}\|x(t)-x^*\|=0t→+∞lim​∥x(t)−x∗∥=0

if there exists T≥t0T\ge t_0T≥t0​ such that {x(t):t≥T}\{x(t):t\ge T\}{x(t):t≥T} stays either in B(0,∥x∗∥)B(0,\|x^*\|)B(0,∥x∗∥) or in its complement.

Milestones

  1. Lemma A.1 (p. 29): for nonnegative continuous integrable fff on (δ,+∞)(\delta,+\infty)(δ,+∞) and nondecreasing φ≥0\varphi\ge 0φ≥0 with φ(t)→+∞\varphi(t)\to+\inftyφ(t)→+∞, 1φ(t)∫δtφ(s)f(s) ds→0\frac1{\varphi(t)}\int_\delta^t\varphi(s)f(s)\,ds\to0φ(t)1​∫δt​φ(s)f(s)ds→0.
  2. Theorem 3.1 (pp. 5–6): for α≥3\alpha\ge3α≥3, g(x(t))→min⁡gg(x(t))\to\min gg(x(t))→ming under either (a) ∫t0+∞ϵ(t)/t dt<+∞\int_{t_0}^{+\infty}\epsilon(t)/t\,dt<+\infty∫t0​+∞​ϵ(t)/tdt<+∞ together with ϵ˙≤−aβ2ϵ2\dot\epsilon\le-\frac{a\beta}{2}\epsilon^2ϵ˙≤−2aβ​ϵ2 eventually, or (b) ϵ(t)≤a/t\epsilon(t)\le a/tϵ(t)≤a/t eventually.
  3. Case I of the proof of Theorem 4.4 (pp. 21–25): the trajectory eventually stays outside the open ball, and x(t)→x∗x(t)\to x^*x(t)→x∗.
  4. Case II (pp. 25–26): the trajectory eventually stays inside the open ball, and x(t)→x∗x(t)\to x^*x(t)→x∗.
  5. Case III (p. 26): the trajectory is inside and outside the ball for arbitrarily large times, and lim inf⁡∥x(t)−x∗∥=0\liminf\|x(t)-x^*\|=0liminf∥x(t)−x∗∥=0.

The three cases are exhaustive, so Cases I–III together give the goal.

Significance

Theorem 4.4 shows that adding Hessian driven damping does not destroy the selection property of Tikhonov regularization: the trajectory comes arbitrarily close to the minimum-norm minimizer, and converges to it in norm whenever it does not oscillate across the sphere ∥y∥=∥x∗∥\|y\|=\|x^*\|∥y∥=∥x∗∥ forever. Since ϵ(t)→0\epsilon(t)\to 0ϵ(t)→0, the system still approaches argmin⁡g\operatorname{argmin} gargming, but the limit is a canonical minimizer determined by ggg alone, not by the initial data. In infinite dimensions this is the difference between weak and strong convergence, a distinction that matters for ill-posed problems and inverse problems, where the minimum-norm solution is the one usually sought. Remark 4.5 of the paper compares the hypotheses with those of Attouch, Chbani and Riahi for the system without Hessian damping: for β=0\beta=0β=0 the lower bound required of t2ϵ(t)t^2\epsilon(t)t2ϵ(t) when α>3\alpha>3α>3 is, in the authors' words, "less tight" than theirs.

The result is proved in the paper; no part of it has a machine-checked proof. Formalizing it requires a Lyapunov-energy argument for a second order ODE in a Hilbert space, the weak lower semicontinuity of convex functions and of the norm, and the passage from weak to strong convergence via convergence of norms. Theorem 3.1 and Lemma A.1 are standalone results reusable for other Tikhonov-regularized inertial systems.

Difficulty

The weak convergence argument for the unregularized system (Opial's lemma) does not identify the limit, and it does not give strong convergence. Tikhonov regularization supplies the identification only through the Tikhonov curve xϵx_{\epsilon}xϵ​, the minimizer of g+ϵ2∥⋅∥2g+\frac{\epsilon}{2}\|\cdot\|^2g+2ϵ​∥⋅∥2, and comparing x(t)x(t)x(t) with xϵ(t)x_{\epsilon(t)}xϵ(t)​ requires an energy whose derivative is controlled with weights tuned to α\alphaα. The Hessian term produces cross terms of the form βϵ(t)t2⟨∇g(x(t)),x(t)⟩\beta\epsilon(t)t^2\langle\nabla g(x(t)),x(t)\rangleβϵ(t)t2⟨∇g(x(t)),x(t)⟩ that are absent from the system without Hessian damping; the integral hypothesis on ϵ2(s)sα/3+1\epsilon^2(s)s^{\alpha/3+1}ϵ2(s)sα/3+1 and the slow-decay condition ϵ˙≤−aβ2ϵ2\dot\epsilon\le-\frac{a\beta}{2}\epsilon^2ϵ˙≤−2aβ​ϵ2 exist to absorb them. A direct energy estimate only works when ∥x(t)∥≥∥x∗∥\|x(t)\|\ge\|x^*\|∥x(t)∥≥∥x∗∥; inside the ball a different argument is required, and when the trajectory crosses the sphere infinitely often neither argument yields convergence of the whole trajectory, only a liminf statement.

Formalization scope

Conventions committed to in Lean:

  • Curves are maps R→H\mathbb R\to\mathcal HR→H; only their values on [t0,+∞)[t_0,+\infty)[t0​,+∞) matter. Derivatives of xxx, x˙\dot xx˙ and ϵ\epsilonϵ are taken within [t0,+∞)[t_0,+\infty)[t0​,+∞) (one-sided at t0t_0t0​) and passed as explicit maps xd, xdd, ε'; x¨\ddot xx¨ and ϵ˙\dot\epsilonϵ˙ are continuous there.
  • ∇g\nabla g∇g is gradient g; ∇2g(x)v\nabla^2g(x)v∇2g(x)v is the Fréchet derivative of gradient g at xxx applied to vvv. "Lipschitz on bounded sets" means Lipschitz on every closed ball centred at 000.
  • min⁡g\min gming is the infimum of the range of ggg, attained because argmin⁡g≠∅\operatorname{argmin} g\neq\emptysetargming=∅.
  • ∫t0+∞ϵ(t)/t dt<+∞\int_{t_0}^{+\infty}\epsilon(t)/t\,dt<+\infty∫t0​+∞​ϵ(t)/tdt<+∞ is Lebesgue integrability of ϵ(t)/t\epsilon(t)/tϵ(t)/t on [t0,+∞)[t_0,+\infty)[t0​,+∞), never a comparison of a Bochner integral with a number. tα/3+1t^{\alpha/3+1}tα/3+1 is the real power.
  • lim inf⁡t→+∞∥x(t)−x∗∥=0\liminf_{t\to+\infty}\|x(t)-x^*\|=0liminft→+∞​∥x(t)−x∗∥=0 is written as: for every δ>0\delta>0δ>0, ∥x(t)−x∗∥<δ\|x(t)-x^*\|<\delta∥x(t)−x∗∥<δ for arbitrarily large ttt. Lean's Filter.liminf is not used, since it returns 000 for a function tending to +∞+\infty+∞.
  • The alternative "in the ball or in its complement" uses one TTT for both branches, with the disjunction outside the universal quantifier. Placing the disjunction inside (∀t≥T\forall t\ge T∀t≥T, ∥x(t)∥<∥x∗∥\|x(t)\|<\|x^*\|∥x(t)∥<∥x∗∥ or ∥x(t)∥≥∥x∗∥\|x(t)\|\ge\|x^*\|∥x(t)∥≥∥x∗∥) would make the hypothesis always true and the strong convergence claim unconditional, which the paper does not prove.
  • Every statement is made for every global C2C^2C2-solution of (5). Existence and uniqueness of that solution (Theorem 2.1 of the paper) is a separate result, formalized in the companion mission on weak convergence; the hypothesis is not vacuous.
  • No positivity of ϵ\epsilonϵ is assumed: it follows from the conditions for α=3\alpha=3α=3 and α>3\alpha>3α>3.
  • Cases I–III carry the full hypothesis list of Theorem 4.4, although Case II uses only part of it.

No statement of the mission has been repaired against the printed text.

A complete development needs: weak lower semicontinuity of convex continuous functions and of the norm on Hilbert spaces; weak sequential compactness of bounded sets; existence of the minimum-norm element of a closed convex set (Mathlib's projection onto closed convex sets); the strongly convex Tikhonov curve and its convergence to x∗x^*x∗; and calculus for energy functionals along C2C^2C2 curves on half-lines. Lemma A.1 and the Tikhonov-curve facts are reusable for every Tikhonov-regularized dynamics. Contributions of proofs of individual milestones, of supporting lemmas, and of alternative arguments are welcome.

Selected references

  • R.I. Boţ, E.R. Csetnek, S.C. László, Tikhonov regularization of a second order dynamical system with Hessian driven damping, arXiv:1911.12845v2, 2020; Mathematical Programming 189, 151–186, 2021. https://arxiv.org/abs/1911.12845v2, https://doi.org/10.1007/s10107-020-01528-8
  • H. Attouch, Z. Chbani, H. Riahi, Combining fast inertial dynamics for convex optimization with Tikhonov regularization, Journal of Mathematical Analysis and Applications 457, 1065–1094, 2018. https://doi.org/10.1016/j.jmaa.2016.12.017
  • H. Attouch, J. Peypouquet, P. Redont, Fast convex optimization via inertial dynamics with Hessian driven damping, Journal of Differential Equations 261(10), 5734–5783, 2016. https://doi.org/10.1016/j.jde.2016.08.020
  • H. Attouch, Z. Chbani, J. Peypouquet, P. Redont, Fast convergence of inertial dynamics and algorithms with asymptotic vanishing viscosity, Mathematical Programming 168, 123–175, 2018. https://doi.org/10.1007/s10107-016-0992-8
  • W. Su, S. Boyd, E.J. Candès, A differential equation for modeling Nesterov's accelerated gradient method: theory and insights, Journal of Machine Learning Research 17(153), 1–43, 2016. https://jmlr.org/papers/v17/15-084.html
7 thms2 active usersReviewed
PreviousPage 3 of 7Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me