Motivation
Mean field games, introduced independently by Lasry and Lions (Mean field games, Jpn. J. Math. 2007) and by Huang, Malhamé and Caines (2006), describe the Nash equilibria of games with a very large number of symmetric players, each of whom reacts only to the empirical distribution of the others. In the limit, an equilibrium is a fixed point: a flow of population laws such that the optimal response of a single representative player to that flow reproduces it.
Existence of such fixed points is typically obtained by compactness, and says nothing about whether the equilibrium is determined by the data. Uniqueness matters for the use of the model: a unique equilibrium can be computed, approximated, and compared across parameters, while multiple equilibria raise a selection problem. Lasry and Lions showed by counterexamples that uniqueness fails in general, and identified a monotonicity condition on the population-dependent part of the reward under which it holds; outside that condition, uniqueness is typically available only for short horizons and Lipschitz coefficients.
Carmona and Lacker (arXiv:1307.1152v2, 2014; Ann. Appl. Probab. 25(3), 2015) set up a weak formulation of mean field games in which the controlled state is obtained from a fixed driftless diffusion by a Girsanov change of measure, so that the coefficients may be merely measurable in the state and path dependent. This mission formalizes their uniqueness theorem (Theorem 3.8): the Lasry–Lions argument carried out in the weak formulation, through backward stochastic differential equations.
Setting
Fix a horizon T, a dimension d, the path space C=C([0,T];Rd) with the sup norm, and a measurable ψ:C→[1,∞). Write Pψ(C) for the probability measures μ on C with ∫ψdμ<∞. A control set A is a compact convex subset of a normed space, and P(A) is the set of probability measures on A with the weak topology.
On a probability space (Ω,P) carrying an initial state ξ and an independent d-dimensional Brownian motion W, filtered by the augmented filtration of (ξ,W), let X solve the driftless state equation dXt=σ(t,X)dWt, X0=ξ. The admissible controls A are the progressively measurable A-valued processes. For μ∈Pψ(C) and α∈A the measure Pμ,α has density
dPdPμ,α=E(∫0⋅σ−1b(t,X,μ,αt)dWt)T,
under which X has drift b(t,X,μ,αt). For a flow q:[0,T]→P(A) the reward is
Jμ,q(α)=Eμ,α[∫0Tf(t,X,μ,qt,αt)dt+g(X,μ)].
A pair (μ,q) is a solution of the MFG (Definition 3.4) if some α∈A maximizes Jμ,q over A, Pμ,α∘X−1=μ, and Pμ,α∘αt−1=qt for almost every t.
The Hamiltonian is h(t,x,μ,q,z,a)=f(t,x,μ,q,a)+z⋅σ−1b(t,x,μ,a), with maximum H over a∈A and maximizer set A(t,x,μ,q,z). Assumption (U) asks that (U.1) the maximizer is unique; (U.2) b=b(t,x,a) does not depend on μ; (U.3) f=f1(t,x,μ)+f2(t,μ,q)+f3(t,x,a); and (U.4) the Lasry–Lions monotonicity condition
∫C[g(x,μ)−g(x,μ′)+∫0T(f1(t,x,μ)−f1(t,x,μ′))dt](μ−μ′)(dx)≤0for all μ,μ′.
The standing assumptions (S) of the paper (measurability, continuity in a, nonsingular σ, bounded σ−1b, a ψ-growth bound on f,g, and a separation of f) are in force throughout.
Formalization targets
Goal: Theorem 3.8
Under (S) and (U), if (μ1,q1) and (μ2,q2) are solutions of the MFG, then
μ1=μ2andqt1=qt2 for almost every t∈[0,T].
Definition 3.4 constrains qt only for almost every t, so this is the strongest identification possible.
Milestones
- §7.3, p. 30. For a solution (μ,q) with optimal control α and a solution (Y,Z) of the BSDE Yt=g(X,μ)+∫tTH(s,X,μ,qs,Zs)ds−∫tTZsdWs (7.1), αt maximizes the Hamiltonian at Zt, dt×dP-a.e.; under (U.1) every such maximizing control agrees with α a.e.
- (7.9)–(7.10). E[Y01−Y02] written as an expectation under Pμ1,α1 and under Pμ2,α2.
- (7.11)–(7.12). Pointwise bounds from maximization of the Hamiltonian, strict when the controls differ.
- (7.13). [Eμ1,α1−Eμ2,α2][Δg(X)+∫0TΔf1(t,X)dt]=0.
- §7.3, p. 31. α1=α2, L×P-a.e.
Significance
Theorem 3.8, combined with the existence theorem of the same paper (Theorem 3.5, the first mission of this series), gives existence and uniqueness of the equilibrium (Corollary 3.9) for coefficients that are only measurable and path dependent in the state, under a monotonicity condition and no Lipschitz or small-horizon requirement. Uniqueness is also what makes the approximation result of the paper (Theorem 4.2, the third mission) refer to the equilibrium.
The result is proved in the paper. It has not been machine-checked; no mean field game uniqueness theorem in a weak or Girsanov formulation is formalized in Lean or Mathlib. The formal development would contain, as reusable parts, the Doléans exponential of a bounded Itô integrand as a probability density, the change of Brownian motion under it, the comparison principle for BSDEs with Lipschitz drivers, and the Lasry–Lions monotonicity argument.
Difficulty
The argument compares two equilibria through two different measures Pμ1,α1 and Pμ2,α2. The direct Lasry–Lions computation, which differentiates a pairing of a Hamilton–Jacobi–Bellman solution with a Fokker–Planck solution, is not available: there is no PDE, and the value functions are only known through BSDEs. The proof needs (a) that an optimal control maximizes the Hamiltonian along the adjoint process Z — the necessity half of the BSDE optimality criterion, which the paper uses without a displayed proof; (b) the representation of E[Y01−Y02] under each of the two measures, which requires that the stochastic integrals ∫(Z1−Z2)dWμi,αi be true martingales under the changed measures; and (c) turning a strict pointwise inequality on a set of positive dt×dP-measure into a strict inequality of expectations, which uses the equivalence P∼Pμi,αi.
Formalization scope
The Lean development lives in the namespace WeakMFG.Uniqueness and builds on the published definition Peng1990.SMP.Stochastic (Brownian motion, L2 Itô integrals, Itô processes, BSDEs). Conventions:
- Base space. Any probability space carrying ξ and an independent standard Brownian motion W, with the filtration σ(ξ)∨σ(Ws:s≤t) completed by the measurable null sets; the canonical space of the paper is an instance.
- State. "Strong solution" of dX=σ(t,X)dW is read in the L2 Itô theory (square-integrable solutions); σ(t,X)>0 is matrix invertibility; states are vectors of Rd with the sup norm, Euclidean squares written as sums of squares.
- Measures. Pψ(C) is a structure carrying the topology τψ; P(A) has the weak topology and its Borel σ-field; time is R≥0, of which only [0,T] enters.
- Densities. Itô integrals are determined up to versions, so dPμ,α/dP is a predicate on a random variable; statements assert that a version exists and hold for every version. Optimality is stated against every admissible competitor, never through a real supremum.
- Added hypotheses, disclosed. Joint measurability of (t,x,q,a)↦f(t,x,μ,q,a), which the reward presupposes; in (U.4), integrability of the integrals the page writes; the slip in (U.3), which omits q from the arguments of f, is corrected.
A formalization whose hypotheses contain the conclusion is ruled out: the goal assumes only that the two pairs are solutions in the sense of Definition 3.4 — no BSDE solution, no Hamiltonian maximization, no equality of densities is assumed. Uniqueness of q is stated almost everywhere in time, and nowhere is equality of the two optimal controls as functions asked for.
Contributions welcome: the Doléans exponential and Girsanov's theorem for bounded drifts in the L2 Itô layer, existence and comparison for Lipschitz BSDEs on a filtration enlarged by an independent initial condition, and the measurable maximum theorem for the Hamiltonian. These are reusable beyond this mission, in particular by the other two missions of the series.
Selected references
- R. Carmona, D. Lacker, A probabilistic weak formulation of mean field games and applications, arXiv:1307.1152v2, 2014; Ann. Appl. Probab. 25(3), 2015. https://arxiv.org/abs/1307.1152
- J.-M. Lasry, P.-L. Lions, Mean field games, Japanese Journal of Mathematics 2(1), 2007. https://doi.org/10.1007/s11537-007-0657-8
- M. Huang, R. P. Malhamé, P. E. Caines, Large population stochastic dynamic games: closed-loop McKean–Vlasov systems and the Nash certainty equivalence principle, Communications in Information and Systems 6(3), 2006. https://doi.org/10.4310/CIS.2006.v6.n3.a5
- E. Pardoux, S. Peng, Adapted solution of a backward stochastic differential equation, Systems & Control Letters 14(1), 1990. https://doi.org/10.1016/0167-6911(90)90082-6