Distributed Algorithms for Aggregative Games on Graphs II: The Gossip Algorithm with Stepsizes 1/Γ_k(i) Converges Almost Surely to the Unique EquilibriumResearch Paper
Motivation
In an aggregative game, each player's cost depends on its own decision and on the sum of all players' decisions. That form appears in resource sharing, production, and network games: a player may know its own choice while lacking a central feed of the aggregate. A distributed algorithm therefore has to estimate the aggregate through local communication as it updates decisions. Koshal, Nedić, and Shanbhag study this setting and give both synchronous and gossip schemes in Distributed Algorithms for Aggregative Games on Graphs. This mission concerns their asynchronous scheme, in which a random pair communicates at each tick.
The question is whether irregular, local updates still find the game's equilibrium when no agent knows in advance how often it will be selected. Each agent uses its own update count to set its step length. The paper's Proposition 3 states almost-sure convergence under strict monotonicity, compact strategy sets, and a connected graph. The result is a convergence claim about the complete random process, including who wakes, whom they contact, which estimate they exchange, and which projected step they take.
Setting
There are agents. Agent chooses , with nonempty, compact, and convex. A strategy profile is in , and its aggregate is . The map is the player's first-order response when its own decision is and its aggregate argument is . The game map is . A solution of the variational inequality is feasible and satisfies
The paper obtains from differentiable convex player costs, making VI solutions Nash equilibria. The formal statements take as the primitive map used by the algorithm. Strict monotonicity means for different feasible profiles . Along with continuity and compact convex strategy sets, it makes the VI solution unique. The paper's Assumptions 1–3 also impose a uniform Lipschitz bound on how changes with .
Agents occupy a connected, undirected graph. At a discrete tick , a uniformly selected agent contacts a neighbour with probability on every edge. The ordered pairs are independent across ticks. Each agent maintains an aggregate estimate ; the selected pair average their estimates to form . Those agents take a projected step using and then add their decision change to the estimate. Other agents retain their decisions and estimates. Initially . The number counts agent 's updates through tick , and its step length at an update is . Equations (23)–(29) of the paper define these operations.
Formalization targets
Goal: almost-sure equilibrium convergence
Under Assumptions 1–3 and connectedness of the gossip graph, Proposition 3 asserts that there is a unique solving and that the generated process satisfies
The goal includes existence and uniqueness of , rather than conditioning convergence on a possibly nonexistent solution. Its random draws have the rate-one-clock law: .
Milestones
The five milestones record the VI's unique solution from the proof of Proposition 1, conservation of the agents' average estimate in Lemma 2, the almost-sure stepsize bounds of Lemma 7, their summability consequences in Corollary 1, and the mean-square gossip contraction in relations (30)–(31). They cover the equilibrium, tracking, step length, and network-mixing parts of the claim. Their source wording, indices, and PDF pages are attached to the mission items.
Significance
The result shows that a shared aggregate can be learned well enough through pairwise, random exchanges to reach the same equilibrium characterized by the centralized VI. Update counts permit agents to choose diminishing steps without a common iteration clock or a schedule ensuring equal participation on each finite interval. Connectedness and positive contact probabilities ensure every graph edge can carry information. The convergence assertion is almost sure, so it concerns individual sample paths outside a null set, rather than merely an average error.
Formalizing the result would connect finite graph gossip, random update counts, projected VI iteration, and almost-sure convergence in one reusable development. The paper proves Proposition 3; this mission supplies an open machine-checked target, not a claim that the result is unresolved mathematically. A proof would need honest probability statements for the draw law and summability and a projection interface that does not assign arbitrary values on empty sets. The VI existence and uniqueness milestone can also serve other compact, strictly monotone games.
Difficulty
Pairwise averaging preserves the mean estimate, but it does not make each agent's estimate equal to that mean at every step. A projected decision change immediately perturbs the local estimate again. The selected agents and their step lengths also depend on the same update history, so deterministic simultaneous-update arguments do not directly apply. The paper controls this interaction using update-count asymptotics, contraction of the random gossip matrix, and almost-sure summability. None of those conclusions follows from connectedness alone if a nominal edge has zero contact probability.
Formalization scope
Lean represents each decision in EuclideanSpace ℝ (Fin n) and profiles as functions on Fin N. The aggregate is a finite sum. A projection is the relation saying that the selected point lies in its set and minimizes Euclidean distance, rather than a total function with an arbitrary output on an empty set. The profile topology used for convergence is the finite product topology. For vectors indexed by agents, relations (30)–(31) use the explicit Euclidean coordinate norm; the default norm of Fin N → ℝ is a sup norm.
The continuous-time Poisson clocks are encoded through their induced independent discrete tick pairs and exact joint law. Initial decisions are fixed and feasible. The source allows random initial decisions; the formal goal covers every deterministic start. This restriction is recorded because the paper's stated random initialization would require an explicit independence relation with future clock draws. Tick indices start at zero in Lean; a selected agent has , so the value assigned to never drives an update. The positive-time series and bounds still begin at .
The paper gives the Lipschitz condition on aggregate arguments only in the feasible aggregate set . Its algorithm can evaluate outside that set, as its own footnote acknowledges. This development explicitly extends that condition to all of to make those evaluations controlled. The change is substantive and disclosed on each affected item; the preprint's Lemma 3 proof contains the corresponding domain gap. The goal assumes neither the stepsize estimates nor the network contraction nor convergence of the estimate errors; they remain mathematical work. Further contributions may formalize the omitted intermediate lemmas, or refine the initialization and domain assumptions while preserving a meaningful statement.
Selected references
- J. Koshal, A. Nedić, and U. V. Shanbhag, Distributed Algorithms for Aggregative Games on Graphs, Operations Research 64(3), 680–704, 2016. arXiv:1605.00267v2; DOI:10.1287/opre.2016.1501.