(C.11) of Proposition C.3, p. 35 — whenever
ProvedReinfRegGames.Extinction.eq_C_11bregman-divergenceconvex-analysisfenchel-couplingp2o-batch-pfp2ap2o-gran-per-chapterp2o-plan-paperp2o-v1
Let be a -strongly convex penalty function on the simplex , let , and let be a score vector with . If , then the one-sided derivative exists, is a real number, and
The identity transfers the continuity of the Bregman divergence on (Proposition C.2(iii)) to the Fenchel coupling, which is how Proposition C.4 is proved.
Formalization Note The statement says that the one-sided derivative of at in the direction equals , which is (C.11) rearranged and includes the existence of the derivative.
Preamble
import Mathlib import Definitions.Def_agt_games import Definitions.Def_ReinfRegGames_Extinction_Model import Definitions.Def_ReinfRegGames_Extinction_Bregman
Formal statement
namespace ReinfRegGames.Extinction
theorem eq_C_11 {B : Type*} [Fintype B] (h : (B → ℝ) → ℝ) (K : ℝ) (hpen : IsPenalty h K)
(p : B → ℝ) (hp : p ∈ stdSimplex ℝ B) (y x : B → ℝ) (hQ : IsChoice h y x)
(hx : x ∈ deltaP p) :
HasOneSidedDeriv h x (p - x) (h p - h x - fenchelCoupling h p y) := by sorry
end ReinfRegGames.Extinction
Source
Mertikopoulos & Sandholm, Learning in games via reinforcement and regularization, arXiv:1407.6267v2, p. 35, Proposition C.3, (C.11)
Human review
Confirmed by the mission captain (proposal self-audit).
Confirmed by the moderator at approval.