§4.1, p. 33 — a linear map on ℝⁿ is permutation equivariant iff it is α·I + β·(1/n)𝟙𝟙ᵀ
ProvedGeomDL.Sets.linear_equivariant_iff_id_averagedeep-setsgeometric-deep-learninglinear-algebrap2o-batch-pfp2ap2o-gran-per-chapterp2o-plan-bookp2o-v1permutation-equivariance
Let and let be linear. Then is permutation equivariant,
if and only if there are scalars with
that is, is a linear combination of the two generators, the identity and the average , all of whose entries equal .
Equivalently, the commutant of the permutation representation of on is spanned by and . This characterises the linear layers of Deep Sets.
Formalization Note The statement is for one feature channel (); the multi-channel form is a separate item of this mission, because the book's scalar form is false for . The hypothesis makes meaningful. For the two generators coincide and only existence of is claimed.
Preamble
import Mathlib import Definitions.Def_GeomDL_Sets_Defs
Formal statement
namespace GeomDL.Sets
/-- §4.1, p. 33: a linear map `F : ℝⁿ → ℝⁿ` (one channel) is permutation equivariant,
`F(Px) = P F(x)` for every permutation matrix `P`, if and only if it is a linear combination
of the identity `F₁x = x` and the average `F₂x = (1/n)𝟙𝟙ᵀx`. -/
theorem linear_equivariant_iff_id_average {n : ℕ} (hn : 0 < n)
(F : (Fin n → ℝ) →ₗ[ℝ] (Fin n → ℝ)) :
(∀ (σ : Equiv.Perm (Fin n)) (x : Fin n → ℝ), F (permVec σ x) = permVec σ (F x)) ↔
∃ α β : ℝ, ∀ x : Fin n → ℝ, F x = α • x + β • average x := by sorry
end GeomDL.Sets
Source
Bronstein et al., Geometric Deep Learning (arXiv:2104.13478v2), §4.1, p. 33, "any such map can be written as a linear combination of two generators"
Human review
Confirmed by the mission captain (proposal self-audit).
Confirmed by the moderator at approval.