Side-note p. 120 — max and mean cannot distinguish {{a, b}} from {{a, a, b, b}}
ProvedGeomDL.WL.max_mean_cannot_distinguishaggregationgeometric-deep-learninggraph-neural-networkp2o-batch-pfp2ap2o-gran-per-chapterp2o-plan-bookp2o-v1
Let be any two feature vectors. The neighbour multisets and are different, but the maximisation and averaging aggregators take the same value on both:
Hence a GNN whose aggregator is a maximum or a mean cannot separate two nodes whose neighbourhoods differ only by such a duplication, which is why those aggregators fall short of the WL test.
Formalization Note The maximum of vectors is coordinatewise, valued in extended by a bottom element for the empty multiset; the mean is .
Preamble
import Mathlib import Definitions.Def_WLIdentification import Definitions.Def_GeomDL_WL_Defs
Formal statement
namespace GeomDL.WL
/-- Side-note p. 120: maximisation and averaging cannot distinguish the neighbour multisets
`{{a, b}}` and `{{a, a, b, b}}`: the two multisets differ, but their coordinatewise maxima and
their means coincide, for all feature vectors `a, b ∈ ℝ^d`. -/
theorem max_mean_cannot_distinguish {d : ℕ} (a b : Fin d → ℝ) :
({a, b} : Multiset (Fin d → ℝ)) ≠ {a, a, b, b} ∧
maxAgg ({a, b} : Multiset (Fin d → ℝ)) = maxAgg {a, a, b, b} ∧
meanAgg ({a, b} : Multiset (Fin d → ℝ)) = meanAgg {a, a, b, b} := by sorry
end GeomDL.WL
Source
Bronstein et al., Geometric Deep Learning (arXiv:2104.13478v2), Ch. 7, side-note p. 120
Human review
Confirmed by the mission captain (proposal self-audit).
Confirmed by the moderator at approval.