§3.5, p. 29 — the Geometric Deep Learning Blueprint f = A ∘ σ_J ∘ B_J ∘ P_{J−1} ∘ … ∘ σ_1 ∘ B_1 is G-invariant
ProvedGeomDL.Blueprint.blueprint_invariantequivariancegeometric-deep-learninginvarianceneural-network-architecturep2o-batch-pfp2ap2o-gran-per-chapterp2o-plan-bookp2o-v1
Let one group act on every domain and (), and on signals by . Suppose
- every layer is -equivariant;
- every is an arbitrary map, applied element-wise;
- every pooling is -equivariant;
- the global pooling is -invariant.
Then the blueprint network
is -invariant, for every number of layers.
This is the invariance claim of the book's Geometric Deep Learning Blueprint.
Formalization Note The book's box requires the poolings only to map to a coarser domain, not to be equivariant; without equivariance of the composite need not be invariant, so condition 3 is added. The box also allows different blocks to use different groups; this statement uses a single group. Indices run from to instead of to .
Preamble
import Mathlib import Definitions.Def_GeomDL_Blueprint_Defs
Formal statement
namespace GeomDL.Blueprint
/-- Bronstein et al., §3.5, p. 29 (the Geometric Deep Learning Blueprint, corrected): with one
group `G` acting on every domain, if every layer `B j` and every pooling `P j` is
`G`-equivariant, every `σ j` acts element-wise, and the global pooling `A` is `G`-invariant, then
`f = A ∘ σ_J ∘ B_J ∘ P_{J−1} ∘ … ∘ P_1 ∘ σ_1 ∘ B_1` is `G`-invariant (here `J = n + 1`, indices
from `0`). The printed box does not require the poolings `P` to be equivariant. -/
theorem blueprint_invariant {G : Type*} [Group G] {Ω Ω' : ℕ → Type*} {C D E : ℕ → Type*}
{Y : Type*} [∀ j, MulAction G (Ω j)] [∀ j, MulAction G (Ω' j)]
(B : ∀ j, (Ω j → C j) → (Ω' j → D j)) (σ : ∀ j, D j → E j)
(P : ∀ j, (Ω' j → E j) → (Ω (j + 1) → C (j + 1))) (n : ℕ) (A : (Ω' n → E n) → Y)
(hB : ∀ j, IsEquivariant (G := G) (B j)) (hP : ∀ j, IsEquivariant (G := G) (P j))
(hA : IsInvariant (G := G) A) :
IsInvariant (G := G) (blueprint B σ P n A) := by sorry
end GeomDL.Blueprint
Source
Bronstein et al., Geometric Deep Learning (arXiv:2104.13478v2), §3.5, Geometric Deep Learning Blueprint box, p. 29
Human review
Confirmed by the mission captain (proposal self-audit).
Confirmed by the moderator at approval.