`BookProof.ChapterAttentionMixture.multiHead_output_eq_mean` (w : Fin H → ℝ) (beta : Fin H → ℝ) (s : Fin H → Fin m → ℝ) (v : Fin m → E) : observableExpectation (multiHead w beta s)
ProvedBookProof.ChapterAttentionMixture.multiHead_output_eq_meantheoremstimepiece
Prove the following Lean 4 theorem from ChapterAttentionMixture.
BookProof.ChapterAttentionMixture.multiHead_output_eq_mean (w : Fin H → ℝ) (beta : Fin H → ℝ) (s : Fin H → Fin m → ℝ) (v : Fin m → E) : observableExpectation (multiHead w beta s) v = ∑ h, w h • headOutput (beta h) (s h) v
Formalization note: Lean 4 identifier BookProof.ChapterAttentionMixture.multiHead_output_eq_mean.
Preamble
-- Generated from ChapterAttentionMixture.lean — theorem BookProof.ChapterAttentionMixture.multiHead_output_eq_mean
import Definitions.Def_ChapterSoftmaxOrder
import Mathlib
import Definitions.Def_ChapterAttentionMixture
import Definitions.Def_ChapterObservableExpectation
import Definitions.Def_ChapterSoftmaxSharpness
import Definitions.Def_ChapterAttentionOutput
open BookProof.ChapterObservableExpectation
open BookProof.ChapterSoftmaxSharpness
open BookProof.ChapterAttentionMixture
open scoped BigOperators
noncomputable section
open BookProof.ChapterSoftmaxSharpness BookProof.ChapterSoftmaxOrder
open BookProof.ChapterAttentionOutput
variable {m H : ℕ} {E : Type*} [NormedAddCommGroup E] [NormedSpace ℝ E]Formal statement
theorem BookProof.ChapterAttentionMixture.multiHead_output_eq_mean (w : Fin H → ℝ) (beta : Fin H → ℝ)
(s : Fin H → Fin m → ℝ) (v : Fin m → E) :
observableExpectation (multiHead w beta s) v
= ∑ h, w h • headOutput (beta h) (s h) v := by sorry