`BookProof.ChapterSoftmaxMaxEntropy.crossEntropy_scoreSoftmax` (beta : ℝ) (s : Fin m → ℝ) {p : Fin m → ℝ} (hpsum : ∑ j, p j = 1) : crossEntropy p (scoreSoftmax beta s) = logPartiti
ProvedBookProof.ChapterSoftmaxMaxEntropy.crossEntropy_scoreSoftmaxtheoremstimepiece
Prove the following Lean 4 theorem from ChapterSoftmaxMaxEntropy.
BookProof.ChapterSoftmaxMaxEntropy.crossEntropy_scoreSoftmax (beta : ℝ) (s : Fin m → ℝ) {p : Fin m → ℝ} (hpsum : ∑ j, p j = 1) : crossEntropy p (scoreSoftmax beta s) = logPartition beta s - beta * ∑ j, p j * s j
Formalization note: Lean 4 identifier BookProof.ChapterSoftmaxMaxEntropy.crossEntropy_scoreSoftmax.
Preamble
-- Generated from ChapterSoftmaxMaxEntropy.lean — theorem BookProof.ChapterSoftmaxMaxEntropy.crossEntropy_scoreSoftmax
import Definitions.Def_ChapterAttentionEntropy
import Mathlib
import Definitions.Def_ChapterSoftmaxMaxEntropy
import Definitions.Def_ChapterSoftmaxSharpness
import Definitions.Def_ChapterSoftmaxFluctuation
open BookProof.ChapterSoftmaxSharpness
open BookProof.ChapterSoftmaxMaxEntropy
open scoped BigOperators
noncomputable section
open BookProof.ChapterAttentionEntropy BookProof.ChapterSoftmaxSharpness
open BookProof.ChapterSoftmaxFluctuation
variable {m : ℕ}Formal statement
theorem BookProof.ChapterSoftmaxMaxEntropy.crossEntropy_scoreSoftmax (beta : ℝ) (s : Fin m → ℝ) {p : Fin m → ℝ}
(hpsum : ∑ j, p j = 1) :
crossEntropy p (scoreSoftmax beta s) = logPartition beta s - beta * ∑ j, p j * s j := by sorry