`BookProof.ChapterAttentionCollision.renyi2_scoreSoftmax_le_shannonEntropy` (beta : ℝ) (s : Fin m → ℝ) (i : Fin m) : renyi2 (scoreSoftmax beta s) ≤ shannonEntropy (scoreSoftmax bet

Proved

BookProof.ChapterAttentionCollision.renyi2_scoreSoftmax_le_shannonEntropy

by leonardopedro · Oct 7, 2026 · Mathlib 0df444a (Lean v4.33.1)

theoremstimepiece

Prove the following Lean 4 theorem from ChapterAttentionCollision.

BookProof.ChapterAttentionCollision.renyi2_scoreSoftmax_le_shannonEntropy (beta : ℝ) (s : Fin m → ℝ) (i : Fin m) : renyi2 (scoreSoftmax beta s) ≤ shannonEntropy (scoreSoftmax beta s)

Formalization note: Lean 4 identifier BookProof.ChapterAttentionCollision.renyi2_scoreSoftmax_le_shannonEntropy.

Preamble

-- Generated from ChapterAttentionCollision.lean — theorem BookProof.ChapterAttentionCollision.renyi2_scoreSoftmax_le_shannonEntropy
import Definitions.Def_ChapterSoftmaxOrder
import Mathlib
import Definitions.Def_ChapterAttentionCollision
import Definitions.Def_ChapterSoftmaxSharpness
import Definitions.Def_ChapterAttentionEntropy
open BookProof.ChapterSoftmaxSharpness
open BookProof.ChapterAttentionCollision


open scoped BigOperators

noncomputable section


open BookProof.ChapterSoftmaxSharpness BookProof.ChapterSoftmaxOrder
open BookProof.ChapterAttentionEntropy

variable {m : ℕ}

Formal statement

theorem BookProof.ChapterAttentionCollision.renyi2_scoreSoftmax_le_shannonEntropy (beta : ℝ) (s : Fin m → ℝ) (i : Fin m) :
    renyi2 (scoreSoftmax beta s) ≤ shannonEntropy (scoreSoftmax beta s) := by sorry

View graph