Eq. (10.42) — under the (PSI) optimal cost is
OpenBertsekasShreve.ImperfectInfo.optCostHat_gt_botLet an (ISI) model with finite horizon be given, together with a statistic sufficient for control (Definition 10.6) and the associated perfect state information model (PSI) of Definition 10.7: states , control space , constraint sets , one-stage costs and transition kernels . For a (PSI) policy (universally measurable kernels with ), denotes its (0-originating) cost at (eq. (31)), and is the optimal cost (eq. (32)).
If assumption holds for (PSI), i.e. for all -originating policies, all and , then
This is equation (42) in the proof of Proposition 10.3; it is Lemma 8.3 combined with Proposition 8.2 () applied to the model (PSI). It is what makes an -optimal (PSI) policy satisfy everywhere.
Formalization Note The model (PSI) is the one bundled in SuffStat (Definitions 10.6–10.8); is σ.optCostHat.
import Mathlib import Definitions.Def_BertsekasShreve_ImperfectInfo_SufficientStatistic open MeasureTheory ProbabilityTheory
namespace BertsekasShreve.ImperfectInfo
theorem optCostHat_gt_bot {S C Z : Type}
[TopologicalSpace S] [MeasurableSpace S] [BorelSpace S]
[TopologicalSpace C] [MeasurableSpace C] [BorelSpace C]
[TopologicalSpace Z] [MeasurableSpace Z] [BorelSpace Z]
(M : ISIModel S C Z) {Y : ℕ → Type} [∀ k, TopologicalSpace (Y k)] [∀ k, MeasurableSpace (Y k)]
(σ : SuffStat M Y)
(hF : σ.FhatPlus) (y : Y 0) :
⊥ < σ.optCostHat y := by sorry
end BertsekasShreve.ImperfectInfo