Linear Programming and Finite Markovian Control Problems VI: Constrained Average Reward — the Limit Points of the Expected State-Action Frequencies Form the Linear Programming PolytopeTextbook
A controller of a finite Markov chain often cares about more than one long-run quantity: an inventory manager wants a high average profit while keeping the long-run fraction of stock-outs below a target; a communication network maximizes throughput subject to bounds on average delay or power. Such problems are constrained Markov decision problems: maximize…