Introduction to Online Convex Optimization VI: Bandit Convex Optimization via Gradient EstimationTextbook
Every algorithm in Chapters I–V observes the full cost function after playing . Many applications only reveal the scalar cost incurred — routing a network and observing total latency, or placing an ad and observing the click-through revenue, without ever seeing the cost of a path or bid not taken. This is the bandit feedback model, and…