In this paper, we introduce ballooning multi-armed bandits (BL-MAB ), a novel extension of the classical stochastic MAB model. In the BL-MAB model, the set of available arms grows (or balloons) over time. In contrast to ...