The internal data structure of the bandit algorithm.
The inner state of a bandit that maintains estimates of arm means.
The internal state of an Exp3 bandit
A ranged action: Action a in normal course of action, Reset a in case * the bandit was just restarted.
The type of a bandit with a range.