On the Bias, Risk, and Consistency of Sample Means in Multi-armed Bandits

The sample mean is among the most well-studied estimators in statistics, having many desirable properties such as unbiasedness and consistency. However, when analyzing data collected using a multi-...