Trading off theory and practice: A bandit perspective