Learning on the Job in the Open World