Combining Statistical methods with Human Input for Evaluation and Optimization in Batch Settings