On the Convergence of Smooth Regularized Approximate Value Iteration Schemes