Accelerating the diffusion-based ensemble sampling by non-reversible dynamics