Continuous-time Lower Bounds for Gradient-based Algorithms