Task-Agnostic Amortized Inference of Gaussian Process Hyperparameters