Reinforcement Learning for Control with Multiple Frequencies