Invited Talk: From Human Language to Agent Action