Knowledge Supports Visual Language Grounding: A Case Study on Colour Terms