Can a language model (like GPT-3) learn meaning? But really?

Apr 29, 2022

|

27 views

AI Coffee Break with Letitia

Details

What is meaning? How far is state-of-the art NLP from meaning? Do publications misuse the word “meaning”? "Climbing towards NLU" paper explained. ▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀ 🔥 Optionally, pay us a coffee to boost our Coffee Bean production! ☕ Patreon: https://www.patreon.com/AICoffeeBreak Ko-fi: https://ko-fi.com/aicoffeebreak ▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀ 📺 Transformer combining Vision and Language: https://youtu.be/dd7nE4nbxN0 📺 GPT-3 video: https://youtu.be/5fqxPOaaqi0 📺 BERTology meets Biology: https://youtu.be/pFf4PltQ9LY Outline: * 00:00 500 subs celebration! * 00:53 Breathing pause * 02:12 Misuse of “meaning” * 04:22 What is meaning? * 06:39 Language models and meaning * 08:20 Octopus experiment * 11:09 What to do? 📄 Paper explained: Bender, Emily M., and Alexander Koller. "Climbing towards NLU: On meaning, form, and understanding in the age of data." In Proc. of ACL. 2020. https://www.aclweb.org/anthology/2020.acl-main.463/ 🎧 Audiopaper: https://soundcloud.com/emily-m-bender/climbingtowardsnlu-audiopaper/s-0ZT7112K1Ep 🔗 Links: YouTube: https://www.youtube.com/AICoffeeBreak Twitter: https://twitter.com/AICoffeeBreak Reddit: https://www.reddit.com/r/AICoffeeBreak/ #AICoffeeBreak #MsCoffeeBean #ACL2020 #NLU Video and thumbnail contain emojis designed by OpenMoji – the open-source emoji and icon project. License: CC BY-SA 4.0

00:00 500 subs celebration! 00:53 Breathing pause 02:12 Misuse of “meaning” 04:22 What is meaning? 06:39 Language models and meaning 08:20 Octopus experiment 11:09 What to do?

Category: Research Paper

Category: Misc.

Comments

loading...

Reactions (0) | Note

📝 No reactions yet

Be the first one to share your thoughts!

Reactions(0)

Note

loading...

Recommended

ICAPS 2012: Session VIIb on "Heuristic Search"

ICAPS | Aug 18, 2014

ICAPS 2012: Session IIIa on "Robot Path Planning"

ICAPS | Aug 18, 2014

ICAPS 2012: DC Posters & System Demos

ICAPS | Aug 18, 2014

ICAPS 2012: Session VIb on "Planning and Scheduling for Shipping and Transportation"

ICAPS | Aug 18, 2014

ICAPS 2012: Awards & Best Dissertation Presentations

ICAPS | Aug 19, 2014