Sign in
Can a language model (like GPT-3) learn meaning? But really?
Apr 29, 2022
|
29 views
AI Coffee Break with Letitia
Follow
Details
📺 Watch on YouTube 😃
What is meaning? How far is state-of-the art NLP from meaning? Do publications misuse the word “meaning”? "Climbing towards NLU" paper explained. ▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀ 🔥 Optionally, pay us a coffee to boost our Coffee Bean production! ☕ Patreon:
https://www.patreon.com/AICoffeeBreak
Ko-fi:
https://ko-fi.com/aicoffeebreak
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀ 📺 Transformer combining Vision and Language:
https://youtu.be/dd7nE4nbxN0
📺 GPT-3 video:
https://youtu.be/5fqxPOaaqi0
📺 BERTology meets Biology:
https://youtu.be/pFf4PltQ9LY
Outline: * 00:00 500 subs celebration! * 00:53 Breathing pause * 02:12 Misuse of “meaning” * 04:22 What is meaning? * 06:39 Language models and meaning * 08:20 Octopus experiment * 11:09 What to do? 📄 Paper explained: Bender, Emily M., and Alexander Koller. "Climbing towards NLU: On meaning, form, and understanding in the age of data." In Proc. of ACL. 2020.
https://www.aclweb.org/anthology/2020.acl-main.463/
🎧 Audiopaper:
https://soundcloud.com/emily-m-bender/climbingtowardsnlu-audiopaper/s-0ZT7112K1Ep
🔗 Links: YouTube:
https://www.youtube.com/AICoffeeBreak
Twitter:
https://twitter.com/AICoffeeBreak
Reddit:
https://www.reddit.com/r/AICoffeeBreak/
#AICoffeeBreak #MsCoffeeBean #ACL2020 #NLU Video and thumbnail contain emojis designed by OpenMoji – the open-source emoji and icon project. License: CC BY-SA 4.0
00:00
500 subs celebration!
00:53
Breathing pause
02:12
Misuse of “meaning”
04:22
What is meaning?
06:39
Language models and meaning
08:20
Octopus experiment
11:09
What to do?
Category: Research Paper
Category: Misc.
Comments
loading...
Reactions
(0)
| Note
📝 No reactions yet
Be the first one to share your thoughts!
Reactions
(0)
Note
loading...
Recommended
43:26
SREcon14 - Grilled Cheese at Scale: A Recipe for Stability Practices
USENIX
| Jun 26, 2014
50:45
SREcon14 - Design Review Best Practices
USENIX
| Jun 26, 2014
55:04
SREcon14 - Keys to SRE
USENIX
| Jun 26, 2014
3:08
The ICAPS Three
ICAPS
| Jul 2, 2014
20:34
ICAPS 2014: Daniel Harabor on "Improving Jump Point Search"
ICAPS
| Jul 2, 2014