Generalization – Interpolation – Extrapolation in Machine Learning: Which is it now!?

Dec 15, 2021

|

41 views

AI Coffee Break with Letitia

Details

A summary of the Generalization – Interpolation – Extrapolation debate in machine Learning. “Learning in High Dimension Always Amounts to Extrapolation” explained. Paper: 📜 Balestriero, Randall, Jerome Pesenti, and Yann LeCun. "Learning in High Dimension Always Amounts to Extrapolation." arXiv preprint arXiv:2110.09485 (2021). https://arxiv.org/abs/2110.09485 🔗 Twitter announcement by Y. LeCun: https://twitter.com/ylecun/status/1450560732483948545 🔗 Response of F. Chollet: https://twitter.com/fchollet/status/1450524400227287040 Older Twitter fights: 🍿 🔗 Y. LeCun claiming that in high dimensions everything is extrapolation. https://twitter.com/ylecun/status/1409940043951742981 🔗 Gary Markus claiming the opposite: https://twitter.com/GaryMarcus/status/1411401507610796032 🔗 “You Don’t Understand Neural Networks Until You Understand the Universal Approximation Theorem” Blog Post by Andre Ye: https://medium.com/analytics-vidhya/you-dont-understand-neural-networks-until-you-understand-the-universal-approximation-theorem-85b3e7677126 🔗 Reddit discussion about the paper: https://www.reddit.com/r/MachineLearning/comments/qbbknr/r_learning_in_high_dimension_always_amounts_to/ Thanks to our Patrons who support us in Tier 2, 3, 4: 🙏 donor, Dres. Trost GbR, Yannik Schneider Outline: 00:00 Paper warning 01:44 It’s interpolation 03:05 No, it’s extrapolation 06:38 Now it’s interpolation again 08:08 What is it?? ▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀ 🔥 Optionally, pay us a coffee to help with our Coffee Bean production! ☕ Patreon: https://www.patreon.com/AICoffeeBreak Ko-fi: https://ko-fi.com/aicoffeebreak ▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀ 🔗 Links: AICoffeeBreakQuiz: https://www.youtube.com/c/AICoffeeBreak/community Twitter: https://twitter.com/AICoffeeBreak Reddit: https://www.reddit.com/r/AICoffeeBreak/ YouTube: https://www.youtube.com/AICoffeeBreak #AICoffeeBreak #MsCoffeeBean #MachineLearning #AI #research Music 🎵 : Cha Da Cup Riddim - Konrad OldMoney Video contains the rock emojis designed by OpenMoji – the open-source emoji and icon project. License: CC BY-SA 4.0

00:00 Paper warning 01:44 It’s interpolation 03:05 No, it’s extrapolation 06:38 Now it’s interpolation again 08:08 What is it??

Category: Research Talk

Category: Research Paper

Comments

loading...

Reactions (0) | Note

📝 No reactions yet

Be the first one to share your thoughts!

Reactions(0)

Note

loading...

Recommended

ICAPS 2014: Menkes van den Briel on "Flow-based Heuristics for Optimal Planning"

ICAPS | Mar 13, 2015

SREcon15 - Notes from Production Engineering

USENIX | Apr 9, 2015

SREcon15 - Case Study: Adopting SRE Principles at StackOverflow

USENIX | Apr 9, 2015

SREcon15 - Monitoring without Infrastructure @ Airbnb

USENIX | Apr 9, 2015

SREcon15 - Scaling Networks through Software

USENIX | Apr 9, 2015