Do Transformers process sequences of FIXED or of VARIABLE length? | #AICoffeeBreakQuiz

Nov 03, 2021

|

22 views

AI Coffee Break with Letitia

Details

Explaining the answer to the following AI Coffee Break Quiz question: “Do Transformers process sequences of fixed or of variable length?” ❓ Find the Quiz Question here: https://www.youtube.com/post/UgkxuvOZ9Un4JaQXwwEzY0Vu6v753m1JoPkx Read more: 🔗 https://huggingface.co/transformers/model_doc/bert.html 🔗 https://stats.stackexchange.com/questions/488844/self-attention-for-variable-length-sequence-classification Outline: 00:00 The quiz question 01:26 The code 03:11 The theory Thanks to our Patrons who support us in Tier 2, 3, 4: 🙏 donor, Dres. Trost GbR, Yannik Schneider ▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀ 🔥 Optionally, pay us a coffee to help with our Coffee Bean production! ☕ Patreon: https://www.patreon.com/AICoffeeBreak Ko-fi: https://ko-fi.com/aicoffeebreak ▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀ 🔗 Links: AICoffeeBreakQuiz: https://www.youtube.com/c/AICoffeeBreak/community Twitter: https://twitter.com/AICoffeeBreak Reddit: https://www.reddit.com/r/AICoffeeBreak/ YouTube: https://www.youtube.com/AICoffeeBreak #AICoffeeBreak #MsCoffeeBean #MachineLearning #AI #research Music 🎵 : Seratonin from the Sun – RAGE

00:00 The quiz question 01:26 The code 03:11 The theory

Category: Research Talk

Comments

loading...

Reactions (0) | Note

📝 No reactions yet

Be the first one to share your thoughts!

Reactions(0)

Note

loading...

Recommended

ICAPS 2014: Jendrik Seipp on "Diverse and Additive Cartesian Abstraction Heuristics"

ICAPS | Apr 14, 2015

ICAPS 2014: Bram Ridder on "Heuristic Evaluation Based on Lifted Relaxed Planning Graphs"

ICAPS | Apr 14, 2015

ICAPS 2014: Richard Valenzano on "A Comparison of Knowledge-Based GBFS Enhancements and..."

ICAPS | Apr 15, 2015

ICAPS 2014: Florian Pommerening on "LP-Based Heuristics for Cost-Optimal Planning"

ICAPS | Apr 15, 2015

ICAPS 2014: Benjamin Cohen on "Single- and Dual-Arm Motion Planning with Heuristic Search"

ICAPS | Apr 15, 2015