Swin Transformer paper animated and explained
Nov 06, 2021
AI Coffee Break with Letitia
📺 Watch on YouTube 😃
Swin Transformer paper explained, visualized, and animated by Ms. Coffee Bean. Find out what the Swin Transformer proposes to do better than the ViT vision transformer. 📺 ViT explained:
📺 Transformer explained:
📺► Positional embeddings (playlist):
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀ Thanks to our Patrons who support us in Tier 2, 3, 4: 🙏 donor, Dres. Trost GbR, Yannik Schneider 🔥 Optionally, pay us a coffee to help with our Coffee Bean production! ☕ Patreon:
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀ Paper discussed: 📜 Liu, Ze, Yutong Lin, Yue Cao, Han Hu, Yixuan Wei, Zheng Zhang, Stephen Lin, and Baining Guo. "Swin transformer: Hierarchical vision transformer using shifted windows." arXiv preprint arXiv:2103.14030 (2021).
💻 Swin Transformer code on GitHub:
Outline: 00:00 Problems with ViT / Swin Motivation 04:16 Swin Transformer explained 06:00 Shifted Window based Self-attention 08:58 positional embeddings in the Swin Transformer 09:29 Task performance of the Swin Transformer Music 🎵 : Bay Street Millionaires by Squadda B --------------------- 🔗 Links: AICoffeeBreakQuiz:
#AICoffeeBreak #MsCoffeeBean #MachineLearning #AI #research Video and thumbnail contain emojis designed by OpenMoji – the open-source emoji and icon project. License: CC BY-SA 4.0 16x16 pixels comprehensible artificial intelligence
Problems with ViT / Swin Motivation
Swin Transformer explained
Shifted Window based Self-attention
positional embeddings in the Swin Transformer
Task performance of the Swin Transformer
Category: Research Paper
📝 No reactions yet
Be the first one to share your thoughts!
ICAPS 2012: Awards & Best Dissertation Presentations
| Aug 19, 2014
ICAPS 2014: Miquel Ramírez on "Directed Fixed-Point Regression-Based Planning..."
| Sep 22, 2014
Representation Learning: A Review and New Perspectives
| Nov 12, 2014
Playing Atari with Deep Reinforcement Learning | Two Minute Paper
Two Minute Papers
| Mar 7, 2015
ICAPS 2014: Menkes van den Briel on "Flow-based Heuristics for Optimal Planning"
| Mar 13, 2015
Crossminds Chrome Extension
Watch videos on arXiv
Subscribe to Our Newsletter
AI Startup Jobs
Terms & Conditions
© Provided by CrossCircles Inc.