[ML News] Google's 540B PaLM Language Model & OpenAI's DALL-E 2 Text-to-Image Revolution

Apr 12, 2022

|

44 views

Yannic Kilcher

Details

#mlnews #palm #dalle2 Google releases PaLM and OpenAI releases DALL-E 2 (and more news). Sponsor: Weights & BIases Start here: https://wandb.me/yannic Thumbnail credit: DALL-E 2 via Sam Altman OUTLINE 0:00 - Street interview w/ random stranger 2:25 - Intro 2:50 - PaLM - Google's 540B Pathways Language Model 7:50 - Sponsor: Weights & Biases 9:10 - OpenAI releases DALL-E 2 12:05 - Open Source Datasets and Models 13:20 - Salesforce releases CodeGen My Live Reaction to DALL-E 2: https://youtu.be/gGPv_SYVDC8 My Video on GLIDE: https://youtu.be/gwI6g1pBD84 My Video on the Pathways System: https://youtu.be/vGFaiLeoLWw References: PaLM - Google's 540B Pathways Language Model https://ai.googleblog.com/2022/04/pathways-language-model-palm-scaling-to.html https://storage.googleapis.com/pathways-language-model/PaLM-paper.pdf OpenAI releases DALL-E 2 https://openai.com/dall-e-2/ https://cdn.openai.com/papers/dall-e-2.pdf https://www.instagram.com/openaidalle/ https://twitter.com/sama/status/1511724264629678084?s=09&t=58fWOJMHUDnOla5nD_ygjg&utm_source=pocket_mylist https://twitter.com/sama/media https://twitter.com/BorisMPower/status/1511738735175610371 https://twitter.com/ariskonstant/status/1511744708875218945 Open Source Datasets and Models https://twitter.com/multimodalart/status/1510999907498442756 https://laion.ai/laion-5b-a-new-era-of-open-large-scale-multi-modal-datasets/ https://github.com/mlfoundations/open_clip Salesforce releases CodeGen https://github.com/salesforce/CodeGen Links: Merch: http://store.ykilcher.com TabNine Code Completion (Referral): http://bit.ly/tabnine-yannick YouTube: https://www.youtube.com/c/yannickilcher Twitter: https://twitter.com/ykilcher Discord: https://discord.gg/4H8xxDF BitChute: https://www.bitchute.com/channel/yannic-kilcher LinkedIn: https://www.linkedin.com/in/ykilcher BiliBili: https://space.bilibili.com/2017636191 If you want to support me, the best thing to do is to share out the content :) If you want to support me financially (completely optional and voluntary, but a lot of people have asked for this): SubscribeStar: https://www.subscribestar.com/yannickilcher Patreon: https://www.patreon.com/yannickilcher Bitcoin (BTC): bc1q49lsw3q325tr58ygf8sudx2dqfguclvngvy2cq Ethereum (ETH): 0x7ad3513E3B8f66799f507Aa7874b1B0eBC7F85e2 Litecoin (LTC): LQW2TRyKYetVC8WjFkhpPhtpbDM4Vw7r9m Monero (XMR): 4ACL8AGrEo5hAir8A9CeVrW8pEauWvnp1WnSDZxW7tziCDLhZAGsgzhRQABDnFy8yuM9fWJDviJPHKRjV4FWt19CJZN9D4n

0:00 - Street interview w/ random stranger 2:25 - Intro 2:50 - PaLM - Google's 540B Pathways Language Model 7:50 - Sponsor: Weights & Biases 9:10 - OpenAI releases DALL-E 2 12:05 - Open Source Datasets and Models 13:20 - Salesforce releases CodeGen

Category: Misc.

Comments

loading...

Reactions (0) | Note

📝 No reactions yet

Be the first one to share your thoughts!

Reactions(0)

Note

loading...

Recommended

SREcon15 - SRE Hiring

USENIX | Apr 9, 2015

SREcon15 - Incident Analysis

USENIX | Apr 13, 2015

SREcon15 - From Zero to Hero: Recommended Practices for Training your Ever-Evolving SRE Teams

USENIX | Apr 13, 2015

SREcon15 - Architecting and Launching the Halo 4 Services

USENIX | Apr 13, 2015

SREcon15 - Being Afraid—How Paranoia at Dropbox Protects Your Data

USENIX | Apr 13, 2015