[ML News] Meta's OPT 175B language model | DALL-E Mega is training | TorToiSe TTS fakes my voice

May 12, 2022

|

137 views

Yannic Kilcher

Details

#mlnews #dalle #gpt3 An inside look of what's happening in the ML world! Sponsor: Weights & Biases https://wandb.me/yannic OUTLINE: 0:00 - Intro 0:20 - Sponsor: Weights & Biases 1:40 - Meta AI releases OPT-175B 4:55 - CoCa: New CLIP-Competitor 8:15 - DALL-E Mega is training 10:05 - TorToiSe TTS is amazing! 11:50 - Investigating Vision Transformers 12:50 - Hugging Face Deep RL class launched 13:40 - Helpful Things 17:00 - John Deere's driverless tractors References: Meta AI releases OPT-175B https://ai.facebook.com/blog/democratizing-access-to-large-scale-language-models-with-opt-175b/ https://arxiv.org/abs/2205.01068 https://arxiv.org/pdf/2205.01068.pdf https://github.com/facebookresearch/metaseq/tree/main/projects/OPT https://github.com/facebookresearch/metaseq/blob/main/projects/OPT/chronicles/OPT175B_Logbook.pdf https://github.com/facebookresearch/metaseq/tree/main/projects/OPT/chronicles https://twitter.com/yoavgo/status/1522150063815987201 CoCa: New CLIP-Competitor https://arxiv.org/abs/2205.01917 https://arxiv.org/pdf/2205.01917.pdf DALL-E Mega is training https://twitter.com/borisdayma https://twitter.com/borisdayma/status/1521891895001112577 https://wandb.ai/dalle-mini/dalle-mini/reports/DALL-E-Mega--VmlldzoxODMxMDI2 TorToiSe TTS is amazing! https://github.com/neonbjb/tortoise-tts https://nonint.com/static/tortoise_v2_examples.html https://colab.research.google.com/drive/1wVVqUPqwiDBUVeWWOUNglpGhU3hg_cbR https://github.com/neonbjb Investigating Vision Transformers https://github.com/sayakpaul/probing-vits/?utm_source=pocket_mylist https://twitter.com/RisingSayak/status/1515918406171914240?utm_source=pocket_mylist https://keras.io/examples/vision/probing_vits/ https://github.com/sayakpaul/probing-vits/tree/main/notebooks?utm_source=pocket_mylist Hugging Face Deep RL class launched https://github.com/huggingface/deep-rl-class Helpful Things https://merantix-momentum.com/technology/squirrel/?utm_source=pocket_mylist https://github.com/merantix-momentum/squirrel-core?utm_source=pocket_mylist https://pyscript.net/?utm_source=pocket_mylist https://github.com/google-research/big_vision https://deepsportradar.github.io/challenge.html https://github.com/DeepSportRadar/camera-calibration-challenge https://twitter.com/alekseykorshuk/status/1515989357961920514?utm_source=pocket_mylist https://github.com/AlekseyKorshuk/huggingnft John Deere's driverless tractors https://thenextweb.com/news/john-deere-slowly-becoming-one-worlds-most-important-ai-companies https://tractorhacking.github.io/ Links: Merch: https://ykilcher.com/merch TabNine Code Completion (Referral): http://bit.ly/tabnine-yannick YouTube: https://www.youtube.com/c/yannickilcher Twitter: https://twitter.com/ykilcher Discord: https://discord.gg/4H8xxDF BitChute: https://www.bitchute.com/channel/yannic-kilcher LinkedIn: https://www.linkedin.com/in/ykilcher BiliBili: https://space.bilibili.com/2017636191 If you want to support me, the best thing to do is to share out the content :) If you want to support me financially (completely optional and voluntary, but a lot of people have asked for this): SubscribeStar: https://www.subscribestar.com/yannickilcher Patreon: https://www.patreon.com/yannickilcher Bitcoin (BTC): bc1q49lsw3q325tr58ygf8sudx2dqfguclvngvy2cq Ethereum (ETH): 0x7ad3513E3B8f66799f507Aa7874b1B0eBC7F85e2 Litecoin (LTC): LQW2TRyKYetVC8WjFkhpPhtpbDM4Vw7r9m Monero (XMR): 4ACL8AGrEo5hAir8A9CeVrW8pEauWvnp1WnSDZxW7tziCDLhZAGsgzhRQABDnFy8yuM9fWJDviJPHKRjV4FWt19CJZN9D4n

0:00 - Intro 0:20 - Sponsor: Weights & Biases 1:40 - Meta AI releases OPT-175B 4:55 - CoCa: New CLIP-Competitor 8:15 - DALL-E Mega is training 10:05 - TorToiSe TTS is amazing! 11:50 - Investigating Vision Transformers 12:50 - Hugging Face Deep RL class launched 13:40 - Helpful Things 17:00 - John Deere's driverless tractors

Category: Misc.

Comments

loading...

Reactions (0) | Note

📝 No reactions yet

Be the first one to share your thoughts!

Reactions(0)

Note

loading...

Recommended

Playing Atari with Deep Reinforcement Learning | Two Minute Paper

Two Minute Papers | Mar 7, 2015

ICAPS 2014: Menkes van den Briel on "Flow-based Heuristics for Optimal Planning"

ICAPS | Mar 13, 2015

SREcon15 - Notes from Production Engineering

USENIX | Apr 9, 2015

SREcon15 - Case Study: Adopting SRE Principles at StackOverflow

USENIX | Apr 9, 2015

SREcon15 - Monitoring without Infrastructure @ Airbnb

USENIX | Apr 9, 2015