[ML News] De-Biasing GPT-3 | RL cracks chip design | NetHack challenge | Open-Source GPT-J

Jun 22, 2021

|

31 views

Yannic Kilcher

Details

OUTLINE: 0:00 - Intro 0:30 - Google RL creates next-gen TPUs 2:15 - Facebook launches NetHack challenge 3:50 - OpenAI mitigates bias by fine-tuning 9:05 - Google AI releases browseable reconstruction of human cortex 9:50 - GPT-J 6B Transformer in JAX 12:00 - Tensorflow launches Forum 13:50 - Text style transfer from a single word 15:45 - ALiEn artificial life simulator My Video on Chip Placement: https://youtu.be/PDRtyrVskMU References: RL creates next-gen TPUs https://www.nature.com/articles/s41586-021-03544-w https://www.youtube.com/watch?v=PDRtyrVskMU Facebook launches NetHack challenge https://ai.facebook.com/blog/launching-the-nethack-challenge-at-neurips-2021/ Mitigating bias by fine-tuning https://openai.com/blog/improving-language-model-behavior/?s=09 Human Cortex 3D Reconstruction https://ai.googleblog.com/2021/06/a-browsable-petascale-reconstruction-of.html GPT-J: An open-source 6B transformer https://arankomatsuzaki.wordpress.com/2021/06/04/gpt-j/ https://6b.eleuther.ai/ https://github.com/kingoflolz/mesh-transformer-jax/#gpt-j-6b Tensorflow launches "Forum" https://discuss.tensorflow.org/ Text style transfer from single word https://ai.facebook.com/blog/ai-can-now-emulate-text-style-in-images-in-one-shot-using-just-a-single-word/ ALiEn Life Simulator https://github.com/chrxh/alien Links: TabNine Code Completion (Referral): http://bit.ly/tabnine-yannick YouTube: https://www.youtube.com/c/yannickilcher Twitter: https://twitter.com/ykilcher Discord: https://discord.gg/4H8xxDF BitChute: https://www.bitchute.com/channel/yannic-kilcher Minds: https://www.minds.com/ykilcher Parler: https://parler.com/profile/YannicKilcher LinkedIn: https://www.linkedin.com/in/ykilcher BiliBili: https://space.bilibili.com/1824646584 If you want to support me, the best thing to do is to share out the content :) If you want to support me financially (completely optional and voluntary, but a lot of people have asked for this): SubscribeStar: https://www.subscribestar.com/yannickilcher Patreon: https://www.patreon.com/yannickilcher Bitcoin (BTC): bc1q49lsw3q325tr58ygf8sudx2dqfguclvngvy2cq Ethereum (ETH): 0x7ad3513E3B8f66799f507Aa7874b1B0eBC7F85e2 Litecoin (LTC): LQW2TRyKYetVC8WjFkhpPhtpbDM4Vw7r9m Monero (XMR): 4ACL8AGrEo5hAir8A9CeVrW8pEauWvnp1WnSDZxW7tziCDLhZAGsgzhRQABDnFy8yuM9fWJDviJPHKRjV4FWt19CJZN9D4n

0:00 - Intro 0:30 - Google RL creates next-gen TPUs 2:15 - Facebook launches NetHack challenge 3:50 - OpenAI mitigates bias by fine-tuning 9:05 - Google AI releases browseable reconstruction of human cortex 9:50 - GPT-J 6B Transformer in JAX 12:00 - Tensorflow launches Forum 13:50 - Text style transfer from a single word 15:45 - ALiEn artificial life simulator

Category: Misc.

Comments

loading...

Reactions (0) | Note

📝 No reactions yet

Be the first one to share your thoughts!

Reactions(0)

Note

loading...

Recommended

ICAPS 2014: Daniel Harabor on "Improving Jump Point Search"

ICAPS | Jul 2, 2014

ICAPS 2014 Invited Talk: Peter Wurman

ICAPS | Jul 2, 2014

ICAPS 2014: Mike Phillips on "PA*SE: Parallel A* for Slow Expansions"

ICAPS | Jul 3, 2014

ICAPS 2014: Vidal Alcázar on "Analyzing the Impact of Partial States..."

ICAPS | Jul 3, 2014

ICAPS 2014: Aijun Bai on "Thompson Sampling Based Monte-Carlo Planning in POMDPs"

ICAPS | Jul 3, 2014