Adversarial attack on OpenAI’s CLIP? Are we the fools or the foolers?

Adversarial attack on OpenAI’s CLIP? Are we the fools or the foolers?

Jun 13, 2021
|
72 views
Details
“Pen and paper fool OpenAI!” Typographic attacks in the wild. Or not. Ms. Coffee Bean rants about the typographic attacks on OpenAI’s CLIP. Are we really fooling the model or are we fooling ourselves? A different take on the adversarial attacks on OpenAI’s CLIP model. 📺 CLIP explained: https://youtu.be/dh8Rxhf7cLU 📄 Multimodal Neurons in Artificial Neural Networks: https://openai.com/blog/multimodal-neurons/ Outline: * 00:00 Fooling CLIP * 00:51 What is this all about? * 03:22 Why zero-shot failure is not an attack * 05:48 Reasons to worry 🤩 CLIP code: https://github.com/openai/CLIP 🤩 Cool list of OpenAI’s CLIP applications list on Reddit: https://www.reddit.com/r/MachineLearning/comments/ldc6oc/p_list_of_sitesprogramsprojects_that_use_openais/ 📺 @Yannic Kilcher explaines Multimodal Neurons in Artificial Neural Networks: https://youtu.be/Z_kWZpgEZ7w 📺 @Yannic Kilcher fix for CLIP adversarial attack: https://youtu.be/Rk3MBx20z24 🔗 Links: YouTube: https://www.youtube.com/AICoffeeBreak Twitter: https://twitter.com/AICoffeeBreak Reddit: https://www.reddit.com/r/AICoffeeBreak/ #AICoffeeBreak #MsCoffeeBean #rant #MachineLearning #AI #OpenAI Video contains emojis designed by OpenMoji – the open-source emoji and icon project. License: CC BY-SA 4.0 Music: 🎵 Brainmelt by Underbelly 🎵 Discovery Hit by Kevin MacLeod is licensed under a Creative Commons Attribution 4.0 licence. https://creativecommons.org/licenses/by/4.0/ Source: http://incompetech.com/music/royalty-free/index.html?isrc=USUAN1300023 Artist: http://incompetech.com/

00:00 Fooling CLIP 00:51 What is this all about? 03:22 Why zero-shot failure is not an attack 05:48 Reasons to worry
Comments
loading...