Adversarial attack on OpenAI’s CLIP? Are we the fools or the foolers?

Jun 13, 2021

|

73 views

AI Coffee Break with Letitia

Details

“Pen and paper fool OpenAI!” Typographic attacks in the wild. Or not. Ms. Coffee Bean rants about the typographic attacks on OpenAI’s CLIP. Are we really fooling the model or are we fooling ourselves? A different take on the adversarial attacks on OpenAI’s CLIP model. 📺 CLIP explained: https://youtu.be/dh8Rxhf7cLU 📄 Multimodal Neurons in Artificial Neural Networks: https://openai.com/blog/multimodal-neurons/ Outline: * 00:00 Fooling CLIP * 00:51 What is this all about? * 03:22 Why zero-shot failure is not an attack * 05:48 Reasons to worry 🤩 CLIP code: https://github.com/openai/CLIP 🤩 Cool list of OpenAI’s CLIP applications list on Reddit: https://www.reddit.com/r/MachineLearning/comments/ldc6oc/p_list_of_sitesprogramsprojects_that_use_openais/ 📺 @Yannic Kilcher explaines Multimodal Neurons in Artificial Neural Networks: https://youtu.be/Z_kWZpgEZ7w 📺 @Yannic Kilcher fix for CLIP adversarial attack: https://youtu.be/Rk3MBx20z24 🔗 Links: YouTube: https://www.youtube.com/AICoffeeBreak Twitter: https://twitter.com/AICoffeeBreak Reddit: https://www.reddit.com/r/AICoffeeBreak/ #AICoffeeBreak #MsCoffeeBean #rant #MachineLearning #AI #OpenAI Video contains emojis designed by OpenMoji – the open-source emoji and icon project. License: CC BY-SA 4.0 Music: 🎵 Brainmelt by Underbelly 🎵 Discovery Hit by Kevin MacLeod is licensed under a Creative Commons Attribution 4.0 licence. https://creativecommons.org/licenses/by/4.0/ Source: http://incompetech.com/music/royalty-free/index.html?isrc=USUAN1300023 Artist: http://incompetech.com/

00:00 Fooling CLIP 00:51 What is this all about? 03:22 Why zero-shot failure is not an attack 05:48 Reasons to worry

Category: Research Talk

Comments

loading...

Reactions (0) | Note

📝 No reactions yet

Be the first one to share your thoughts!

Reactions(0)

Note

loading...

Recommended

ICAPS 2012: Session VIa on "Probabilistic and Non-Deterministic Planning"

ICAPS | Aug 18, 2014

ICAPS 2012: Session VIIa on "Probabilistic and Non-Deterministic Planning II"

ICAPS | Aug 18, 2014

ICAPS 2012: Session VIIb on "Heuristic Search"

ICAPS | Aug 18, 2014

ICAPS 2012: Session IIIa on "Robot Path Planning"

ICAPS | Aug 18, 2014

ICAPS 2012: DC Posters & System Demos

ICAPS | Aug 18, 2014