Adversarial Examples

Tag

SolidGoldMagikarp (plus, prompt generation)

Jessica Rumbelow and mwatkins

5 Feb 2023 22:02 UTC

676 points

205 comments12 min readLW link

Ironing Out the Squiggles

Zack_M_Davis29 Apr 2024 16:13 UTC

153 points

36 comments11 min readLW link

AI Safety in a World of Vulnerable Machine Learning Systems

AdamGleave and EuanMcLean

8 Mar 2023 2:40 UTC

70 points

28 comments29 min readLW link

(far.ai)

If I were a well-intentioned AI… I: Image classifier

Stuart_Armstrong26 Feb 2020 12:39 UTC

35 points

4 comments5 min readLW link

Solving adversarial attacks in computer vision as a baby version of general AI alignment

Stanislav Fort29 Aug 2024 17:17 UTC

87 points

8 comments7 min readLW link

[Question] What progress have we made on automated auditing?

LawrenceC6 Jul 2024 1:49 UTC

38 points

1 comment1 min readLW link

AXRP Episode 1 - Adversarial Policies with Adam Gleave

DanielFilan29 Dec 2020 20:41 UTC

12 points

5 comments34 min readLW link

Deep Forgetting & Unlearning for Safely-Scoped LLMs

scasper5 Dec 2023 16:48 UTC

122 points

29 comments13 min readLW link

The Goodhart Game

John_Maxwell18 Nov 2019 23:22 UTC

13 points

5 comments5 min readLW link

Adversarial Robustness Could Help Prevent Catastrophic Misuse

aogara11 Dec 2023 19:12 UTC

30 points

18 comments9 min readLW link

There are (probably) no superhuman Go AIs: strong human players beat the strongest AIs

Taran19 Feb 2023 12:25 UTC

124 points

34 comments4 min readLW link

RAIN: Your Language Models Can Align Themselves without Finetuning—Microsoft Research 2023 - Reduces the adversarial prompt attack success rate from 94% to 19%!

Singularian250124 Sep 2023 16:48 UTC

5 points

0 comments1 min readLW link

Adversarial Policies Beat Professional-Level Go AIs

sanxiyn3 Nov 2022 13:27 UTC

31 points

35 comments1 min readLW link

(goattack.alignmentfund.org)

Human beats SOTA Go AI by learning an adversarial policy

Vanessa Kosoy19 Feb 2023 9:38 UTC

58 points

32 comments1 min readLW link

(goattack.far.ai)

Adversarial attacks and optimal control

Jan22 May 2022 18:22 UTC

17 points

7 comments8 min readLW link

(universalprior.substack.com)

A Search for More ChatGPT / GPT-3.5 / GPT-4 “Unspeakable” Glitch Tokens

Martin Fell9 May 2023 14:36 UTC

26 points

9 comments6 min readLW link

EIS X: Continual Learning, Modularity, Compression, and Biological Brains

scasper21 Feb 2023 16:59 UTC

14 points

4 comments3 min readLW link

EIS XII: Summary

scasper23 Feb 2023 17:45 UTC

18 points

0 comments6 min readLW link

[AN #62] Are adversarial examples caused by real but imperceptible features?

Rohin Shah22 Aug 2019 17:10 UTC

28 points

10 comments9 min readLW link

(mailchi.mp)

Even Superhuman Go AIs Have Surprising Failure Modes

AdamGleave, EuanMcLean, Tony Wang, Kellin Pelrine, Tom Tseng, Yawen Duan, Joseph Miller and MichaelDennis

20 Jul 2023 17:31 UTC

129 points

22 comments10 min readLW link

(far.ai)

Analysing Adversarial Attacks with Linear Probing

Yoann Poupart, Imene Kerboua, Clement Neo and Jason Hoelscher-Obermaier

17 Jun 2024 14:16 UTC

9 points

0 comments8 min readLW link

The Achilles Heel Hypothesis for AI

scasper13 Oct 2020 14:35 UTC

20 points

6 comments1 min readLW link

An adversarial example for Direct Logit Attribution: memory management in gelu-4l

Can, Yeu-Tong Lau, James Dao and Jett Janiak

30 Aug 2023 17:36 UTC

17 points

0 comments8 min readLW link

(arxiv.org)

Image Hijacks: Adversarial Images can Control Generative Models at Runtime

Scott Emmons, Luke Bailey and Euan Ong

20 Sep 2023 15:23 UTC

58 points

9 comments1 min readLW link

(arxiv.org)

EIS IX: Interpretability and Adversaries

scasper20 Feb 2023 18:25 UTC

30 points

7 comments8 min readLW link

Beyond the Board: Exploring AI Robustness Through Go

AdamGleave19 Jun 2024 16:40 UTC

41 points

2 comments1 min readLW link

(far.ai)

Evidence Sets: Towards Inductive-Biases based Analysis of Prosaic AGI

bayesian_kitten16 Dec 2021 22:41 UTC

22 points

10 comments21 min readLW link

Does robustness improve with scale?

ChengCheng, niki.h, Ian McKenzie, Oskar Hollinsworth, Tom Tseng and AdamGleave

25 Jul 2024 20:55 UTC

14 points

0 comments1 min readLW link

(far.ai)

High-stakes alignment via adversarial training [Redwood Research report]

dmz, LawrenceC and Nate Thomas

5 May 2022 0:59 UTC

142 points

29 comments9 min readLW link

SmartyHeaderCode: anomalous tokens for GPT3.5 and GPT-4

AdamYedidia15 Apr 2023 22:35 UTC

71 points

18 comments6 min readLW link

Features and Adversaries in MemoryDT

Joseph Bloom and Jay Bailey

20 Oct 2023 7:32 UTC

31 points

6 comments25 min readLW link

Artefacts generated by mode collapse in GPT-4 Turbo serve as adversarial attacks.

Sohaib Imran10 Nov 2023 15:23 UTC

11 points

0 comments2 min readLW link

No comments.

Ad­ver­sar­ial Examples

Adversarial Examples