Nora_Ammann

Karma: 1,515

Current:

Technical Specialist, Safeguarded AI, Advanced Research and Invention Agency (ARIA)
Work on ‘Flexible Hardware Enabled Guarantees’ (flexHEG)

Past:

Director and Co-Founder of “Principles of Intelligent Behaviour in Biological and Social Systems” (pibbss.ai)
Research Affiliate and PhD student with the Alignment of Complex Systems group, Charles University (acsresearch.org)
Programme Manager, Future of Humanity Institute, University of Oxford
Research Affiliate, Simon Institute for Longterm Governance

In response to critiques of Guaranteed Safe AI

Nora_AmmannJan 31, 2025, 1:43 AM

44 points

14 comments26 min readLW link

Gradual Disempowerment: Systemic Existential Risks from Incremental AI Development

Jan_Kulveit, Raymond D, Nora_Ammann, Deger Turan, David Scott Krueger (formerly: capybaralet) and David Duvenaud

Jan 30, 2025, 5:03 PM

162 points

57 comments2 min readLW link

(gradual-disempowerment.ai)

New Executive Team & Board — PIBBSS

Nora_AmmannJul 1, 2024, 7:30 PM

43 points

1 comment1 min readLW link

Announcing ILIAD — Theoretical AI Alignment Conference

Nora_Ammann and Alexander Gietelink Oldenziel

Jun 5, 2024, 9:37 AM

163 points

18 comments2 min readLW link

[Closed] PIBBSS is hiring in a variety of roles (alignment research and incubation program)

Nora_Ammann, Lucas Teixeira and DusanDNesic

Apr 9, 2024, 8:12 AM

54 points

0 comments3 min readLW link

Post series on “Liability Law for reducing Existential Risk from AI”

Nora_AmmannFeb 29, 2024, 4:39 AM

42 points

1 comment1 min readLW link

(forum.effectivealtruism.org)

Retrospective: PIBBSS Fellowship 2023

DusanDNesic and Nora_Ammann

Feb 16, 2024, 5:48 PM

31 points

1 comment8 min readLW link

PIBBSS Speaker events comings up in February

DusanDNesic, Nora_Ammann and Lucas Teixeira

Feb 1, 2024, 3:28 AM

10 points

2 comments1 min readLW link

Three Types of Constraints in the Space of Agents

Nora_Ammann and Mateusz Bagiński

Jan 15, 2024, 5:27 PM

26 points

3 comments17 min readLW link

Apply to the 2024 PIBBSS Summer Research Fellowship

Nora_Ammann, DusanDNesic and Lucas Teixeira

Jan 12, 2024, 4:06 AM

39 points

1 comment2 min readLW link

Complex systems research as a field (and its relevance to AI Alignment)

Nora_Ammann and habryka

Dec 1, 2023, 10:10 PM

65 points

11 comments19 min readLW link

What’s next for the field of Agent Foundations?

Nora_Ammann, Alexander Gietelink Oldenziel and mattmacdermott

Nov 30, 2023, 5:55 PM

59 points

23 comments10 min readLW link

‘Theories of Values’ and ‘Theories of Agents’: confusions, musings and desiderata

Mateusz Bagiński and Nora_Ammann

Nov 15, 2023, 4:00 PM

35 points

8 comments24 min readLW link

5. Risks from preventing legitimate value change (value collapse)

Nora_AmmannOct 26, 2023, 2:38 PM

13 points

1 comment9 min readLW link

4. Risks from causing illegitimate value change (performative predictors)

Nora_AmmannOct 26, 2023, 2:38 PM

8 points

3 comments5 min readLW link

3. Premise three & Conclusion: AI systems can affect value change trajectories & the Value Change Problem

Nora_AmmannOct 26, 2023, 2:38 PM

28 points

4 comments4 min readLW link

2. Premise two: Some cases of value change are (il)legitimate

Nora_AmmannOct 26, 2023, 2:36 PM

24 points

7 comments6 min readLW link

1. Premise one: Values are malleable

Nora_AmmannOct 26, 2023, 2:36 PM

21 points

1 comment15 min readLW link

0. The Value Change Problem: introduction, overview and motivations

Nora_AmmannOct 26, 2023, 2:36 PM

32 points

0 comments5 min readLW link

Announcing new round of “Key Phenomena in AI Risk” Reading Group

DusanDNesic and Nora_Ammann

Oct 20, 2023, 7:11 AM

15 points

2 comments1 min readLW link