Nora_Ammann

Karma: 1,268

Current:

Technical Specialist, Safeguarded AI, Advanced Research and Invention Agency (ARIA)
Work on ‘Flexible Hardware Enabled Guarantees’ (flexHEG)

Past:

Director and Co-Founder of “Principles of Intelligent Behaviour in Biological and Social Systems” (pibbss.ai)
Research Affiliate and PhD student with the Alignment of Complex Systems group, Charles University (acsresearch.org)
Programme Manager, Future of Humanity Institute, University of Oxford
Research Affiliate, Simon Institute for Longterm Governance

Gradual Disempowerment: Systemic Existential Risks from Incremental AI Development

Jan_Kulveit, Raymond D, Nora_Ammann, Deger Turan, David Scott Krueger (formerly: capybaralet) and David Duvenaud

30 Jan 2025 17:03 UTC

22 points

0 comments2 min readLW link

(gradual-disempowerment.ai)

New Executive Team & Board — PIBBSS

Nora_Ammann1 Jul 2024 19:30 UTC

43 points

1 comment1 min readLW link

Announcing ILIAD — Theoretical AI Alignment Conference

Nora_Ammann and Alexander Gietelink Oldenziel

5 Jun 2024 9:37 UTC

163 points

18 comments2 min readLW link

[Closed] PIBBSS is hiring in a variety of roles (alignment research and incubation program)

Nora_Ammann, Lucas Teixeira and DusanDNesic

9 Apr 2024 8:12 UTC

54 points

0 comments3 min readLW link

Post series on “Liability Law for reducing Existential Risk from AI”

Nora_Ammann29 Feb 2024 4:39 UTC

42 points

1 comment1 min readLW link

(forum.effectivealtruism.org)

Retrospective: PIBBSS Fellowship 2023

DusanDNesic and Nora_Ammann

16 Feb 2024 17:48 UTC

31 points

1 comment8 min readLW link

PIBBSS Speaker events comings up in February

DusanDNesic, Nora_Ammann and Lucas Teixeira

1 Feb 2024 3:28 UTC

10 points

2 comments1 min readLW link

Three Types of Constraints in the Space of Agents

Nora_Ammann and Mateusz Bagiński

15 Jan 2024 17:27 UTC

26 points

3 comments17 min readLW link

Apply to the 2024 PIBBSS Summer Research Fellowship

Nora_Ammann, DusanDNesic and Lucas Teixeira

12 Jan 2024 4:06 UTC

39 points

1 comment2 min readLW link

Complex systems research as a field (and its relevance to AI Alignment)

Nora_Ammann and habryka

1 Dec 2023 22:10 UTC

64 points

11 comments19 min readLW link

What’s next for the field of Agent Foundations?

Nora_Ammann, Alexander Gietelink Oldenziel and mattmacdermott

30 Nov 2023 17:55 UTC

59 points

23 comments10 min readLW link

‘Theories of Values’ and ‘Theories of Agents’: confusions, musings and desiderata

Mateusz Bagiński and Nora_Ammann

15 Nov 2023 16:00 UTC

35 points

8 comments24 min readLW link

5. Risks from preventing legitimate value change (value collapse)

Nora_Ammann26 Oct 2023 14:38 UTC

13 points

1 comment9 min readLW link

4. Risks from causing illegitimate value change (performative predictors)

Nora_Ammann26 Oct 2023 14:38 UTC

8 points

3 comments5 min readLW link

3. Premise three & Conclusion: AI systems can affect value change trajectories & the Value Change Problem

Nora_Ammann26 Oct 2023 14:38 UTC

28 points

4 comments4 min readLW link

2. Premise two: Some cases of value change are (il)legitimate

Nora_Ammann26 Oct 2023 14:36 UTC

24 points

7 comments6 min readLW link

1. Premise one: Values are malleable

Nora_Ammann26 Oct 2023 14:36 UTC

21 points

1 comment15 min readLW link

0. The Value Change Problem: introduction, overview and motivations

Nora_Ammann26 Oct 2023 14:36 UTC

32 points

0 comments5 min readLW link

Announcing new round of “Key Phenomena in AI Risk” Reading Group

DusanDNesic and Nora_Ammann

20 Oct 2023 7:11 UTC

15 points

2 comments1 min readLW link

Become a PIBBSS Research Affiliate

Nora_Ammann and DusanDNesic

10 Oct 2023 7:41 UTC

24 points

6 comments6 min readLW link