Catastrophic Regressional Goodhart

9 May 2023 3:43 UTC

When is Goodhart catastrophic?

Drake Thomas and Thomas Kwa

9 May 2023 3:59 UTC

179 points

29 comments8 min readLW link 1 review

Catastrophic Regressional Goodhart: Appendix

Thomas Kwa and Drake Thomas

15 May 2023 0:10 UTC

25 points

1 comment9 min readLW link

Catastrophic Goodhart in RL with KL penalty

Thomas Kwa and Adrià Garriga-alonso

15 May 2024 0:58 UTC

62 points

10 comments7 min readLW link

Goodhart in RL with KL: Appendix

Thomas Kwa18 May 2024 0:40 UTC

12 points

0 comments6 min readLW link