The explanation itself was very clear—a serious effort had been made to explain this work and related ideas.
In the course of explaining a single result, it helps give strong intuitions about a wide variety of related areas in math and logic, which are very important for alignment research.
It was really fun to read; the drawings are very beautiful.
Biggest hesitations I had with curating:
It wasn’t clear to me that the main argument the post makes regarding the untrollable mathematicians is itself a huge result in agent foundations research.
This wasn’t a big factor for me though, as just making transparent all of the mental moves in achieving this result helps the reader with seeing / learning the mental models used throughout this research area.
I curated this post because:
The explanation itself was very clear—a serious effort had been made to explain this work and related ideas.
In the course of explaining a single result, it helps give strong intuitions about a wide variety of related areas in math and logic, which are very important for alignment research.
It was really fun to read; the drawings are very beautiful.
Biggest hesitations I had with curating:
It wasn’t clear to me that the main argument the post makes regarding the untrollable mathematicians is itself a huge result in agent foundations research.
This wasn’t a big factor for me though, as just making transparent all of the mental moves in achieving this result helps the reader with seeing / learning the mental models used throughout this research area.