I’m very glad this list is finally published; I think it’s pretty great at covering the space (tho I won’t be surprised if we discover a few more points), and making it so that plans can say “yeah, we’re targeting a hole we see in number X.”
[In particular, I think most of my current hope is targeted at 5 and 6, specifically that we need an AI to do a pivotal act at all; it seems to me like we might be able to transition from this world to a world sophisticated enough to survive on human power. But this is, uh, a pretty remote possibility and I was much happier when I was optimistic about technical alignment.]
I’m very glad this list is finally published; I think it’s pretty great at covering the space (tho I won’t be surprised if we discover a few more points), and making it so that plans can say “yeah, we’re targeting a hole we see in number X.”
[In particular, I think most of my current hope is targeted at 5 and 6, specifically that we need an AI to do a pivotal act at all; it seems to me like we might be able to transition from this world to a world sophisticated enough to survive on human power. But this is, uh, a pretty remote possibility and I was much happier when I was optimistic about technical alignment.]