Superintelligence will be the most impactful technology humanity has ever invented, and could help us solve many of the world’s most important problems. But the vast power of superintelligence could also be very dangerous, and could lead to the disempowerment of humanity or even human extinction.
So they came out and said it. Overton Window is open.
We are dedicating 20% of the compute we’ve secured to date over the next four years to solving the problem of superintelligence alignment.
Significant resources then.
Our goal is to build a roughly human-level automated alignment researcher.
Hmm. The fox is guarding the henhouse. I just don’t know if anything else has a chance of working in time.
[EDIT: just saw the linkpost. Not sure why it didn’t load in my feed before.]
Published just yesterday: https://openai.com/blog/introducing-superalignment
So they came out and said it. Overton Window is open.
Significant resources then.
Hmm. The fox is guarding the henhouse. I just don’t know if anything else has a chance of working in time.
[EDIT: just saw the linkpost. Not sure why it didn’t load in my feed before.]