Gutz, I think the idea is that if you set your goal any lower than perfection, you are creating a glass ceiling for yourself. Yahl doesn’t need or expect you to attain perfection, and you won’t have failed if you don’t. You just can’t settle for anything less.
Especially important to bear in mind when building an AGI. Setting terminal goals lower than what might be possible is the ultimate millennium bug. Except this time planes might actually fall out of the sky.
Gutz, I think the idea is that if you set your goal any lower than perfection, you are creating a glass ceiling for yourself. Yahl doesn’t need or expect you to attain perfection, and you won’t have failed if you don’t. You just can’t settle for anything less.
Especially important to bear in mind when building an AGI. Setting terminal goals lower than what might be possible is the ultimate millennium bug. Except this time planes might actually fall out of the sky.