I agree with this, except that I would go farther and add that if we had a superintelligent AI correctly calculate our “extrapolated preferences,” they would precisely include not being made into agents.
I agree with this, except that I would go farther and add that if we had a superintelligent AI correctly calculate our “extrapolated preferences,” they would precisely include not being made into agents.