When you say the AGI has a goal of not modifying itself, do you mean that the AGI has a goal of not modifying its goals? Because that assumption seems to be fairly prevalent.
I meant “not modifying itself” which would include not modifying its goals if an AGI without a utility function can be said to have goals.
When you say the AGI has a goal of not modifying itself, do you mean that the AGI has a goal of not modifying its goals? Because that assumption seems to be fairly prevalent.
I meant “not modifying itself” which would include not modifying its goals if an AGI without a utility function can be said to have goals.