or there is some amount of uncertainty about what it means to achieve the goal of “maximizing paperclips
“uncertainty” is in your human understanding of the program, not in the actual program. A program doesn’t go “I don’t know what I’m supposed to do next”, it follows instructions step-by-step.
If the latter, what would it mean to maximize shapeless objects?
It would mean exactly what it’s programmed to mean, without any uncertainty in it at all.
“uncertainty” is in your human understanding of the program, not in the actual program. A program doesn’t go “I don’t know what I’m supposed to do next”, it follows instructions step-by-step.
It would mean exactly what it’s programmed to mean, without any uncertainty in it at all.