Incredibly unlikely: an AI is not going to structure itself so it works to fulfill the inverse of its utility function as the result of a single bit flip.
Sure it is if it’s the right bit, but averting this sort of bug when it’s important is a solved problem of software engineering, not value-alignment-complete.
However, if we assume that everything possible exists, such AI exists somewhere in the universe and is torturing a copy of me. And it is disturbing thought.
As I have said before, the BB is a scattered being in your model, but you yourself might be a scattered being in the BB’s model. So there are not two worlds, a real one and a BB one. There are just two real ones. A better way to think about it might be like special relativity, where each observer has a resting frame and might be moving relative to other ones. In the same way each observer has a reference frame where they are real.
Incredibly unlikely: an AI is not going to structure itself so it works to fulfill the inverse of its utility function as the result of a single bit flip.
Sure it is if it’s the right bit, but averting this sort of bug when it’s important is a solved problem of software engineering, not value-alignment-complete.
However, if we assume that everything possible exists, such AI exists somewhere in the universe and is torturing a copy of me. And it is disturbing thought.
If everything that’s possible exists, so do Boltzmann brains. We need some way to quantify existence, such as by likelyhood.
Don’t see any problem with BB existence. For each BB exists a real world there the same observer-moment is justified.
As I have said before, the BB is a scattered being in your model, but you yourself might be a scattered being in the BB’s model. So there are not two worlds, a real one and a BB one. There are just two real ones. A better way to think about it might be like special relativity, where each observer has a resting frame and might be moving relative to other ones. In the same way each observer has a reference frame where they are real.