It seems worth saying at this point that I don’t have an objection to loading up an AI with true prior information; it’s just not clear to me that a Solomonoff approximator would be incapable of learning that it’s part of the Universe and that its continued existence is contingent on the persistence of some specific structure in the Universe.
It seems worth saying at this point that I don’t have an objection to loading up an AI with true prior information; it’s just not clear to me that a Solomonoff approximator would be incapable of learning that it’s part of the Universe and that its continued existence is contingent on the persistence of some specific structure in the Universe.