Because I would give odds around as extreme as the odds I would give of anything, that if you tell me “the AI you built is trying to deceive yourself”, it indicates that some kind of really epic error has occurred. Controlled shutdown, immediately.
Um, no. Controlled shutdown means you are relying on software, which should be presumed corrupted, unless you are very sure about your correctness proofs. What you want there is uncontrolled shutdown, whether by pulling the plug, taking an axe to the CPU, shutting down the local power-grid, or nuking the city, as necessary. Otherwise, Hard Rapture.
Because I would give odds around as extreme as the odds I would give of anything, that if you tell me “the AI you built is trying to deceive yourself”, it indicates that some kind of really epic error has occurred. Controlled shutdown, immediately.
Um, no. Controlled shutdown means you are relying on software, which should be presumed corrupted, unless you are very sure about your correctness proofs. What you want there is uncontrolled shutdown, whether by pulling the plug, taking an axe to the CPU, shutting down the local power-grid, or nuking the city, as necessary. Otherwise, Hard Rapture.