I maybe want to stop saying “explicitly thinking about it” (which brings up associations of conscious vs subconscious thought, and makes it sound like I only mean that “conscious thoughts” have deception in them) and instead say that “the AI system at some point computes some form of ‘reason’ that the deceptive action would be better than the non-deceptive action, and this then leads further computation to take the deceptive action instead of the non-deceptive action”.
I don’t quite agree with that as literally stated; a huge part of intelligence is finding heuristics which allow a system to avoid computing anything about worse actions in the first place (i.e. just ruling worse actions out of the search space). So it may not actually compute anything about a non-deceptive action.
But unless that distinction is central to what you’re trying to point to here, I think I basically agree with what you’re gesturing at.
But unless that distinction is central to what you’re trying to point to here
Yeah, I don’t think it’s central (and I agree that heuristics that rule out parts of the search space are very useful and we should expect them to arise).
I don’t quite agree with that as literally stated; a huge part of intelligence is finding heuristics which allow a system to avoid computing anything about worse actions in the first place (i.e. just ruling worse actions out of the search space). So it may not actually compute anything about a non-deceptive action.
But unless that distinction is central to what you’re trying to point to here, I think I basically agree with what you’re gesturing at.
Yeah, I don’t think it’s central (and I agree that heuristics that rule out parts of the search space are very useful and we should expect them to arise).