I don’t think it prevents the wireheading scenario that many people consider undesirable. For instance, if an AI modifies everybody into drooling idiots who are made deliriously happy by pressing “Accept Outcome” as often and forcefully as possible, it wins.
I don’t think it prevents the wireheading scenario that many people consider undesirable. For instance, if an AI modifies everybody into drooling idiots who are made deliriously happy by pressing “Accept Outcome” as often and forcefully as possible, it wins.