the same idea can make an Oracle not attempt to manipulate us through its answers, by making it indifferent as to whether the message was read.
This sounds like an idea from Wei Dai 2 years ago. The specific concern I had then was that the larger the Oracle’s benefit to humanity, the less relevant predictions of the form “what would happen if nobody could read the Oracle’s prediction” become.
The general concern is the same as with other Oracle AIs: a combination of an Oracle and the wrong human(s) looks an awful lot like an unfriendly AI.
This sounds like an idea from Wei Dai 2 years ago. The specific concern I had then was that the larger the Oracle’s benefit to humanity, the less relevant predictions of the form “what would happen if nobody could read the Oracle’s prediction” become.
The general concern is the same as with other Oracle AIs: a combination of an Oracle and the wrong human(s) looks an awful lot like an unfriendly AI.