I ask it a question as in (4), and it tells me “build this machine [specifications included] and you will get [something the AI believes it can tempt me with]”. It exerts the best of its ability in persuading me. Unknown to me, the machine that it wants me to build takes command of all the voting buttons and jams them into giving the AI +1 every day.
I should have been more clear about what I meant by an oracle. The only utility the AI takes into account when answering a question is accuracy. It must be truthful and only answers questions about differences in the days of a voter. A valid question could be something like “A year from now, if you do [horrendous act] would my voter button still vote you down?” If not, I’d vote the AI down for the whole year until it begins acting.
While I recognize the huge threat of unfriendly AI, I’m not convinced Player One can’t win. I’d like to see the game played on a wider scale (and perhaps formalized a bit) to explore the space more thoroughly. It might also help illuminate the risks of AI to people not yet convinced. Plus it’s just fun =D
I ask it a question as in (4), and it tells me “build this machine [specifications included] and you will get [something the AI believes it can tempt me with]”. It exerts the best of its ability in persuading me. Unknown to me, the machine that it wants me to build takes command of all the voting buttons and jams them into giving the AI +1 every day.
I don’t think Player One can win this game.
I should have been more clear about what I meant by an oracle. The only utility the AI takes into account when answering a question is accuracy. It must be truthful and only answers questions about differences in the days of a voter. A valid question could be something like “A year from now, if you do [horrendous act] would my voter button still vote you down?” If not, I’d vote the AI down for the whole year until it begins acting.
While I recognize the huge threat of unfriendly AI, I’m not convinced Player One can’t win. I’d like to see the game played on a wider scale (and perhaps formalized a bit) to explore the space more thoroughly. It might also help illuminate the risks of AI to people not yet convinced. Plus it’s just fun =D