I’m one of the human beings that Eliezer has so much trouble imagining: While I’m not (entirely) selfish myself, I have no trouble acting as if I were completely selfish for the purpose of playing in the vanilla prisoner’s dilemma. Consequently, it’s of no relevance to me that the other agent is an unfriendly superintelligence, rather than a friendly human being. I defect in both cases.
Out of curiosity, do you cooperate or defect against an unfriendly superintelligence in the regular prisoner’s dilemma?
I’m one of the human beings that Eliezer has so much trouble imagining: While I’m not (entirely) selfish myself, I have no trouble acting as if I were completely selfish for the purpose of playing in the vanilla prisoner’s dilemma. Consequently, it’s of no relevance to me that the other agent is an unfriendly superintelligence, rather than a friendly human being. I defect in both cases.
well, thanks for the heads-up =)