You may consider the scenario 3, where the trusted algorithm checks that your PREFIX is present in your opponent, and only tells you that fact, without giving you its source code or a simulator black box. But anyway, this little example is not a Totally General Solution to All Similar Problems, and so generalization is not useless. It might in a given formal problem, that is already solved by other means, but not in other cases.
For example, recall my previous remarks about how PD turns into an Ultimatum game once you allow mixed strategies (that is, any form of randomness in the programs). In which case, pure ‘Cooperate’ becomes suboptimal.
And if you do that properly, taking into account other issues like reflective consistency, you won’t need the other part of your algorithm at all, since picking fair Pareto-optimal strategies will also allow to correctly deal with defectors.
I’m still perplexed by the fairness part (and Ultimatum game in particular) though. One solution from symmetry seems obvious (not ‘cut on equal parts’, since what ‘equal part’ means also depends on the preference orders of each agent), but I don’t know in what sense it’s universally right, and if it isn’t, what should be done.
You may consider the scenario 3, where the trusted algorithm checks that your PREFIX is present in your opponent, and only tells you that fact, without giving you its source code or a simulator black box. But anyway, this little example is not a Totally General Solution to All Similar Problems, and so generalization is not useless. It might in a given formal problem, that is already solved by other means, but not in other cases.
For example, recall my previous remarks about how PD turns into an Ultimatum game once you allow mixed strategies (that is, any form of randomness in the programs). In which case, pure ‘Cooperate’ becomes suboptimal.
Then just change PREFIX to play the Pareto-optimal symmetric mixed strategy instead of cooperating.
And if you do that properly, taking into account other issues like reflective consistency, you won’t need the other part of your algorithm at all, since picking fair Pareto-optimal strategies will also allow to correctly deal with defectors.
I’m still perplexed by the fairness part (and Ultimatum game in particular) though. One solution from symmetry seems obvious (not ‘cut on equal parts’, since what ‘equal part’ means also depends on the preference orders of each agent), but I don’t know in what sense it’s universally right, and if it isn’t, what should be done.