I’m not sure that most people who seek to create aligned AI’s want an AI that starts doing the Last Judgment and punishes people for their misdeads for causal trade reasons.
It’s been a while since I read Roko’s post, but I don’t think that it makes any argument for the resulting AI being non-Aligned. Being aligned doesn’t prevent the AI from assuming that it’s existence is very high utility and doing acausal trade to further the chances of existing.
I’m not sure that most people who seek to create aligned AI’s want an AI that starts doing the Last Judgment and punishes people for their misdeads for causal trade reasons.
It’s been a while since I read Roko’s post, but I don’t think that it makes any argument for the resulting AI being non-Aligned. Being aligned doesn’t prevent the AI from assuming that it’s existence is very high utility and doing acausal trade to further the chances of existing.