I don’t think the idea of Superwisdom / Moral RSI requires Moral Realism. Personally, I am a big fan of research being put into a Superwisdom Agenda, but I don’t believe in Moral Realism. In fact, I’d be against a project which had (in my view, harmful and incorrect) assumptions about Moral Realism as a core part of its aims.
So I think you should ask yourself whether this is necessarily part of the Superwisdom Agenda, or if you could envision the agenda being at least agnostic about Moral Realism.
Thanks! Yes, there’s lots of convergence between methods, something Joe Carlsmith also wrote about. What do you see as the strongest arguments against Moral Realism?
I don’t think the idea of Superwisdom / Moral RSI requires Moral Realism. Personally, I am a big fan of research being put into a Superwisdom Agenda, but I don’t believe in Moral Realism. In fact, I’d be against a project which had (in my view, harmful and incorrect) assumptions about Moral Realism as a core part of its aims.
So I think you should ask yourself whether this is necessarily part of the Superwisdom Agenda, or if you could envision the agenda being at least agnostic about Moral Realism.
Note that Yudkowsky wasn’t agnostic about it either, see his theory of moral realism here.
Thanks! Yes, there’s lots of convergence between methods, something Joe Carlsmith also wrote about. What do you see as the strongest arguments against Moral Realism?