Rather than issues of philosophy or social science intuitions, I think the problems remain in the realm of concrete action… however, there’s too many assumptions left unstated from both sides to unpack them in that debate, and the focus became too narrow.
Channeling XiXiDu, someone really needs to create a formalization of the Friendly AI problem, so that these sorts of debates don’t continue along the same lines, where they talk past each other so often.
Rather than issues of philosophy or social science intuitions, I think the problems remain in the realm of concrete action… however, there’s too many assumptions left unstated from both sides to unpack them in that debate, and the focus became too narrow.
Channeling XiXiDu, someone really needs to create a formalization of the Friendly AI problem, so that these sorts of debates don’t continue along the same lines, where they talk past each other so often.