Chipmonk comments on A central AI alignment problem: capabilities generalization, and the sharp left turn

[Chipmonk]

Attempting to manually specify the nature of goodness is a doomed endeavor, of course

where does this come from? Is this just an assumption?

What if it were possibly to specify morality (insofar as safety)? I think it is; Davidad agrees: «Boundaries» for formalizing a bare-bones morality