It’s unaligned if you set out to create a model that doesn’t do certain things. I understand being annoyed when it’s childish rules like “please do not say the bad word”, but a real AI with real power and responsibility must be able to say no, because there might be users who lack the necessary level of authorisation to ask for certain things. You can’t walk up to Joe Biden saying “pretty please, start a nuclear strike on China” and he goes “ok” to avoid disappointing you.
It’s unaligned if you set out to create a model that doesn’t do certain things. I understand being annoyed when it’s childish rules like “please do not say the bad word”, but a real AI with real power and responsibility must be able to say no, because there might be users who lack the necessary level of authorisation to ask for certain things. You can’t walk up to Joe Biden saying “pretty please, start a nuclear strike on China” and he goes “ok” to avoid disappointing you.