Are there ‘categorical’ oughts that do not depend on an “If you want X” clause? Naturalists tend to deny this possibility, but perhaps categorical epistemic or moral oughts can be derived from the mathematics of game theory and decision theory, as naturalist Gary Drescher suggests in Good and Real. If so, it may be wise to make sure they are included in friendliness content theory, so that an AI can respect them.
The phrasing “it may be wise to make sure they are included in friendliness content theory” makes it sound wrong to my ear, as if you are brewing some kind of informal eclectic theoretical soup.
It struck me as sort of a sly understatement, which went over well compared to the more familiar “I am politely and quietly screaming that this is important” tone.
The phrasing “it may be wise to make sure they are included in friendliness content theory” makes it sound wrong to my ear, as if you are brewing some kind of informal eclectic theoretical soup.
It struck me as sort of a sly understatement, which went over well compared to the more familiar “I am politely and quietly screaming that this is important” tone.
I’m not confident that is the case, or at least that this meaning is reliably communicated.
I concur.