I mean someone else might score you very low on qualityOfCharacter because your family has totally failed to provide a sacrificial infant for the yearly solstice ceremony. (Failure to support important social traditions)
Another might rate your qualityOfCharacter as very low because you reported a neighbor to the police for selling weed on the street corner. (betrayal of member of ingroup to a member of the outgroup)
Another might rate your impactOnSociety as terrible because you eat meat and thus help increase the suffering of creatures around you.
Though if you can come up with a definition of impactOnSociety() that almost everyone from a wide range of backgrounds can agree on then you’re probably half way to a utility function for a friendly AI.
Define qualityOfCharacter and impactOnSociety.
I mean someone else might score you very low on qualityOfCharacter because your family has totally failed to provide a sacrificial infant for the yearly solstice ceremony. (Failure to support important social traditions)
Another might rate your qualityOfCharacter as very low because you reported a neighbor to the police for selling weed on the street corner. (betrayal of member of ingroup to a member of the outgroup)
Another might rate your impactOnSociety as terrible because you eat meat and thus help increase the suffering of creatures around you.
Though if you can come up with a definition of impactOnSociety() that almost everyone from a wide range of backgrounds can agree on then you’re probably half way to a utility function for a friendly AI.