I don’t even see how one would start to research the problem of getting a hypothetical AGI to recognize humans as distinguished beings. [...] Even if one does have a model for a hypothetical AGI, writing code conducive to it recognizing humans as distinguished beings seems like an intractable task.
IANAAIR, but I doubt anyone at the SIAI would try to program a way of identifying humans directly into an AI. Instead, it would learn what a human is from observations, using its general learning algorithms. Obviously there are many possible ambiguous cases, but we should try to prevent the AI from needing to make these decisions until it has figured out what goals we want it to have.
IANAAIR, but I doubt anyone at the SIAI would try to program a way of identifying humans directly into an AI. Instead, it would learn what a human is from observations, using its general learning algorithms. Obviously there are many possible ambiguous cases, but we should try to prevent the AI from needing to make these decisions until it has figured out what goals we want it to have.