Hmm, if I understand it correctly, this sounds like a case for a virtue-ethics-based AGI, augmented by some basic deontology to account for bounded rationality. In this example it will be “the mother instills the virtues of “working hard and behaving well”. Maybe with some basic deontology of no cheating etc. Not sure how consequentialism fits in there. Maybe in the form of “drives”, e.g. improve happiness, reduce suffering, reduce odds of extinction, encourage diversity… This does not sound very revolutionary though, and probably can result in a “sharp left turn”.
One way to fit in consequentialism would be to have the decision-making process itself be part of the space of consequences. In a way, virtue ethics is consequentialism for non-cartesian agents :P
Hmm, if I understand it correctly, this sounds like a case for a virtue-ethics-based AGI, augmented by some basic deontology to account for bounded rationality. In this example it will be “the mother instills the virtues of “working hard and behaving well”. Maybe with some basic deontology of no cheating etc. Not sure how consequentialism fits in there. Maybe in the form of “drives”, e.g. improve happiness, reduce suffering, reduce odds of extinction, encourage diversity… This does not sound very revolutionary though, and probably can result in a “sharp left turn”.
One way to fit in consequentialism would be to have the decision-making process itself be part of the space of consequences. In a way, virtue ethics is consequentialism for non-cartesian agents :P
That’s not a bad framing, wonder if it can be formalized.