If we assume that our morality arises from the complex interplay of a thousand shards of genetic desire, each with its own abstract ‘value’ in our minds, then I wholly agree that we can’t reduce things down to a single function.
But clear this up for a non-expert: does stating that ethics cannot come from a single utility function imply that no amount of utility functions (i.e. no computer program) will do the job on their own? Surely an enormously complex morality-machine (NOT a Friendly AI!) would be of no application to human morality unless it had a few hard-coded values such those we place on life, fairness, freedom and so on? If only because this is the way our morality works.
If parental love is ultimately a genetic function, surely it’s impossible to separate it from the biological substrate without simply reverse-engineering the brain? More bluntly, how can we write a value-free program that makes parental love look sensible?
If we assume that our morality arises from the complex interplay of a thousand shards of genetic desire, each with its own abstract ‘value’ in our minds, then I wholly agree that we can’t reduce things down to a single function.
But clear this up for a non-expert: does stating that ethics cannot come from a single utility function imply that no amount of utility functions (i.e. no computer program) will do the job on their own? Surely an enormously complex morality-machine (NOT a Friendly AI!) would be of no application to human morality unless it had a few hard-coded values such those we place on life, fairness, freedom and so on? If only because this is the way our morality works.
If parental love is ultimately a genetic function, surely it’s impossible to separate it from the biological substrate without simply reverse-engineering the brain? More bluntly, how can we write a value-free program that makes parental love look sensible?