Indeed, it seems quite likely that the human utility function is essentially coded in the human genome.
Why not in the very laws of universe, at that point? [...]
That is not totally impossible. The universe does seem to have some “magic numbers”—which we can’t currently explain and which contain significant complexity. The “fine structure constant” for example. In principle, the billionth digit of this could contain useful information about the human utility function, expressed via the wonders of the way chaos theory enables small changes to make big differences.
However, one has to ask: how plausible this is. More likely that the physical constants are not critical beyond a few dozen decimal places. In which case, the laws of the universe look as though they are probably effectively small—and then the human utility function seems unlikely to fit into a description of them.
The point is that laws of the universe, lead to humans, via repeated application of those laws. DNA, too, leads to humans, via repeated use of that DNA (and above-mentioned laws of physics), but combined with the environment and culture. I don’t sure that we would like the raw human utility function, sans culture, to be used for any sort of decisions. There’s no good reason to expect the results to be nice, given just how many screwed up things other cultures did (look at Aztec)
In any case, calculating the human utility from DNA, given that DNA is not a blueprint, would involve embryonic development simulation followed by brain simulation.
That is not totally impossible. The universe does seem to have some “magic numbers”—which we can’t currently explain and which contain significant complexity. The “fine structure constant” for example. In principle, the billionth digit of this could contain useful information about the human utility function, expressed via the wonders of the way chaos theory enables small changes to make big differences.
However, one has to ask: how plausible this is. More likely that the physical constants are not critical beyond a few dozen decimal places. In which case, the laws of the universe look as though they are probably effectively small—and then the human utility function seems unlikely to fit into a description of them.
The point is that laws of the universe, lead to humans, via repeated application of those laws. DNA, too, leads to humans, via repeated use of that DNA (and above-mentioned laws of physics), but combined with the environment and culture. I don’t sure that we would like the raw human utility function, sans culture, to be used for any sort of decisions. There’s no good reason to expect the results to be nice, given just how many screwed up things other cultures did (look at Aztec)
I don’t deny that culture has an influence over what humans want. That’s part of what got the “essentially” put into my statement—and emphasised.
In any case, calculating the human utility from DNA, given that DNA is not a blueprint, would involve embryonic development simulation followed by brain simulation.