Evolutionary metaphors is about huge differences between evolutionary pressure in ancestral environment and what we have now: ice cream, transgenders, lesswrong, LLMs, condoms and other contraceptives. What kind of “ice cream” AGI and ASI will make for itself? May be it can be made out of humans, put them in vats and let them dream inputs for GPT10?
Mimicry is product of evolution too. Also—social mimicry.
I have thoughts about reasons for AI to evolve human-like morality too. But i also have thoughts like “this coin turned up heads 3 times in a row, so it must turn tails next”.
Evolutionary metaphors is about huge differences between evolutionary pressure in ancestral environment and what we have now: ice cream, transgenders, lesswrong, LLMs, condoms and other contraceptives. What kind of “ice cream” AGI and ASI will make for itself? May be it can be made out of humans, put them in vats and let them dream inputs for GPT10?
Mimicry is product of evolution too. Also—social mimicry.
I have thoughts about reasons for AI to evolve human-like morality too. But i also have thoughts like “this coin turned up heads 3 times in a row, so it must turn tails next”.