One thing to consider is that until you’ve got an end-to-end automation of basic human needs like farming, the existence of other humans remains a net benefit for you, both to maintain these needs and to incentivize others to share what they’ve done.
Automating this end-to-end is a major undertaking, and it’s unclear whether LLMs are up to the task. If they aren’t, it’s possible we will return to a form of AI where classical alignment problems apply.
One thing to consider is that until you’ve got an end-to-end automation of basic human needs like farming, the existence of other humans remains a net benefit for you, both to maintain these needs and to incentivize others to share what they’ve done.
Automating this end-to-end is a major undertaking, and it’s unclear whether LLMs are up to the task. If they aren’t, it’s possible we will return to a form of AI where classical alignment problems apply.