I do think a good initial map of the territory might help an agent avoid catastrophic short-term behavior.
I hazard that a good map would be as big as possible, across both time and space. Time—because it’s only over eons that identifying with all life may be selected for in AGI. Space—because a physically bounded system is more likely to see itself in direct competition to physical life than a distributed/substrate independent mind.
Same page then.
I do think a good initial map of the territory might help an agent avoid catastrophic short-term behavior.
I hazard that a good map would be as big as possible, across both time and space. Time—because it’s only over eons that identifying with all life may be selected for in AGI. Space—because a physically bounded system is more likely to see itself in direct competition to physical life than a distributed/substrate independent mind.