I think that most people imagine themselves as gatekeepers for controlling the world, when in reality the world is controlled by systems we don’t fully understand. For example, I don’t think people really know what “money” means in the real world. You can imagine yourself as a person who knows it, but can you verify that your understanding matches reality?
If we want to have a chance to control the future to some degree, then it means that humans need to take over the world. It is not sufficient to stop AGI from taking over the world, but we also need to ensure that the future of the world is aligned with human values. For now, it seems that stuff like “money” is running the show.
I think that most people imagine themselves as gatekeepers for controlling the world, when in reality the world is controlled by systems we don’t fully understand. For example, I don’t think people really know what “money” means in the real world. You can imagine yourself as a person who knows it, but can you verify that your understanding matches reality?
If we want to have a chance to control the future to some degree, then it means that humans need to take over the world. It is not sufficient to stop AGI from taking over the world, but we also need to ensure that the future of the world is aligned with human values. For now, it seems that stuff like “money” is running the show.