Perhaps I misunderstand what you mean by “first principles,” or safety therefrom.
It seems like there are significant first principles omitted as fundamental premises.
Such as aspects of natural philosophy, emotional intelligence and other key factors that enabled humans to gain control of the planet, along with how and why we struggle as such already, and why, without needing to become a very successful “new first species” per se, nor misaligned, nor achieve full agency, AGI could still easily wipe everything out.
Merely by being devoid of emotional intelligence, empathy, symbiosis, sustainability etc.,
yet in full control of the systems on which we rely to facilitate those for our societies.
It would seem to me that those factors, along with the basics of good diplomacy, ombudsmanship and human international relations,
would more be the “first principles,” on which the foundations of safety in AGI depend, beyond anything else.
Perhaps I misunderstand what you mean by “first principles,” or safety therefrom.
It seems like there are significant first principles omitted as fundamental premises.
Such as aspects of natural philosophy, emotional intelligence and other key factors that enabled humans to gain control of the planet, along with how and why we struggle as such already, and why, without needing to become a very successful “new first species” per se, nor misaligned, nor achieve full agency, AGI could still easily wipe everything out.
Merely by being devoid of emotional intelligence, empathy, symbiosis, sustainability etc.,
yet in full control of the systems on which we rely to facilitate those for our societies.
It would seem to me that those factors, along with the basics of good diplomacy, ombudsmanship and human international relations,
would more be the “first principles,” on which the foundations of safety in AGI depend, beyond anything else.