I entirely disagree that “rationalists are more than ready.” They have exactly the same problems that a fanatical AI would have, and should be kept sandboxed for similar reasons.
(That said, AIs are unlikely to actually be fanatical.)
Meh, kinda agree, added “(at least some of them!)” to the post.
I didn’t mean “ready” in the sense of value alignment, but rather that by accessing more power they would grow instead of destroying themselves.
I entirely disagree that “rationalists are more than ready.” They have exactly the same problems that a fanatical AI would have, and should be kept sandboxed for similar reasons.
(That said, AIs are unlikely to actually be fanatical.)
Meh, kinda agree, added “(at least some of them!)” to the post.
I didn’t mean “ready” in the sense of value alignment, but rather that by accessing more power they would grow instead of destroying themselves.