It’s an issue, but not an insurmountable one; strategies for sidestepping incompleteness problems exist, even in the context where you treat your AGI as pure math and insist on full provability. Most of the work on incompleteness problems focuses on Löb’s theorem, sometimes jokingly calling it the Löbstacle. I’m not sure what the state of this subfield is, exactly, but I’ve seen enough progress to be pretty sure that it’s tractable.
It’s an issue, but not an insurmountable one; strategies for sidestepping incompleteness problems exist, even in the context where you treat your AGI as pure math and insist on full provability. Most of the work on incompleteness problems focuses on Löb’s theorem, sometimes jokingly calling it the Löbstacle. I’m not sure what the state of this subfield is, exactly, but I’ve seen enough progress to be pretty sure that it’s tractable.