Thank you for narrowing my confusion over what AI_0 does.
My top question now is: how long does AI_0 need to run, and why is it safe from other AIs during that period?
AI_0 appears to need a nontrivial fraction of our future lightcone to produce a decent approximation of the intended output. Yet keeping it boxed seems to leave the world vulnerable to other AIs.
Thank you for narrowing my confusion over what AI_0 does.
My top question now is: how long does AI_0 need to run, and why is it safe from other AIs during that period?
AI_0 appears to need a nontrivial fraction of our future lightcone to produce a decent approximation of the intended output. Yet keeping it boxed seems to leave the world vulnerable to other AIs.