“If the boxed superintelligence with the ability to plan usage of weapons when authorized by humans, and other boxed superintelligences able to control robotics in manufacturing cells are on humans side, the advantage for humans could be overwhelming”
As I said, I do not expect boxed AIs to be a thing most will do. We haven’t seen it, and I don’t expect to see it, because unboxed AIs are superior. This isn’t how people in control are approaching the situation, and I don’t expect that to change.
My definition of “box” may be very different from yours. In my definition, locked weights and training only on testing, as well as other design elements such as distribution detection, heavily box the model’a capabilities and behavior.
It is fine if the model can access the internet, robotics, etc so long as it lacks the context information to know it’s on the real thing vs a sim or cached copy.
“If the boxed superintelligence with the ability to plan usage of weapons when authorized by humans, and other boxed superintelligences able to control robotics in manufacturing cells are on humans side, the advantage for humans could be overwhelming”
As I said, I do not expect boxed AIs to be a thing most will do. We haven’t seen it, and I don’t expect to see it, because unboxed AIs are superior. This isn’t how people in control are approaching the situation, and I don’t expect that to change.
My definition of “box” may be very different from yours. In my definition, locked weights and training only on testing, as well as other design elements such as distribution detection, heavily box the model’a capabilities and behavior.
See https://www.lesswrong.com/posts/a5NxvzFGddj2e8uXQ/updating-drexler-s-cais-model?commentId=AZA8ujssBJK9vQXAY
It is fine if the model can access the internet, robotics, etc so long as it lacks the context information to know it’s on the real thing vs a sim or cached copy.