Hard-coding onto chips, or even making specific structures electromechanical in nature, is one way of how humans would achieve “explicitly forbidden to self-modify” in AIs. I estimated that one in every four AGI projects will desire to forbid their project from self-modification. I thought this was optimistic; I haven’t seen any discussion of fixed AGI. Although maybe that might be something military research and development is interested in.
Hard-coding onto chips, or even making specific structures electromechanical in nature, is one way of how humans would achieve “explicitly forbidden to self-modify” in AIs. I estimated that one in every four AGI projects will desire to forbid their project from self-modification. I thought this was optimistic; I haven’t seen any discussion of fixed AGI. Although maybe that might be something military research and development is interested in.
My point was that even in some cases where people aren’t thinking about self-modification, self-modification won’t happen by default.