Ah, fair, I might be mixing the two things. But let’s put it this way—if “melt all GPUs” is the pivotal act example Eliezer keeps going back to, and he has a secret one that he knows but doesn’t say out loud, is it because it’s some kind of infohazard that risks failing if spelled out, or is it because it’s so bad he knows it’s better if he doesn’t say it?
Ah, fair, I might be mixing the two things. But let’s put it this way—if “melt all GPUs” is the pivotal act example Eliezer keeps going back to, and he has a secret one that he knows but doesn’t say out loud, is it because it’s some kind of infohazard that risks failing if spelled out, or is it because it’s so bad he knows it’s better if he doesn’t say it?