Eliezer, since you’ve mentioned this several times now, I must object: you unfairly slander a generation of AI researchers (which included me). It was and remains perfectly reasonable for programmers to give programs and data structures suggestive names, and this habit was not at all akin to thinking a machine lever could do everything the machine does. As a whole that generation certainly did not think that merely naming a data structure “fruit” gave the program all the knowledge about fruit we have.
Eliezer, since you’ve mentioned this several times now, I must object: you unfairly slander a generation of AI researchers (which included me). It was and remains perfectly reasonable for programmers to give programs and data structures suggestive names, and this habit was not at all akin to thinking a machine lever could do everything the machine does. As a whole that generation certainly did not think that merely naming a data structure “fruit” gave the program all the knowledge about fruit we have.