Tim probably read my analysis using the self-optimizing compiler as an example, then forgot that I had analyzed it and thought that he was inventing a crushing objection on his own.
It does not seem very likely that I am copying you—when my essay on this subject dates from February 3rd, while yours apparently dates from November 25th.
So what exactly is the counter-argument you were attempting to make?
That self-optimising compilers lack “insight”—and “insight” is some kind of boolean substance that you either have or you lack?
In my view, machines gradually accumulate understanding of themselves—and how to modify themselves. There is a long history of automated refactoring—which seems to me to clearly demonstrate that “insight” within machines into how to modify computer code comes in a vast number of little pieces, which are gradually being assembled over the decades into ever more impressive refactoring tools. I have worked on refactoring tools myself—and I see no hint of sudden gains in capability in this area—rather progress is made in thousands, or even millions of tiny steps.
But the machines themselves are not writing the code for any of these millions of tiny steps. If they were, and if they were able to do so faster than humans, their self-improvement would be different than what you’re describing.
It does not seem very likely that I am copying you—when my essay on this subject dates from February 3rd, while yours apparently dates from November 25th.
So what exactly is the counter-argument you were attempting to make?
That self-optimising compilers lack “insight”—and “insight” is some kind of boolean substance that you either have or you lack?
In my view, machines gradually accumulate understanding of themselves—and how to modify themselves. There is a long history of automated refactoring—which seems to me to clearly demonstrate that “insight” within machines into how to modify computer code comes in a vast number of little pieces, which are gradually being assembled over the decades into ever more impressive refactoring tools. I have worked on refactoring tools myself—and I see no hint of sudden gains in capability in this area—rather progress is made in thousands, or even millions of tiny steps.
But the machines themselves are not writing the code for any of these millions of tiny steps. If they were, and if they were able to do so faster than humans, their self-improvement would be different than what you’re describing.