Eliezer credits Nick Bostrom with coming up with the idea of Friendly AI first (and indeed while Eliezer was indifferent to AI risk on the assumption that either superintelligences would be automatically supermoral or it didn’t matter what happened). FOOM probably goes to I.J. Good, or SF (Eliezer found out about the idea of a technological singularity by reading Vernor Vinge’s science fiction, and closely related ideas are decades older in SF).
Maybe it is just me. But as I understood I.J. Good’s intelligence explosion is much more “Kurzweilian”. Happens as a consequence of some large improvement all over the place. While for the Yudkowsky’s FOOM, a right binary string in the RAM of the PC from 2000 would suffice to blow us away.
I think, that the computer may need to be from today, or even from tomorrow, but this does not change much.
You would need improvements in both software and hardware to compete with natural nanotechnology at its best.
Improvements in software would catalyse improvements in hardware—and visa versa. I think most of the parties involved are on the same page about all this.
What is originally his? AFAIK the FOOM and the Friendliness are his.
I am just curious.
Eliezer credits Nick Bostrom with coming up with the idea of Friendly AI first (and indeed while Eliezer was indifferent to AI risk on the assumption that either superintelligences would be automatically supermoral or it didn’t matter what happened). FOOM probably goes to I.J. Good, or SF (Eliezer found out about the idea of a technological singularity by reading Vernor Vinge’s science fiction, and closely related ideas are decades older in SF).
FOOM (AKA Intelligence Explosion) was formulated by I.J. Good about 50 years ago.
...and pre-formulated by John W. Campbell, a famous science-fiction editor.
Maybe it is just me. But as I understood I.J. Good’s intelligence explosion is much more “Kurzweilian”. Happens as a consequence of some large improvement all over the place. While for the Yudkowsky’s FOOM, a right binary string in the RAM of the PC from 2000 would suffice to blow us away.
I think, that the computer may need to be from today, or even from tomorrow, but this does not change much.
You would need improvements in both software and hardware to compete with natural nanotechnology at its best.
Improvements in software would catalyse improvements in hardware—and visa versa. I think most of the parties involved are on the same page about all this.