I thought EY said there would be no AI analogy, and yet the mirror clearly is an AI (and it seems more FAI to me than NAI)
Well, I suppose he changed his mind.
With relatively little support, the tiny handful of would-be makers of this device labored under working conditions that were not so much dramatically arduous, as pointlessly annoying.
Are MIRI’s working conditions pointlessly annoying?
Eliezer: Slightly edited the original post to avoid giving away what my readers have finally convinced me is, in fact, an undesirable spoiler. I also hope you didn’t mind my removing the mention of FAI, because I feel fairly strongly about not mixing that into the fic. “A fanatic is someone who can’t change their mind and won’t change the subject”; if we can’t shut up about FAI while talking about Harry Potter, we may have a problem.
Working from memory, I believe that when asked about AI in the story, Eliezer said “they say a crackpot is someone who won’t change his mind and won’t change the subject—I endeavor to at least change the subject.” Obviously this is non-binding, but it still seems odd to me that he would go ahead and do the whole thing that he did with the mirror.
It’s not an FAI, it hasn’t taken over and promptly saved the world yet.
Well, I suppose this could all be a very slow plan on its part, but that would be boring, so it’s probably magically charged to not do that, in some better-than-English conceptual way.
And well, insofar as they’re trying to save the world and no major government cares to throw large quantities of public funds at them.
I thought EY said there would be no AI analogy, and yet the mirror clearly is an AI (and it seems more FAI to me than NAI)
Well, I suppose he changed his mind.
Are MIRI’s working conditions pointlessly annoying?
If anyone has the exact wording of the no-AI promise, I’d like to examine it.
Eliezer: Slightly edited the original post to avoid giving away what my readers have finally convinced me is, in fact, an undesirable spoiler. I also hope you didn’t mind my removing the mention of FAI, because I feel fairly strongly about not mixing that into the fic. “A fanatic is someone who can’t change their mind and won’t change the subject”; if we can’t shut up about FAI while talking about Harry Potter, we may have a problem.
(http://lesswrong.com/lw/2ab/harry_potter_and_the_methods_of_rationality/22cq)
Working from memory, I believe that when asked about AI in the story, Eliezer said “they say a crackpot is someone who won’t change his mind and won’t change the subject—I endeavor to at least change the subject.” Obviously this is non-binding, but it still seems odd to me that he would go ahead and do the whole thing that he did with the mirror.
He said “Harry will not build an FAI”...
Source?
(Not that I don’t believe you; I’ve just never been able to find where EY says this.)
I think I heard it from him personally at a meet up...
It’s not an FAI, it hasn’t taken over and promptly saved the world yet.
Well, I suppose this could all be a very slow plan on its part, but that would be boring, so it’s probably magically charged to not do that, in some better-than-English conceptual way.
And well, insofar as they’re trying to save the world and no major government cares to throw large quantities of public funds at them.
So its not a superhuman FAI. But the Atlanteans were working on superhuman FAI.