This reminds me of I believe it was Robin’s post which cautioned us about interesting writing styles and anecdotes since it seems to subtract from how accurately people recall the main points of a piece of writing. From reading your blog, and others, I have been inspired to take the interesting and informal writing approach when talking about high-level concepts.
I think that perhaps in any one piece it may be a negative factor, especially if the anecdotes and cliches aren’t completely pertinent to the topic. Nevertheless, I think on a larger scale that it makes sense to keep things as accessible and entertaining as possible, since that will draw more people in. Freakonomics, for all its numerous flaws, probably drew more interest in the field of economics than the illustrious General Theory of Employment, Interest, and Money.
I really liked the end where you say, “And so I take a certain dark delight in quoting anime fanfiction at people who expect me to behave like a wise sage of rationality. Why should I pretend to be mature when practically every star in the night sky is older than I am?”
Yet, you still think you should build an Artificial General Intelligence. That seems very much like childish hubris, and yet you seem to simultaneously show humility. Or is it just that you have a really low opinion of everyone else’s intelligence and rationality? I wouldn’t blame you. Neither would they, since statistics show the majority of people believe that they are above average intelligence.
I think all humans are walking balls of contradictions, so it isn’t really surprising that you display both hubris and humility. I can also honestly say I know much much less about AI, physics, neuropsychology, and bayesian probability theory than you, so I can’t say one way or another whether AGI is possible or desirable, nor could I if I spent years researching it. I tend to avoid thinking about it generally for that reason.
Just something to think about.… but you probably already have. Smarty pants.
Tiiba,
There is a difference between science and technology. Science is just empirical knowledge and the process of acquiring it. Technology is applied science. It shows hubris to actually think you can build something smarter than yourself in a way that has a reasonable chance of avoiding terrible unforeseen consequences.
That doesn’t mean he is wrong when he argues AGI is just on the horizon and it is better that someone who cares about friendliness implements it first. I don’t know enough to say one way or another.
Hubris is probably one of the traits that has propelled humanity to it’s current stage of civilization. It is debatable whether that was a good thing. Certainly not from a negative utilitarian perspective, but definitely from an aggregate utilitarian calculus.
Now that we are at this stage of human civilization, all we can do is continue onward. Humans taking their destiny into their own hands has the potential to solve the problems of previous attempts to do just that.
It isn’t really debatable that the stories of Faust and the Tower of Babel, etc have a point, it is just a matter of figuring out to what degree. The whole idea of FAI inherently gives this idea some credence, but it says that since someone is creating the tech it might as well be us since we care about Friendliness. Oh yea, and by the way you get Singularities and stuff if we don’t all die.