Overview article on FAI in a popular science magazine (Hebrew)

A new article which I wrote just appeared in Hebrew in Galileo, Israel’s top popular science magazine, in hardcopy.

It is titled “Superhuman Intelligence, Unhuman Intelligence” (Super- and un- are homophones in Hebrew, a bit of wordplay.)

You can read it here. [Edit: Here’s an English version on the Singularity Institute site.]

The cover art, the “I Robot” images, and the tag line (“Artificial Intelligence: Can we reign in the golem”) are a bit off; I didn’t choose them; but that’s par for the course.

To the best of my knowledge, this is the first feature article overviewing FAI in any popular-science publication (whether online or hardcopy).

Here is the introduction to the article. (It avoids weasel words, but all necessary caveats are given in the body of the article).

In coming decades, engineers will build an entity with intelligence on a level which can compete with humans. This entity will want to improve its own intelligence, and will be able to do so. The process of improvement will repeat, until it reaches a level far above that of humans; the entity will then be able to achieve its goals efficiently. It is thus essential that its goals are good for humanity. To guarantee this, it is necessary to define the correct goals before this intelligence is built.