Sounds safe to me. The AI you describe is not going to FOOM or do anything dangerous.
On the other hand, it is probably not going to cure AIDS, either.
Building an AI that is guaranteed not to FOOM is not that difficult (assuming you know how to build an AI). The trick is to get an AI that does FOOM, but does so in a safe and friendly way.
Why do we want our AI to FOOM? Because if ours doesn’t, someone else’s will.
Why do we want our AI to FOOM? Because if ours doesn’t, someone else’s will.
It would have to get far enough ahead to put others out of business—though that may not necessarily mean terribly fast development, or a terribly high level of development. From there progress could take place at whatever rate was deemed desirable.
Sounds safe to me. The AI you describe is not going to FOOM or do anything dangerous.
On the other hand, it is probably not going to cure AIDS, either.
Building an AI that is guaranteed not to FOOM is not that difficult (assuming you know how to build an AI). The trick is to get an AI that does FOOM, but does so in a safe and friendly way.
Why do we want our AI to FOOM? Because if ours doesn’t, someone else’s will.
It would have to get far enough ahead to put others out of business—though that may not necessarily mean terribly fast development, or a terribly high level of development. From there progress could take place at whatever rate was deemed desirable.