If we get a working Oracle AI, couldn’t we just ask it how to build an FAI. I just don’t think this is of much use since the Oracle route doesn’t really seem much easier than the FAI route.
I just don’t think this is of much use since the Oracle route doesn’t really seem much easier than the FAI route.
Experts and general forecasters are easier to build than general intelligent agents—or so I argue in my section on Machine Forecasting Implications. That is before we even get to constraints on how we want them to behave.
If we get a working Oracle AI, couldn’t we just ask it how to build an FAI.
At a given tech level, if you trying to use an use an general oracle on its own to create a general intelligence would probably produce a less intelligent agent than could be produced by other means, using a broader set of tools. An oracle might well be able to help, though.
If we get a working Oracle AI, couldn’t we just ask it how to build an FAI. I just don’t think this is of much use since the Oracle route doesn’t really seem much easier than the FAI route.
No, it won’t know what you mean. Even you don’t know what you mean, which is part of the problem.
Experts and general forecasters are easier to build than general intelligent agents—or so I argue in my section on Machine Forecasting Implications. That is before we even get to constraints on how we want them to behave.
At a given tech level, if you trying to use an use an general oracle on its own to create a general intelligence would probably produce a less intelligent agent than could be produced by other means, using a broader set of tools. An oracle might well be able to help, though.