So perhaps the supposed difference is that this AI won’t actually take direct actions, merely make verbal suggestions. Well it’s awful optimistic to suppose no one will get lazy or exigencies won’t drive them to connect a simple script up to the machine which takes say sentences of the form “I recommend you deploy your troops in this manner.” and directly sends the orders. Even if so the machine still takes direct action in the form of making statements that influence human behavior.
An Oracle determines which action would produce higher utility, then outputs it. An “Agent AGI” determines which output will produce higher utility, then outputs it. It’s a question of optimizing the output or merely outputting optimization.
And yes, you can easily turn an Oracle into an Agent.
An Oracle determines which action would produce higher utility, then outputs it. An “Agent AGI” determines which output will produce higher utility, then outputs it. It’s a question of optimizing the output or merely outputting optimization.
And yes, you can easily turn an Oracle into an Agent.