Well, simulator type systems like GPT-3 do not become agents if amplified to superhuman cognition.
Simulators could be used to generate/evaluate superhuman plans without being agents with independent objectives of their own.
In the intervening period, I’ve updated towards your position, though I still think it is risky to build systems with capabilities that open ended which are that close to agents in design space
Well, simulator type systems like GPT-3 do not become agents if amplified to superhuman cognition.
Simulators could be used to generate/evaluate superhuman plans without being agents with independent objectives of their own.
In the intervening period, I’ve updated towards your position, though I still think it is risky to build systems with capabilities that open ended which are that close to agents in design space