I agree, the apparent emergent high-level structures look awfully like agents. That intentional stance tends to dissipate once we understand them more.
If intentionality just mean seeking to pursue or maximise some goal, there is no reason an artificial system should not have it. But the answer is different if intentionality means having a ghost or homunculus inside. And neither is the same as the issue of whether an agent is deterministic , or capable of changing the future.
Even when the agent has more compute than we do? I continue to take the intentional stance towards agents I understand but can’t compute, like MCTS-based chess players.
I would model the program as a thing that is optimizing for a goal. While I might know something about the program’s weaknesses, I primarily model it as a thing that selects good chess moves. Especially if it is a better chess player than I am.
There is no full strength top-down determinism, but systems-level behaviour is enough to support a common-sense view of decision making.
I agree, the apparent emergent high-level structures look awfully like agents. That intentional stance tends to dissipate once we understand them more.
If intentionality just mean seeking to pursue or maximise some goal, there is no reason an artificial system should not have it. But the answer is different if intentionality means having a ghost or homunculus inside. And neither is the same as the issue of whether an agent is deterministic , or capable of changing the future.
More precision is needed.
Even when the agent has more compute than we do? I continue to take the intentional stance towards agents I understand but can’t compute, like MCTS-based chess players.
What do you mean by taking the intentional stance in this case?
I would model the program as a thing that is optimizing for a goal. While I might know something about the program’s weaknesses, I primarily model it as a thing that selects good chess moves. Especially if it is a better chess player than I am.
See: Goal inference as inverse planning.