I agree that intention comes with its own baggage, but I think that baggage is mostly appropriate. Intention usually refers to explicit goals. And those are the ones we’re mostly worried about. I think it’s unhelpful tomix concerns about goal-directed AI with concerns about implicit biases and accidental side effects. So I’d call this another step in the right direction.
I am going to try adopting this terminology, at least in some cases.
So the idea is to use “Artificial Intention” to specifically speak of the subset of concerns about what outcomes an artificial system will try to steer for, rather than the concerns about the world-states that will result in practice from the interaction of that artificial system’s steering plus the steering of everything else in the world?
Makes sense. I expect it’s valuable to also have a term for the bit where you can end up in a situation that nobody was steering for due to the interaction of multiple systems, but explicitly separating those concerns is probably a good idea.
I agree that intention comes with its own baggage, but I think that baggage is mostly appropriate. Intention usually refers to explicit goals. And those are the ones we’re mostly worried about. I think it’s unhelpful tomix concerns about goal-directed AI with concerns about implicit biases and accidental side effects. So I’d call this another step in the right direction.
I am going to try adopting this terminology, at least in some cases.
So the idea is to use “Artificial Intention” to specifically speak of the subset of concerns about what outcomes an artificial system will try to steer for, rather than the concerns about the world-states that will result in practice from the interaction of that artificial system’s steering plus the steering of everything else in the world?
Makes sense. I expect it’s valuable to also have a term for the bit where you can end up in a situation that nobody was steering for due to the interaction of multiple systems, but explicitly separating those concerns is probably a good idea.