Now that I’ve read your post on optimization, I’d restate
More generally, it seems like “help X” or “assist X” only means something when you view X as pursuing some goal.
as
More generally, it seems like “help X” or “assist X” only means something when you view X as an optimizing system.
Which I guess was your point in the first place, that we should view things as optimizing systems and not agents. (Whereas when I hear “agent” I usually think of something like what you call an “optimizing system”.)
I think my main point is that “CHAI’s agenda depends strongly on an agent assumption” seems only true of the specific mathematical formalization that currently exists; I would not be surprised if the work could then be generalized to optimizing systems instead of agents / EU maximizers in particular.
I think my main point is that “CHAI’s agenda depends strongly on an agent assumption” seems only true of the specific mathematical formalization that currently exists; I would not be surprised if the work could then be generalized to optimizing systems instead of agents / EU maximizers in particular.
Ah, very interesting, yeah I agree this seems plausible, and also this is very encouraging to me!
Now that I’ve read your post on optimization, I’d restate
as
Which I guess was your point in the first place, that we should view things as optimizing systems and not agents. (Whereas when I hear “agent” I usually think of something like what you call an “optimizing system”.)
I think my main point is that “CHAI’s agenda depends strongly on an agent assumption” seems only true of the specific mathematical formalization that currently exists; I would not be surprised if the work could then be generalized to optimizing systems instead of agents / EU maximizers in particular.
Ah, very interesting, yeah I agree this seems plausible, and also this is very encouraging to me!