Re: (2), that depends heavily on how the “shutdown utility function” handles those numbers. An “invest” action which costs 1 utility for subagent 1, and yields 10 utility for subagent 1 in each subsequent step, may have totally unrelated utilities for subagent 2. The subagents have different utility functions, and we don’t have many constraints on the relationship between them.
Re: (2), that depends heavily on how the “shutdown utility function” handles those numbers. An “invest” action which costs 1 utility for subagent 1, and yields 10 utility for subagent 1 in each subsequent step, may have totally unrelated utilities for subagent 2. The subagents have different utility functions, and we don’t have many constraints on the relationship between them.
Re: (1), yup, agreed.