Tool-AIs do not contain such a component—they might have a relevance or accuracy function for evaluating answers, but it’s not a utility function over the world.
Wouldn’t that depend on the Tool-AI?
I think this is explicitly part of the “Tool-AI” definition, that it is not a Utility Maximizer.
I think this is explicitly part of the “Tool-AI” definition, that it is not a Utility Maximizer.