The mathematical sense: A mathematical function with certain properties of consistency, allowing an agent that uses it to make optimal decisions.
The engineering senses:
2.1) An actual code module, something that is distinct and separable in the source code.
2.2) An aspect of the operation that is thoroughly entangled with the other aspects.
2.3) Something external to an AI system, relevant only while it is being trained.
The “stance”. A way of describing or thinking about a system, not necessarily describing anything in the territory, in the spirit or Dennett’s “intentional stance”.
A technical-sounding, but actually vague way of talking about preferences or goals, with no implications to have a particular mathematical engineering implementaiton.
Note how (1) is entirely in the territory, whereas (3) is entirely a map or stance. Note also that only the “engineering” senses are relevant to practical AI safety.
The term “utility function” can mean:-
The mathematical sense: A mathematical function with certain properties of consistency, allowing an agent that uses it to make optimal decisions.
The engineering senses: 2.1) An actual code module, something that is distinct and separable in the source code.
2.2) An aspect of the operation that is thoroughly entangled with the other aspects.
2.3) Something external to an AI system, relevant only while it is being trained.
The “stance”. A way of describing or thinking about a system, not necessarily describing anything in the territory, in the spirit or Dennett’s “intentional stance”.
A technical-sounding, but actually vague way of talking about preferences or goals, with no implications to have a particular mathematical engineering implementaiton.
Note how (1) is entirely in the territory, whereas (3) is entirely a map or stance. Note also that only the “engineering” senses are relevant to practical AI safety.