it’s impossible to not have an implicit utility function, as you can define a revealed preference utility function for any hunk of matter.
Yes, you can “prove” that everything has a UF by trivializing UF, and this has been done many times, and it isn’t a good argument because of the trivialisation.
I think evolutionary fitness is a better way to think about this—the preferences that preserve themselves are the ones that win.
The preferences that please humans are the ones that win.
The preferences that please humans are the ones that win.
aha! what about preferences that help humans hurt each other? we need only imagine ais used in war as their strength grows. the story where ai jump on their own to malice is unnecessary, humans will boost it to that directly. oh, also scammers.
Yes, you can “prove” that everything has a UF by trivializing UF, and this has been done many times, and it isn’t a good argument because of the trivialisation.
The preferences that please humans are the ones that win.
yes, that was my point about ufs.
aha! what about preferences that help humans hurt each other? we need only imagine ais used in war as their strength grows. the story where ai jump on their own to malice is unnecessary, humans will boost it to that directly. oh, also scammers.