it seems like the vast majority of people don’t make their lives primarily about delicious food
That’s true. There are built-in decreasing marginal returns to eating massive quantities of delicious food (you get full), but we don’t see a huge number of—for example—bulimics who are bulimic for the core purpose of being able to eat more.
However, I’d mention that yummy food is only one of many things that are brains are hard-wired to mesa-optimize for. Social acceptance and social status (particularly within the circles we care about, i.e. usually the circles we are likely to succeed in and get benefit from) are very big examples that much of our behavior can be ascribed to.
reward optimization might be a convergent secondary goal, it probably won’t be the agent’s primary motivation.
So I guess, reflecting this to humans, would you argue that most human’s primary motivations aren’t motivated mostly by various mesa-objectives our brains are hardwired to have? In my mind this is a hard sell, as most things humans do you can trace back (sometimes incorrectly, sure) to some thing that was evolutionary advantageous (mesa-objective that led to genetic fitness). The whole area of evolutionary biology specializes in coming up with (hard to prove and sometimes convoluted) explanations here relating to both our behavior and physiology.
For example, you could argue that us posting hopefully smart things here is giving our brains happy juice relating to social status / intelligence signaling / social interaction, which in our evolutionary history increased the probability that we would find high quality partners to make lots of high quality babies with. I guess, if mesa-objectives aren’t the primary drivers of us humans—what is, and how can you be sure?
That’s true. There are built-in decreasing marginal returns to eating massive quantities of delicious food (you get full), but we don’t see a huge number of—for example—bulimics who are bulimic for the core purpose of being able to eat more.
However, I’d mention that yummy food is only one of many things that are brains are hard-wired to mesa-optimize for. Social acceptance and social status (particularly within the circles we care about, i.e. usually the circles we are likely to succeed in and get benefit from) are very big examples that much of our behavior can be ascribed to.
So I guess, reflecting this to humans, would you argue that most human’s primary motivations aren’t motivated mostly by various mesa-objectives our brains are hardwired to have? In my mind this is a hard sell, as most things humans do you can trace back (sometimes incorrectly, sure) to some thing that was evolutionary advantageous (mesa-objective that led to genetic fitness). The whole area of evolutionary biology specializes in coming up with (hard to prove and sometimes convoluted) explanations here relating to both our behavior and physiology.
For example, you could argue that us posting hopefully smart things here is giving our brains happy juice relating to social status / intelligence signaling / social interaction, which in our evolutionary history increased the probability that we would find high quality partners to make lots of high quality babies with. I guess, if mesa-objectives aren’t the primary drivers of us humans—what is, and how can you be sure?