Can’t you choose an arbitrary encoding procedure? Choosing a different one only adds a constant number of bits. Also, my comment on discounted entropy was a little too flippant. What I mean is closer to entropy rate with a discount factor, like in soft-actor critic. Maximizing your ability to have options in the future requires a lot of “agency”.
Maybe consciousness should be more than just agency, e.g. if a chess bot were trained to maximize entropy, games wouldn’t be as strategic as if it wants to get a high*-energy payoff. However, I’m not convinced energy even exists? Humans learn strategy because their genes are more likely to survive, thrive, and have choices in the future when they win. You could even say elementary particles are just the ones still around since the Big Bang.
*Note: The physicists should reverse the sign on energy. While they’re at it, switch to inverse-temperature.
Can’t you choose an arbitrary encoding procedure? Choosing a different one only adds a constant number of bits. Also, my comment on discounted entropy was a little too flippant. What I mean is closer to entropy rate with a discount factor, like in soft-actor critic. Maximizing your ability to have options in the future requires a lot of “agency”.
Maybe consciousness should be more than just agency, e.g. if a chess bot were trained to maximize entropy, games wouldn’t be as strategic as if it wants to get a high*-energy payoff. However, I’m not convinced energy even exists? Humans learn strategy because their genes are more likely to survive, thrive, and have choices in the future when they win. You could even say elementary particles are just the ones still around since the Big Bang.
*Note: The physicists should reverse the sign on energy. While they’re at it, switch to inverse-temperature.