Shards and Bidding
“Shard of value”: “contextually active computations downstream of similar historical reinforcement events”
Shards activate more strongly in contexts similar to those where they were historically reinforced
“Subshard”: “contextually activated component of a shard”
Bidding
Shards bid for actions historically responsible for receiving reward (“reward circuit activation”) and not directly for reward
Credit assignment plays a role in all this that I don’t understand well yet
Shards and Bidding
“Shard of value”: “contextually active computations downstream of similar historical reinforcement events”
Shards activate more strongly in contexts similar to those where they were historically reinforced
“Subshard”: “contextually activated component of a shard”
Bidding
Shards bid for actions historically responsible for receiving reward (“reward circuit activation”) and not directly for reward
Credit assignment plays a role in all this that I don’t understand well yet