My claim is that only a couple of structures pop out after testing a utility-maximizing agent in a sufficient amount of environments.
I think there’s a lot of assumptions here about the kinds of feasible/available structures, and what “sufficient amount” of environments entails. My expectation is that this is true neither for toy problems (often optimized for a gotcha) nor for real-world problems (often with massive complexity and near-chaotic margins).
I think there’s a lot of assumptions here about the kinds of feasible/available structures, and what “sufficient amount” of environments entails. My expectation is that this is true neither for toy problems (often optimized for a gotcha) nor for real-world problems (often with massive complexity and near-chaotic margins).