An area where I think there is an important difference between doing explicit search and optimisation through piles of heuristics is in clistering NN à la Filan et al. (link TBD).
A usecase I’ve been thinking about is to use that kind of technique to help identify mesaoptimisation or more particularly mesaobjectives (with the help of interpretability tools guided by the clustering of the NN).
In the case of explicit search I would expect that it would be more common than not to be able to find a specific part of the network evaluating world states in terms of the mesaobjective and thus being able to identify the behavioural objective (link TBD). For piles of heuristics I would instead expect the behavioural objective to only be apparent from investigating large parts of the NN in relation to the environment, this seems a lot harder.
An area where I think there is an important difference between doing explicit search and optimisation through piles of heuristics is in clistering NN à la Filan et al. (link TBD).
A usecase I’ve been thinking about is to use that kind of technique to help identify mesaoptimisation or more particularly mesaobjectives (with the help of interpretability tools guided by the clustering of the NN).
In the case of explicit search I would expect that it would be more common than not to be able to find a specific part of the network evaluating world states in terms of the mesaobjective and thus being able to identify the behavioural objective (link TBD). For piles of heuristics I would instead expect the behavioural objective to only be apparent from investigating large parts of the NN in relation to the environment, this seems a lot harder.