An even more pointed example: chess endgame tables. What does it mean to ‘fully understand’ it beyond understanding the algorithms which construct them, and is it a reasonable goal to attempt to play chess endgames as well as the tables?
If you have a “lazy” version of the goal, like “have a question-answerer that can tell you anything the model knows” or “produce a locally human-legible but potentially giant object capturing everything the model knows” then chess endgame tables are a reasonably straightforward case (“position X is a win for white”).
An even more pointed example: chess endgame tables. What does it mean to ‘fully understand’ it beyond understanding the algorithms which construct them, and is it a reasonable goal to attempt to play chess endgames as well as the tables?
If you have a “lazy” version of the goal, like “have a question-answerer that can tell you anything the model knows” or “produce a locally human-legible but potentially giant object capturing everything the model knows” then chess endgame tables are a reasonably straightforward case (“position X is a win for white”).