Charlie Steiner comments on Research Report: Sparse Autoencoders find only 9/​180 board state features in OthelloGPT

[Charlie Steiner]

At a high level, you don’t get to pick the ontology.

This post seems like a case of there being too many natural abstractions.