Fabien Roger comments on What Discovering Latent Knowledge Did and Did Not Find

[Fabien Roger]

Probes initialized like Collin does in the zip file: a random spherical initialization (take a random Gaussian, and normalize it).