gwern comments on Transformer inductive biases & RASP

[gwern]

They apparently reinvented RASP independently.