Cleo Nardo comments on Want to predict/​explain/​control the output of GPT-4? Then learn about the world, not about transformers.

[Cleo Nardo]

okay, I’ll clarify in the article —

if your goal is to predict the logits layer on this particular prompt, then you should probably learn about Shakespearean dramas, Early Modern English, and the politics of the Late Roman Republic.”