evhub comments on RL with KL penalties is better seen as Bayesian inference

[evhub]

In the first equation under “KL-regularised RL as variational inference,” I think $a\left(x\right)$ should be ${\pi }_0\left(x\right)$.

[Tomek Korbak]

fixed, thanks!