Lucius Bushnaq comments on RL with KL penalties is better seen as Bayesian inference

[Lucius Bushnaq]

Is a(x) in the formulas supposed to be pi_0(x)?

[Tomek Korbak]

good catch, yes, thanks!