Stuart_Armstrong comments on Comparing reward learning/​reward tampering formalisms

[Stuart_Armstrong]

Suart, by ”$P_{rt}(R\mid D_{1:j})$ is complex” are you referring to...

I mean that that defining $P_{rt}$ can be done in many different ways, and hence has a lot of contingent structure. In contrast, in $P_{lp}(R\mid D_{1:j},\rho )$, the $\rho is a complex distribution on $R$, conditional on $D_{1:j}$; hence $P_{lp}$ itself is trivial and just encodes “apply $\rho$ to $R$ and $D_{1:j}$ in the obvious way.