Stuart_Armstrong comments on Reward function learning: the learning process

[Stuart_Armstrong]

Do you mean “onto” rather than “one-to-one”? (If the function is not one-to-one, which two inputs map to the same output?)

The observation function is onto, and not one-to-one. For most states $s\in S$, the states $s\times \left\{\text{cook}\right\}$ and $s\times \left\{\text{wash}\right\}$ will map to the same observation.

Do you mean “then” instead of “when”?

Thanks, I’ve now corrected that.