I did a search for “ergodic” and was surprised not to find it. Then I did a search for “reachable” and found this:
Without loss of generality, assumes all states of M are reachable from S(λ) (otherwise, υ is an O-realization of the MDP we get by discarding the unreachable states)
You could just be left with one state after that! If that’s the domain that the results cover, that should be flagged. It seems to me like this result only applies to ergodic MDPs.
I did a search for “ergodic” and was surprised not to find it. Then I did a search for “reachable” and found this:
You could just be left with one state after that! If that’s the domain that the results cover, that should be flagged. It seems to me like this result only applies to ergodic MDPs.