[ I am sure this is not new to anyone who’s been thinking about this. ]
I worry that the world is not benign in general, but contains critters that want to mislead you to win utility. There might be such critters that may exploit the difficulty of the problem faced by Cai by trying to mislead Cai into constructing the wrong mapping from “stuff out there” to “stuff in Cai” (of course even the easy version is hard :( ).
[ I am sure this is not new to anyone who’s been thinking about this. ]
I worry that the world is not benign in general, but contains critters that want to mislead you to win utility. There might be such critters that may exploit the difficulty of the problem faced by Cai by trying to mislead Cai into constructing the wrong mapping from “stuff out there” to “stuff in Cai” (of course even the easy version is hard :( ).
-