You are taking the inscrutability thing a bit too strongly. Someone can transition from rationality to meta rationality, just as someone can transition to pre rationality to rationality. Pre rationality has limitations because yelling tribal slogans at people who aren’t in your tribe doesn’t work.
What does meta-rationality even imply, for the real world?
What does rationality imply? You can’t actually run Solomonoff Induction, so FAPP you are stuck with a messy plurality of approximations. And if you notice that problem...
You are taking the inscrutability thing a bit too strongly. Someone can transition from rationality to meta rationality, just as someone can transition to pre rationality to rationality. Pre rationality has limitations because yelling tribal slogans at people who aren’t in your tribe doesn’t work.
What does rationality imply? You can’t actually run Solomonoff Induction, so FAPP you are stuck with a messy plurality of approximations. And if you notice that problem...