Because it comes boxed with an inaccurate causal story.
For example, if I tell you not to lie because god is watching you and will send you to hell, this is somewhat useful because you’ll become more trustworthy if you believe it, but the claim about god and hell is false.
Maybe I am missing some previous rationalist discourse about the red sky saying. I remember reading it in books as a child, and do not know (except that it is listed here as a useful heuristic) whether it is actually true, or what the bundled incorrect causal story is. I have always interpreted it as “a red sunrise is correlated with a higher chance of storms at sea.” That claim does not entail any particular causal mechanism, and it still seems to me that it must be either accurate and therefore useful, or inaccurate and therefore not useful, but it’s hard to imagine how it could be inaccurate and useful.
Because it comes boxed with an inaccurate causal story.
For example, if I tell you not to lie because god is watching you and will send you to hell, this is somewhat useful because you’ll become more trustworthy if you believe it, but the claim about god and hell is false.
Maybe I am missing some previous rationalist discourse about the red sky saying. I remember reading it in books as a child, and do not know (except that it is listed here as a useful heuristic) whether it is actually true, or what the bundled incorrect causal story is. I have always interpreted it as “a red sunrise is correlated with a higher chance of storms at sea.” That claim does not entail any particular causal mechanism, and it still seems to me that it must be either accurate and therefore useful, or inaccurate and therefore not useful, but it’s hard to imagine how it could be inaccurate and useful.