What we’d ask depends on the context. In general, not all rationalist teachings are in the form of a question, but many could probably be phrased that way.
“Am I winning?” This is the fundamental lesson of instrumental rationality. It’s not enough to act with Propriety or “virtue” or obey the Great Teacher. Sometimes the rules you learned aren’t applicable. If you’re not winning and it’s not due to pure chance, you did it wrong, propriety be damned. You failed to grasp the Art. Reflect, and actually cut the enemy.
Is there a chain of causality linking the evidence to the hypothesis? What else is on that chain? Can I gather more direct evidence? Have I double-counted indirect evidence?
What do I expect? (And then, “How surprised am I?”)
Assuming this failed, how surprised would I be? What’s the most obvious reason why it would fail? Can I take a step to mitigate that/improve my plans? (And repeat.)
Does this happen often enough to be worth the cost of fixing it?
Has anyone else solved this problem? Have I checked? (Web, LLMs, textbooks?)
Have I thought about this for at least five minutes?
What’s my biggest problem? What’s the bottleneck? What am I not allowed to care about? If my life was a novel, what would I be yelling at the protagonist to do? Of my current pursuits, which am I pursuing ineffectively? What sparks my interest?
On what evidence do I conclude what I think is know is correct/factual/true and how strong is that evidence? To what extent have I verified that view and just how extensively should I verify the evidence?
After that might be a similar approach to the implications or outcomes of applying actions based on what one holds as truth/fact.
I tend to think of rationality as a process rather than endpoint. Which isn’t to say that the destination is not important but clearly without the journey the destination is just a thought or dream. That first of a thousand steps thing.
“On what evidence do I conclude what I think is know is correct/factual/true and how strong is that evidence? To what extent have I verified that view and just how extensively should I verify the evidence?”
For this, aside from traditional paper reading from credible sources, one good approach in my opinion is to actively seek evidence/arguments from, or initiate conversations with people who have a different perspective with me (on both side of the spectrum if the conclusion space is continuous).
I’d like to know: what are the main questions a rational person would ask? (Also what are some better ways to phrase what I have?)
I’ve been thinking something like
What will happen in the future?
What is my best course of action regardless of what all other people are doing? (Asked in moderation)
What we’d ask depends on the context. In general, not all rationalist teachings are in the form of a question, but many could probably be phrased that way.
“Do I desire to believe X if X is the case and not-X if X is not the case?” (For whatever X in question.) This is the fundamental lesson of epistemic rationality. If you don’t want to lie to yourself, the rest will help you get better at that. But if you do, you’ll lie to yourself anyway and all your acquired cleverness will be used to defeat itself.
“Am I winning?” This is the fundamental lesson of instrumental rationality. It’s not enough to act with Propriety or “virtue” or obey the Great Teacher. Sometimes the rules you learned aren’t applicable. If you’re not winning and it’s not due to pure chance, you did it wrong, propriety be damned. You failed to grasp the Art. Reflect, and actually cut the enemy.
Those two are the big ones. But there are more.
Key lessons from Bayes:
How much do I currently believe this?
What’s my best guess, or upper/lower bound, or probability distribution?
Do I have sufficient cause to even entertain the hypothesis?
Is the evidence more consistent with my hypothesis, or its converse?
How ad-hoc is the hypothesis? Is there a weaker claim more likely to be true?
Is there a chain of causality linking the evidence to the hypothesis? What else is on that chain? Can I gather more direct evidence? Have I double-counted indirect evidence?
Others I thought of:
Am I confused?
What’s a concrete example?
What do I expect? (And then, “How surprised am I?”)
Assuming this failed, how surprised would I be? What’s the most obvious reason why it would fail? Can I take a step to mitigate that/improve my plans? (And repeat.)
Does this happen often enough to be worth the cost of fixing it?
Has anyone else solved this problem? Have I checked? (Web, LLMs, textbooks?)
Have I thought about this for at least five minutes?
Do I care? Should I? Why?
Wanna bet?
Can I test this?
What’s my biggest problem? What’s the bottleneck? What am I not allowed to care about? If my life was a novel, what would I be yelling at the protagonist to do? Of my current pursuits, which am I pursuing ineffectively? What sparks my interest?
Am I lying?
I’m not claiming this list is exhaustive.
There’s a triad of paired questions I sometimes run through.
What do you think you know and how do you think you know it?
Do you know what you are doing, and why you are doing it?
What are you about to do and what do you think will happen next?
They’re suited for slightly different circumstances, but I think each is foundational in its own way.
I think perhaps a first one might be:
On what evidence do I conclude what I think is know is correct/factual/true and how strong is that evidence? To what extent have I verified that view and just how extensively should I verify the evidence?
After that might be a similar approach to the implications or outcomes of applying actions based on what one holds as truth/fact.
I tend to think of rationality as a process rather than endpoint. Which isn’t to say that the destination is not important but clearly without the journey the destination is just a thought or dream. That first of a thousand steps thing.
“On what evidence do I conclude what I think is know is correct/factual/true and how strong is that evidence? To what extent have I verified that view and just how extensively should I verify the evidence?”
For this, aside from traditional paper reading from credible sources, one good approach in my opinion is to actively seek evidence/arguments from, or initiate conversations with people who have a different perspective with me (on both side of the spectrum if the conclusion space is continuous).