But still, this trick might be harmful to some people. If someone instead will just eat cookies whenever they are available, without any regard to future availability, this will cause that person to eat a lot of cookies.
And if you cross the street, you might get hit by a car. This sort of reasoning goes on and on but never gets you anywhere. If you don’t want to do something, you can always find a reason.
Sure, that doesn’t mean that ANY reason is valid, or that EVERY objection is invalid. However, that too is another step in a chain of reasoning that never ends, and never results in taking action. Instead, you will simply wait and wait and wait for someone else to validate your taking action. So if you don’t take status quo bias into consideration, then you have no protection against your own confabulation, because the only way to break the confabulation deadlock is to actually DO something.
Even if you don’t know what the hell you’re doing and try things randomly, you’ll improve as long as there’s some empirical way to measure your results, and the costs of your inevitable mistakes and failures are acceptable. Hell, look at how far evolution got, doing basically that. An intelligent human being can certainly do better… but ONLY by doing something besides thinking.
After all, the platform human thinking runs on is not reliable. In principle, LWers and I agree on this. But in practice, LWers argue as if their brains were reliable reasoning machines, instead of arguing machines!
I learned the hard way that my brain’s confabulation—“reasoning”—is not reliable when it is not subjected to empirical testing. It works well for reducing evidence to pattern and playing with explanatory models, but it’s lousy at coming up with ideas in the first place, and even worse at noticing whether those ideas are any good for anything but sounding convincing.
One of my pet sayings is that “amateurs guess, professionals test”. But “test” in the instrumental world does not mean a review of statistics from double-blind experiments. It means actually testing the thing you are trying to build or fix, in as close to the actual use environment as practical. If my mechanic said statistics show it’s 27% likely that the problem with my car is in the spark plugs, but didn’t actually test them, I’d best get another mechanic!
The best that statistics can do for the mechanic is to mildly optimize what tests should be done first… but you could get almost as much optimization by testing in easiest-first order.
It might help to have some studies that say some percentage of people are the sort this technique helps, and some other percentage are the sort that are harmed, or better yet, identify some observable characteristics that predicts how a person would be affected.
And where, pray tell is this information going to come from if nobody tries anything? If the Extreme Rationalist position is only to try things that have been validated on other people first, what happens when everybody is an extreme rationalist? Doesn’t sound very scalable to me.
And if you cross the street, you might get hit by a car. This sort of reasoning goes on and on but never gets you anywhere. If you don’t want to do something, you can always find a reason.
The fact that one might get hit by a car when crossing the street does not prevent people from crossing the street; it causes them to actually look to see if cars are coming before crossing the street. Did you miss the part where I talked about how the evidence might convince someone the risk is acceptable in their case? Or how it might help them to compare it to another trick that is less risky or more likely to work for them that they could try first?
And where, pray tell is this information going to come from if nobody tries anything? If the Extreme Rationalist position is only to try things that have been validated on other people first, what happens when everybody is an extreme rationalist? Doesn’t sound very scalable to me.
Getting volunteer subjects for a study is different than announcing a trick on the internet and expecting people to try it.
Where do you think the data is going to come from if people just try it on their own? How are you going to realize if you have suggested a trick that doesn’t work, or that only works for some people, if you accept all anecdotal success stories as confirming its effectiveness, but reject all reports of failure because people just make excuses?
How are you going to realize if you have suggested a trick that doesn’t work, or that only works for some people, if you accept all anecdotal success stories as confirming its effectiveness, but reject all reports of failure because people just make excuses?
I can only assume you’re implying that that’s what I do. But as I’ve already stated, when someone has performed a technique to my satisfaction, and it still doesn’t work, I have them try something else. I don’t just say, “oh well, tough luck, and it’s your fault”.
There are only a few possibilities regarding an explanation of why “different things work for different people”:
Some things only work on some people, and this is an unchanging trait attributable to the people themselves,
Some things only work on certain kinds of problems, and many problems superficially sound similar but are actually different in their mechanism of operation (so that technique A works on problem A1 but not A2, and the testers/experimenters have not yet discerned the difference between A1 and A2), and
Some people have an easier time of learning how to do some things than others, depending in part on how the thing is explained, and what prior beliefs, understandings, etc. they have. (So that even though a test of technique A is being performed, in practice one is testing an unknown set of variant techniques A1, A2,...)
On LW, #1 is a popular explanation, but I have seen much more evidence that makes sense for #2 and #3. (For example, not being able to apply a technique and then later learning it supports #3, and discovering a criterion that predicts which of two techniques will be more likely to work for a given problem supports #2.)
Of course, I cannot 100% rule out the possibility that #1 could be true, but it seems like pretty long odds to me. There are so many clear-cut cases of #2 and #3, that barring actual brain damage or defect, #1 seems like adding unnecessary entities to one’s model, without any theoretical or empirical justification whatsoever.
More than that, it sounds exactly like attribution error, and an instance of Dweck’s “fixed” mindset as well. In other words, we can expect belief in #1 to be associated with a mindset that is highly correlated with consistent difficulty and stress in the corresponding field.
That’s why I consider view #1 to be bad instrumental hygiene as well as not that likely to be true anyway. It’s a horrible negative self-prime to saddle yourself with.
And if you cross the street, you might get hit by a car. This sort of reasoning goes on and on but never gets you anywhere. If you don’t want to do something, you can always find a reason.
Sure, that doesn’t mean that ANY reason is valid, or that EVERY objection is invalid. However, that too is another step in a chain of reasoning that never ends, and never results in taking action. Instead, you will simply wait and wait and wait for someone else to validate your taking action. So if you don’t take status quo bias into consideration, then you have no protection against your own confabulation, because the only way to break the confabulation deadlock is to actually DO something.
Even if you don’t know what the hell you’re doing and try things randomly, you’ll improve as long as there’s some empirical way to measure your results, and the costs of your inevitable mistakes and failures are acceptable. Hell, look at how far evolution got, doing basically that. An intelligent human being can certainly do better… but ONLY by doing something besides thinking.
After all, the platform human thinking runs on is not reliable. In principle, LWers and I agree on this. But in practice, LWers argue as if their brains were reliable reasoning machines, instead of arguing machines!
I learned the hard way that my brain’s confabulation—“reasoning”—is not reliable when it is not subjected to empirical testing. It works well for reducing evidence to pattern and playing with explanatory models, but it’s lousy at coming up with ideas in the first place, and even worse at noticing whether those ideas are any good for anything but sounding convincing.
One of my pet sayings is that “amateurs guess, professionals test”. But “test” in the instrumental world does not mean a review of statistics from double-blind experiments. It means actually testing the thing you are trying to build or fix, in as close to the actual use environment as practical. If my mechanic said statistics show it’s 27% likely that the problem with my car is in the spark plugs, but didn’t actually test them, I’d best get another mechanic!
The best that statistics can do for the mechanic is to mildly optimize what tests should be done first… but you could get almost as much optimization by testing in easiest-first order.
And where, pray tell is this information going to come from if nobody tries anything? If the Extreme Rationalist position is only to try things that have been validated on other people first, what happens when everybody is an extreme rationalist? Doesn’t sound very scalable to me.
The fact that one might get hit by a car when crossing the street does not prevent people from crossing the street; it causes them to actually look to see if cars are coming before crossing the street. Did you miss the part where I talked about how the evidence might convince someone the risk is acceptable in their case? Or how it might help them to compare it to another trick that is less risky or more likely to work for them that they could try first?
Getting volunteer subjects for a study is different than announcing a trick on the internet and expecting people to try it.
Where do you think the data is going to come from if people just try it on their own? How are you going to realize if you have suggested a trick that doesn’t work, or that only works for some people, if you accept all anecdotal success stories as confirming its effectiveness, but reject all reports of failure because people just make excuses?
I can only assume you’re implying that that’s what I do. But as I’ve already stated, when someone has performed a technique to my satisfaction, and it still doesn’t work, I have them try something else. I don’t just say, “oh well, tough luck, and it’s your fault”.
There are only a few possibilities regarding an explanation of why “different things work for different people”:
Some things only work on some people, and this is an unchanging trait attributable to the people themselves,
Some things only work on certain kinds of problems, and many problems superficially sound similar but are actually different in their mechanism of operation (so that technique A works on problem A1 but not A2, and the testers/experimenters have not yet discerned the difference between A1 and A2), and
Some people have an easier time of learning how to do some things than others, depending in part on how the thing is explained, and what prior beliefs, understandings, etc. they have. (So that even though a test of technique A is being performed, in practice one is testing an unknown set of variant techniques A1, A2,...)
On LW, #1 is a popular explanation, but I have seen much more evidence that makes sense for #2 and #3. (For example, not being able to apply a technique and then later learning it supports #3, and discovering a criterion that predicts which of two techniques will be more likely to work for a given problem supports #2.)
Of course, I cannot 100% rule out the possibility that #1 could be true, but it seems like pretty long odds to me. There are so many clear-cut cases of #2 and #3, that barring actual brain damage or defect, #1 seems like adding unnecessary entities to one’s model, without any theoretical or empirical justification whatsoever.
More than that, it sounds exactly like attribution error, and an instance of Dweck’s “fixed” mindset as well. In other words, we can expect belief in #1 to be associated with a mindset that is highly correlated with consistent difficulty and stress in the corresponding field.
That’s why I consider view #1 to be bad instrumental hygiene as well as not that likely to be true anyway. It’s a horrible negative self-prime to saddle yourself with.