What exactly is meant by the phrase “BS discipline”?
I suppose a discipline is BS if in the case of a science, it fails to systematically track the realities of an object of study. In the case of a trade, like business management or welding, then it’s a BS discipline if it fails to make its practitioners more successful than those outside the discipline. I’m not sure what kind of a discipline law is.
Taleb’s thought, I suppose, is that a discipline is likely to be BS if, instead of directly measuring the capabilities of its practitioners, we tend to measure only indirectly. This only implies that direct measurement is costly enough to outweigh its benefits, however. One reason for its being so may be that there’s nothing to measure directly (i.e. the discipline is BS), but another might be that the discipline is so specialized that very few people are competent to judge any given applicant. Yet a third might be that its subject matter is subject to a lot of mind-killing, so that one can confidently judge an applicant without bias.
I agree that it’s difficult to tell how good a lawyer is, which leads to a lot of nonsense like firms spending a lot of money of impressive offices and spending hours and hours of time chasing down every last grammatical error before filing court papers.
Thank you for answering. I would have to say that with plumbers and auto-mechanics, it is a lot easier to assess how good they are compared to lawyers since if they do their job properly, the problem they are working on will normally be solved and if they do not do their job properly, the problem will normally not be solved. Do you agree with this?
I agree that with doctors, there is a similar problem of difficulty in assessing quality as with lawyers. On the other hand, there are also problems with doctors spending energy on signalling, although perhaps not as bad as with lawyers. For example, caring about where a doctor went to medical school; prestigious internships; and spending money on impressive facilities. Do you agree with this?
I would have to say that with plumbers and auto-mechanics, it is a lot easier to assess how good they are compared to lawyers since if they do their job properly, the problem they are working on will normally be solved and if they do not do their job properly, the problem will normally not be solved. Do you agree with this?
And with a lawyer you can tell what the outcome of the trial was. Now obviously, the lawyers might overcharge you, but you also have the same problems with car mechanics and plumbers. Also for some cases what kind of outcome one can reasonably expect can depend on details of the case that may not be obvious to an non-lawyer, but you have the same problem with car mechanics.
Also, with all four of plumbers, auto-mechanics, doctors, and lawyers (especially contract lawyers) its possible for them to screw up in ways that aren’t immediately obvious but will cause problems down the line. (With lawyers one will at least be more obvious that the lawyer screwed up when the problem finally surfaces.)
And with a lawyer you can tell what the outcome of the trial was.
If someone is found guilty in a trial, is that a sign of a poor lawyer, or is that a sign that he was, in actual fact, guilty as charged, independent of the ability of his legal team?
A highly competent legal team may allow a guilty man to get away with a crime, yes. And an incompetent legal team may allow an innocent man to get convicted.
But a very competent legal team which normally takes cases where the defendant is guilty will do very badly by this metric; while an incompetent legal team might get a lot of innocent clients might do very well by the same metric.
If I wish to select a lawyer to defend me in a trial, then I know whether or not I am guilty of whatever I am being charged with. I do not know how many of the lawyer’s previous clients were guilty; nor how many were wrongfully convicted, or wrongfully released. Thus, a mere count of previous victories in court is potentially a poor measure of the lawyer’s effectiveness.
You have a point—a man who takes on only easy problems, in any field, will have a higher success rate than a man who takes on only hard problems, irrespective of actual skill level.
I think that what makes evaluating a lawyer in particular difficult is that it is very hard for a non-lawyer to easily distinguish easy from hard problems. For car mechanics, I know that replacing the oil is a much simpler job than replacing the engine; but when looking over a lawyer’s history, I can’t easily evaluate the relative difficulty of his previous successes.
For car mechanics, I know that replacing the oil is a much simpler job than replacing the engine
On the other hand, if I come in complaining that the car is making funny noises, it’s a lot harder to see whether this is an easy or hard problem. Another example, I come in for a routine inspection and he tells me that some part I’ve never heard of needs replacing and it’s going to be expensive. I have no way to check short of going to a different mechanic and then some figuring out who to trust.
And with a lawyer you can tell what the outcome of the trial was.
Even putting aside the fact that the vast majority of litigation is resolved before trial, there is also the fact that excellent lawyers lose cases all the time due to a lot of extraneous factors. By analogy, if the auto mechanic charged you $500 to change your brakes, and after he was done with the car the brakes still didn’t work, you could be pretty confident that you have a lousy auto mechanic.
Do you agree that in litigation there is a much more of a problem of extraneous factors making it difficult to assess the lawyer than extraneous factors in auto repair making it difficult to assess the mechanic?
Do you agree that with plumbers and auto mechanics it is a lot easier to assess how good they are compared to lawyers since if they do their job properly, the problem they are working on will normally be solved and if they do not do their job properly, the problem will normally not be solved?
Do you agree there are also problems with doctors spending energy on signalling, (although perhaps not as bad as with lawyers), for example, caring about where a doctor went to medical school; prestigious internships; and spending money on impressive facilities?
These are real questions, not rhetorical questions; they are aimed to get a better grip on where we agree. Please actually answer them as opposed to just answering the argument you imagine is behind them.
By analogy, if the auto mechanic charged you $500 to change your brakes, and after he was done with the car the brakes still didn’t work,
What if the brakes now work, but not necessarily quite as well as they did before? If an auto mechanic tells you your car is totaled, how do you know he’s correct?
Do you agree that with plumbers and auto mechanics it is a lot easier to assess how good they are compared to lawyers since if they do their job properly, the problem they are working on will normally be solved and if they do not do their job properly, the problem will normally not be solved?
That depends on the details of the problem. In a sense the same is true for lawyers. I agree that there are quantitative differences about exactly how likely you are to get a good estimate with what amount of certainty between these examples but I don’t think it’s large enough to make a qualitative difference in the analysis.
What if the brakes now work, but not necessarily quite as well as they did before? If an auto mechanic tells you your car is totaled, how do you know he’s correct?
That depends on the details of the problem. In a sense the same is true for lawyers. I agree that there are quantitative differences about exactly how likely you are to get a good estimate with what amount of certainty between these examples but I don’t think it’s large enough to make a qualitative difference in the analysis.
Those are interesting questions, but unfortunately you have basically ignored two of the three questions I asked you. As mentioned above,these were real questions aimed at getting a better grip on where we agree. It’s difficult enough to discuss these kinds of things without having the other person dance around the issues. I don’t engage with people who do this . . . .goodbye.
Those are interesting questions, but unfortunately you have basically ignored two of the three questions I asked you.
I figured the answers to those were easy to extrapolate from what I wrote, in any case here they are.
Do you agree that in litigation there is a much more of a problem of extraneous factors making it difficult to assess the lawyer than extraneous factors in auto repair making it difficult to assess the mechanic?
I agree that this is more of a problem for lawyers, although I’m not sure how much more.
Do you agree there are also problems with doctors spending energy on signalling, (although perhaps not as bad as with lawyers), for example, caring about where a doctor went to medical school; prestigious internships; and spending money on impressive facilities?
It is, but I’ve never heard anyone say that there is no point going to anything besides the top tier medical schools.
I suppose a discipline is BS if in the case of a science, it fails to systematically track the realities of an object of study. In the case of a trade, like business management or welding, then it’s a BS discipline if it fails to make its practitioners more successful than those outside the discipline. I’m not sure what kind of a discipline law is.
Taleb’s thought, I suppose, is that a discipline is likely to be BS if, instead of directly measuring the capabilities of its practitioners, we tend to measure only indirectly. This only implies that direct measurement is costly enough to outweigh its benefits, however. One reason for its being so may be that there’s nothing to measure directly (i.e. the discipline is BS), but another might be that the discipline is so specialized that very few people are competent to judge any given applicant. Yet a third might be that its subject matter is subject to a lot of mind-killing, so that one can confidently judge an applicant without bias.
I agree that it’s difficult to tell how good a lawyer is, which leads to a lot of nonsense like firms spending a lot of money of impressive offices and spending hours and hours of time chasing down every last grammatical error before filing court papers.
This is true for a lot of professions. Most of them don’t have the problem you’re describing.
Would you mind giving me three examples? This would help me think about what you are saying. TIA.
Plumbers, auto-mechanics, doctors.
Thank you for answering. I would have to say that with plumbers and auto-mechanics, it is a lot easier to assess how good they are compared to lawyers since if they do their job properly, the problem they are working on will normally be solved and if they do not do their job properly, the problem will normally not be solved. Do you agree with this?
I agree that with doctors, there is a similar problem of difficulty in assessing quality as with lawyers. On the other hand, there are also problems with doctors spending energy on signalling, although perhaps not as bad as with lawyers. For example, caring about where a doctor went to medical school; prestigious internships; and spending money on impressive facilities. Do you agree with this?
And with a lawyer you can tell what the outcome of the trial was. Now obviously, the lawyers might overcharge you, but you also have the same problems with car mechanics and plumbers. Also for some cases what kind of outcome one can reasonably expect can depend on details of the case that may not be obvious to an non-lawyer, but you have the same problem with car mechanics.
Also, with all four of plumbers, auto-mechanics, doctors, and lawyers (especially contract lawyers) its possible for them to screw up in ways that aren’t immediately obvious but will cause problems down the line. (With lawyers one will at least be more obvious that the lawyer screwed up when the problem finally surfaces.)
If someone is found guilty in a trial, is that a sign of a poor lawyer, or is that a sign that he was, in actual fact, guilty as charged, independent of the ability of his legal team?
I mean it’s not like a good legal team has ever allowed a guilty man to get away with it. Also, presumably the person knows whether he is guilty.
A highly competent legal team may allow a guilty man to get away with a crime, yes. And an incompetent legal team may allow an innocent man to get convicted.
But a very competent legal team which normally takes cases where the defendant is guilty will do very badly by this metric; while an incompetent legal team might get a lot of innocent clients might do very well by the same metric.
If I wish to select a lawyer to defend me in a trial, then I know whether or not I am guilty of whatever I am being charged with. I do not know how many of the lawyer’s previous clients were guilty; nor how many were wrongfully convicted, or wrongfully released. Thus, a mere count of previous victories in court is potentially a poor measure of the lawyer’s effectiveness.
Yes, and the same problem can exist for plumbers, car mechanics, and doctors.
Academics also.
You have a point—a man who takes on only easy problems, in any field, will have a higher success rate than a man who takes on only hard problems, irrespective of actual skill level.
I think that what makes evaluating a lawyer in particular difficult is that it is very hard for a non-lawyer to easily distinguish easy from hard problems. For car mechanics, I know that replacing the oil is a much simpler job than replacing the engine; but when looking over a lawyer’s history, I can’t easily evaluate the relative difficulty of his previous successes.
On the other hand, if I come in complaining that the car is making funny noises, it’s a lot harder to see whether this is an easy or hard problem. Another example, I come in for a routine inspection and he tells me that some part I’ve never heard of needs replacing and it’s going to be expensive. I have no way to check short of going to a different mechanic and then some figuring out who to trust.
Even putting aside the fact that the vast majority of litigation is resolved before trial, there is also the fact that excellent lawyers lose cases all the time due to a lot of extraneous factors. By analogy, if the auto mechanic charged you $500 to change your brakes, and after he was done with the car the brakes still didn’t work, you could be pretty confident that you have a lousy auto mechanic.
Do you agree that in litigation there is a much more of a problem of extraneous factors making it difficult to assess the lawyer than extraneous factors in auto repair making it difficult to assess the mechanic?
Do you agree that with plumbers and auto mechanics it is a lot easier to assess how good they are compared to lawyers since if they do their job properly, the problem they are working on will normally be solved and if they do not do their job properly, the problem will normally not be solved?
Do you agree there are also problems with doctors spending energy on signalling, (although perhaps not as bad as with lawyers), for example, caring about where a doctor went to medical school; prestigious internships; and spending money on impressive facilities?
These are real questions, not rhetorical questions; they are aimed to get a better grip on where we agree. Please actually answer them as opposed to just answering the argument you imagine is behind them.
What if the brakes now work, but not necessarily quite as well as they did before? If an auto mechanic tells you your car is totaled, how do you know he’s correct?
That depends on the details of the problem. In a sense the same is true for lawyers. I agree that there are quantitative differences about exactly how likely you are to get a good estimate with what amount of certainty between these examples but I don’t think it’s large enough to make a qualitative difference in the analysis.
Those are interesting questions, but unfortunately you have basically ignored two of the three questions I asked you. As mentioned above,these were real questions aimed at getting a better grip on where we agree. It’s difficult enough to discuss these kinds of things without having the other person dance around the issues. I don’t engage with people who do this . . . .goodbye.
I figured the answers to those were easy to extrapolate from what I wrote, in any case here they are.
I agree that this is more of a problem for lawyers, although I’m not sure how much more.
It is, but I’ve never heard anyone say that there is no point going to anything besides the top tier medical schools.
How about manifacturers of multivitamins?
(BTW, the term for this sort of things is credence goods.)