+A bunch for running an experiment to test a hypothesis and reporting back!
That having been said, it’s not at all clear to me that this is a problem worth solving. For example, mathematical history is littered with examples where important concepts are named, not after the originator, but after the person who first really made good use of the concept and/or really popularized it (I particularly have in mind motte and bailey as I say this). Most mathematicians probably couldn’t tell you the originator of most of the concepts they use. This does not seem to have done much damage at all. (Although there’s a nearby thing that I think is quite bad, which is not having any story at all for how one might go about inventing / reinventing a concept. But there’s a huge difference between the historical story behind how something was discovered and the best way to present it pedagogically / capture the principle that generates it; Eliezer makes this point in the quantum mechanics sequence, for example.)
More concretely, suppose I want to know more about aliefs, after hearing someone talk about them in whatever context. If I just google “alief,” I’ll get to the Wikipedia article on aliefs, which has citations to papers I can read. So it’s completely irrelevant that I started out not knowing where the concept came from; the moment I google it I’ll find out.
The problem with not knowing the true origins of your concepts is that you can’t be sure whether the concept was distorted, intentionally or unintentionally by the person re-transmitting the concept to you.
For example, much of what is attributed to Clausewitz in the popular mind was actually written by Jomini, who interpreted and summarized Clausewitz’s ideas. In fact, Clausewitz actually disagreed with much of Jomini’s writing. One example is that when Clausewitz referred to political considerations in the lead up to war, he was primarily referring to internal political considerations—things like how much political capital the leadership had and whether the nation would be able to sustain the will to fight.
Jomini, however, translated Clausewitz’s dictums on politics as referring to diplomacy, that is, he took what Clausewitz was saying about internal considerations and rephrased it as being about relations between states. This was a huge distortion, one which lay undiscovered for nearly a hundred years, since Jomini was widely regarded as the authoritative translator and summarizer of Clausewitz.
History and philosophy are riddled with these kinds of distortions and misinterpretations. Just look at the varying interpretations of Nietzsche, for example, and contrast those with the source material. That’s why it’s important to know where an idea comes from. You want to be able to verify that the idea you’re receiving is the idea you think you’re receiving, rather than some related or distorted version of that idea.
Another important consideration is finding related ideas. If I can track an idea back to its original source, I can find other things that person has written, and see if they have other good ideas. I can’t do that if the original source is obscured or not cited.
1. If you understand how to regenerate a concept in an inside view way, there’s an important sense in which it really doesn’t matter who originated it, because you can correct any distortions in the concept yourself. In the same way that if you hear someone state a theorem and reprove it yourself, you can discover that they slightly misstated it and find the correct statement yourself. So it seems to me that this distortionary effect is more important the more your reasoning is outside view-flavored.
2. This all seems fine if you have an active project of seeking out good ideas, but I don’t expect everyone in the community to actively be wanting to do this as opposed to the many other things they could be wanting to do. Said another way, I don’t think you’re engaging with the opportunity cost of paying attention to this as opposed to something else.
If you understand how to regenerate a concept in an inside view way, there’s an important sense in which it really doesn’t matter who originated it, because you can correct any distortions in the concept yourself. In the same way that if you hear someone state a theorem and reprove it yourself, you can discover that they slightly misstated it and find the correct statement yourself. So it seems to me that this distortionary effect is more important the more your reasoning is outside view-flavored.
This isn’t actually how ideas work. For one thing, this presupposes that the version of an idea which has been passed down to you is ‘correct’/its most useful version in the first place. For example, Alan Kay invented Object Oriented Programming several decades ago, and most modern computer languages implement ‘Object Oriented Programming’. The version they implement is of course significantly degraded from the version that appears in say, Smalltalk. But it’s an improvement over what existed before in C, so nobody really notices that OOP could theoretically be something better. This is a stable situation that doesn’t look like it’ll be changing anytime soon.
The object level argument against this of course is that Alan Kay is wrong about the utility of his original version of OOP. On such things I have no comment.
The object level argument against this of course is that Alan Kay is wrong about the utility of his original version of OOP. On such things I have no comment.
The counter-argument, of course, is that sure, maybe Alan Kay is wrong about how useful his original version of OOP is, but is everyone who ever proposed an older-but-more-advanced version of an idea always wrong about the usefulness of that idea? Do implementations never degrade from prior visions for anything but the most unimpeachable reasons of effectiveness (as opposed to, say, market pressures, or contingent historical matters, etc.)?
I think it would be absurd to take such a position. The counterexamples are legion. To maintain any such view is to ascribe, to the market (both the actual market where products are offered and sold, and the “marketplace of ideas”), a sort of definitional correctness which it manifestly does not have.
Which is all to say that I agree with this:
For one thing, this presupposes that the version of an idea which has been passed down to you is ‘correct’/its most useful version in the first place.
And I concur that this presupposition is often mistaken.
While concurring entirely, let me add another, related motivation for wanting to know the origin of your concepts (one which applies quite strongly in, for instance, both philosophy and psychology):
Many concepts, conceptual frameworks, positions, etc., are born out of disputes. Concepts do not arise in a vacuum, and writers do not write in a vacuum; they are often responding to things other people—their contemporaries—have said, or are saying.
But if you don’t know what someone was responding to, you have no hope of grasping their motivations for saying what they were saying; and consequently you’ll fail to understand what they meant.
Often this takes the following form: there is some dispute, and one side takes position A, and the other side, position B. Much later, you—reading the latter side’s works out of context—encounter position B. It seems to you to be rather absurd, and obviously wrong, so you dismiss it. But what you’re missing is that “B” should really be read as “not A”—which is to say, that the thrust of the argument is “A is wrong; the truth is really more like B”. If you knew the context, you’d agree that A is absurd; and that B is a correction in the right direction. An overcorrection? Perhaps; but that is a secondary point.
Thus you dismiss the author of B as deluded, when in fact he may have been the one sane man in a dispute filled with madmen!
(Finding examples of this dynamic is left as an exercise for the reader…)
Alief is sort of an easy one. I found for example instrumental versus terminal to be a hard one to track down the source for. I think it would be a mistake to underestimate the difficulty of tracking down a hard citation, especially if your prior is that there’s nothing to track down past a certain point. For example let’s say you believe that Scott Alexander is the originator of Motte/Bailey, thankfully if you go back to his ‘original source’ for information you’ll see that he’s clearly referencing someone elses idea and be led back. But if you believed that and he hadn’t cited his source, well this is the top search results for Motte-Bailey:
I could easily see our intrepid researcher going “oh, ratwiki is just a tertiary source no need to look at that, Scott’s post is at the top so it’s probably the canonical reference...junk underneath yeah I think we’re good”. Confirmation bias causes us to assume our best known etymology is the etymology.
For example, mathematical history is littered with examples where important concepts are named, not after the originator, but after the person who first really made good use of the concept and/or really popularized it (I particularly have in mind motte and bailey as I say this). Most mathematicians probably couldn’t tell you the originator of most of the concepts they use. This does not seem to have done much damage at all.
This isn’t an issue with using the concepts, this is an issue with being able to tap into the original research or sources of received knowledge. Previous performance predicts future performance, and places where one good idea originated probably have others you could use. It’s possible for someone to popularize one of a dozen really great ideas, but never get around to the other eleven. If we want to make full use of intellectual work it’s a good idea not to set ourselves up for that to silently happen all the time.
Confirmation bias causes us to assume our best known etymology is the etymology.
But what is the actual bad thing that happens if this happens?
Previous performance predicts future performance, and places where one good idea originated probably have others you could use.
This is not as true as it sounds if you’re selecting on previous performance as opposed to observing it; said another way, you aren’t accounting for regression to the mean.
In a model where people have some hidden “propensity to have good ideas” stat and your probability of generating a good idea at any time is some function of this stat + noise, for many plausible distributions of this stat and the noise, most good ideas will have been had by a person who has one or two good ideas, simply because there are many more people who are okay at having good ideas + get lucky than there are people who are extremely good at having good ideas.
In any case, searching for people with good ideas is only one of many things that people might want to do and I don’t see the hurry in wanting everyone to have gone through the first step or two of this process if they have other things to do.
+A bunch for running an experiment to test a hypothesis and reporting back!
That having been said, it’s not at all clear to me that this is a problem worth solving. For example, mathematical history is littered with examples where important concepts are named, not after the originator, but after the person who first really made good use of the concept and/or really popularized it (I particularly have in mind motte and bailey as I say this). Most mathematicians probably couldn’t tell you the originator of most of the concepts they use. This does not seem to have done much damage at all. (Although there’s a nearby thing that I think is quite bad, which is not having any story at all for how one might go about inventing / reinventing a concept. But there’s a huge difference between the historical story behind how something was discovered and the best way to present it pedagogically / capture the principle that generates it; Eliezer makes this point in the quantum mechanics sequence, for example.)
More concretely, suppose I want to know more about aliefs, after hearing someone talk about them in whatever context. If I just google “alief,” I’ll get to the Wikipedia article on aliefs, which has citations to papers I can read. So it’s completely irrelevant that I started out not knowing where the concept came from; the moment I google it I’ll find out.
The problem with not knowing the true origins of your concepts is that you can’t be sure whether the concept was distorted, intentionally or unintentionally by the person re-transmitting the concept to you.
For example, much of what is attributed to Clausewitz in the popular mind was actually written by Jomini, who interpreted and summarized Clausewitz’s ideas. In fact, Clausewitz actually disagreed with much of Jomini’s writing. One example is that when Clausewitz referred to political considerations in the lead up to war, he was primarily referring to internal political considerations—things like how much political capital the leadership had and whether the nation would be able to sustain the will to fight.
Jomini, however, translated Clausewitz’s dictums on politics as referring to diplomacy, that is, he took what Clausewitz was saying about internal considerations and rephrased it as being about relations between states. This was a huge distortion, one which lay undiscovered for nearly a hundred years, since Jomini was widely regarded as the authoritative translator and summarizer of Clausewitz.
History and philosophy are riddled with these kinds of distortions and misinterpretations. Just look at the varying interpretations of Nietzsche, for example, and contrast those with the source material. That’s why it’s important to know where an idea comes from. You want to be able to verify that the idea you’re receiving is the idea you think you’re receiving, rather than some related or distorted version of that idea.
Another important consideration is finding related ideas. If I can track an idea back to its original source, I can find other things that person has written, and see if they have other good ideas. I can’t do that if the original source is obscured or not cited.
1. If you understand how to regenerate a concept in an inside view way, there’s an important sense in which it really doesn’t matter who originated it, because you can correct any distortions in the concept yourself. In the same way that if you hear someone state a theorem and reprove it yourself, you can discover that they slightly misstated it and find the correct statement yourself. So it seems to me that this distortionary effect is more important the more your reasoning is outside view-flavored.
2. This all seems fine if you have an active project of seeking out good ideas, but I don’t expect everyone in the community to actively be wanting to do this as opposed to the many other things they could be wanting to do. Said another way, I don’t think you’re engaging with the opportunity cost of paying attention to this as opposed to something else.
This isn’t actually how ideas work. For one thing, this presupposes that the version of an idea which has been passed down to you is ‘correct’/its most useful version in the first place. For example, Alan Kay invented Object Oriented Programming several decades ago, and most modern computer languages implement ‘Object Oriented Programming’. The version they implement is of course significantly degraded from the version that appears in say, Smalltalk. But it’s an improvement over what existed before in C, so nobody really notices that OOP could theoretically be something better. This is a stable situation that doesn’t look like it’ll be changing anytime soon.
https://www.youtube.com/watch?v=QjJaFG63Hlo
https://www.youtube.com/watch?v=YyIQKBzIuBY
The object level argument against this of course is that Alan Kay is wrong about the utility of his original version of OOP. On such things I have no comment.
The counter-argument, of course, is that sure, maybe Alan Kay is wrong about how useful his original version of OOP is, but is everyone who ever proposed an older-but-more-advanced version of an idea always wrong about the usefulness of that idea? Do implementations never degrade from prior visions for anything but the most unimpeachable reasons of effectiveness (as opposed to, say, market pressures, or contingent historical matters, etc.)?
I think it would be absurd to take such a position. The counterexamples are legion. To maintain any such view is to ascribe, to the market (both the actual market where products are offered and sold, and the “marketplace of ideas”), a sort of definitional correctness which it manifestly does not have.
Which is all to say that I agree with this:
And I concur that this presupposition is often mistaken.
While concurring entirely, let me add another, related motivation for wanting to know the origin of your concepts (one which applies quite strongly in, for instance, both philosophy and psychology):
Many concepts, conceptual frameworks, positions, etc., are born out of disputes. Concepts do not arise in a vacuum, and writers do not write in a vacuum; they are often responding to things other people—their contemporaries—have said, or are saying.
But if you don’t know what someone was responding to, you have no hope of grasping their motivations for saying what they were saying; and consequently you’ll fail to understand what they meant.
Often this takes the following form: there is some dispute, and one side takes position A, and the other side, position B. Much later, you—reading the latter side’s works out of context—encounter position B. It seems to you to be rather absurd, and obviously wrong, so you dismiss it. But what you’re missing is that “B” should really be read as “not A”—which is to say, that the thrust of the argument is “A is wrong; the truth is really more like B”. If you knew the context, you’d agree that A is absurd; and that B is a correction in the right direction. An overcorrection? Perhaps; but that is a secondary point.
Thus you dismiss the author of B as deluded, when in fact he may have been the one sane man in a dispute filled with madmen!
(Finding examples of this dynamic is left as an exercise for the reader…)
Alief is sort of an easy one. I found for example instrumental versus terminal to be a hard one to track down the source for. I think it would be a mistake to underestimate the difficulty of tracking down a hard citation, especially if your prior is that there’s nothing to track down past a certain point. For example let’s say you believe that Scott Alexander is the originator of Motte/Bailey, thankfully if you go back to his ‘original source’ for information you’ll see that he’s clearly referencing someone elses idea and be led back. But if you believed that and he hadn’t cited his source, well this is the top search results for Motte-Bailey:
I could easily see our intrepid researcher going “oh, ratwiki is just a tertiary source no need to look at that, Scott’s post is at the top so it’s probably the canonical reference...junk underneath yeah I think we’re good”. Confirmation bias causes us to assume our best known etymology is the etymology.
This isn’t an issue with using the concepts, this is an issue with being able to tap into the original research or sources of received knowledge. Previous performance predicts future performance, and places where one good idea originated probably have others you could use. It’s possible for someone to popularize one of a dozen really great ideas, but never get around to the other eleven. If we want to make full use of intellectual work it’s a good idea not to set ourselves up for that to silently happen all the time.
But what is the actual bad thing that happens if this happens?
This is not as true as it sounds if you’re selecting on previous performance as opposed to observing it; said another way, you aren’t accounting for regression to the mean.
In a model where people have some hidden “propensity to have good ideas” stat and your probability of generating a good idea at any time is some function of this stat + noise, for many plausible distributions of this stat and the noise, most good ideas will have been had by a person who has one or two good ideas, simply because there are many more people who are okay at having good ideas + get lucky than there are people who are extremely good at having good ideas.
In any case, searching for people with good ideas is only one of many things that people might want to do and I don’t see the hurry in wanting everyone to have gone through the first step or two of this process if they have other things to do.