your argument seems to rely purely on the intuition of your fictional character
Yes, the dependence on intuition is definitely a weakness of this particular post. (I wish I knew as much math as Jessica Taylor! If I want to become stronger, I’ll have to figure out how fit more studying into my schedule!)
you seem to assume that categories are non-overlapping.
you seem to assume that categories are crisp rather than fuzzy
I don’t believe either of those things. If you have any specific wording suggestions on how I can write more clearly so as to better communicate to my readers that I don’t believe either of those things, I’m listening.
If you take a table made out of a block of wood, and start to gradually deform its shape until it becomes perfectly spherical, is there an exact point when it is no longer called a “table”?
But in any case, the categorization would depend on the particular trade-offs that the designers of the production line made (depending on things like, how expensive is it to run the palladium scanner)
Right. Another example of one of the things the particular algorithm-design trade-offs will depend on is the distribution of objects.
We could imagine a slightly altered parable in which the frequency distribution of objects is much more evenly spread out in color–shape–metal-content space: while cubeness has a reasonably strong correlation with redness and palladium yield, and eggness with blueness and vanadium yield, you still have a substantial fraction of non-modal objects: bluish-purple rounded cubes, reddish-purple squarish eggs, &c.
In that scenario, a natural-language summary of the optimal decision algorithm wouldn’t talk about discrete categories: you’d probably want some kind of scoring algorithm with thresholds for various tests and decisions as you describe, and no matter where you set the threshold for each decision, you’d still see a lot of objects just on either side of the boundary, with no good “joint” to anchor the placement of a category boundary.
In contrast, my reading of Yudkowsky’s original parable posits a much sparser, more tightly-clustered distribution of objects in configuration space. The objects do vary somewhat (some bleggs are purple, some rubes contain vanadium), but there’s a very clear cluster-structure: virtually all objects are close to the center of—and could be said to “belong to”—either the “rube” cluster or the “blegg” cluster, with a lot of empty space in between.
In this scenario, I think it does make sense for a natural-language summary of the optimal decision algorithm to talk about two distinct “categories” where the density in the configuration space is concentrated. Platonic essences are just the limiting case as the overlap between clusters goes to zero.
In my fanfiction, I imagine that some unknown entity has taken objects that were originally in the “rube” cluster, and modified them so that they appear, at first glance but not on closer inspection, to be members of the “blegg” cluster. At first, the protagonist wishes to respect the apparent intent of the unknown entity by considering the modified objects to be bleggs. But in the process of her sorting work, the protagonist finds herself wanting to mentally distinguish adapted bleggs from regular bleggs, because she can’t make the same job-relevant probabilistic inferences with the new “bleggs (either regular or adapted)” concept as she could with the old “bleggs (only standard bleggs)” concept.
To see why, forget about the category labels for a moment and just consider the clusters in the six-dimensional color–shape–texture–firmness–luminesence–metal-content configuration space.
Before the unknown entity’s intervention, we had two distinct clusters: one centered at {blue, egg, furry, flexible, luminescent, vanadium}, and another centered at {red, cube, smooth, hard, non-luminescent, palladium}.
After the unknown entity’s intervention, we have three distinct clusters: the two previously-existing clusters, and a new cluster centered at {blue, egg, furry, hard, non-luminescent, palladium}. This is a different situation! Workers on the sorting line might want different language in order to describe this new reality!
Now, if we were to project into the three-dimensional color–shape–texture subspace, then we would have two clusters again: with just these attributes, we can’t distinguish between bleggs and adapted bleggs. But since workers on the sorting line can observe hardness, and care about metal content, they probably want to use the three-cluster representation, even if they suspect the unknown entity might thereby feel disrespected.
Hmm. Why would the entity feel disrespected by how many clusters the workers use? I actually am aware that this is an allegory for something else. Moreover, I think that I disagree you with about the something else (although I am not sure since I am not entirely sure what’s your position about the something else is). Which is to say, I think that this allegory misses crucial aspects of the original situation and loses the crux of the debate.
I think that this allegory misses crucial aspects of the original situation
That makes sense! As gjm noted, sometimes unscrupulous authors sneakily construct an allegory with the intent of leading the reader to a particular conclusion within the context of the allegory with the hope that the reader will map that conclusion back onto the real-world situation in a particular way, without doing the work of actually showing that the allegory and the real-world situation are actually analogous in the relevant aspects.
I don’t want to be guilty of that! This is a story about bleggs and rubes that I happened to come up with in the context of trying to think about something else (and I don’t want to be deceptive about that historical fact), but I definitely agree that people shouldn’t map the story onto some other situation unless they actually have a good argument for why that mapping makes sense. If we wanted to discuss the something else rather than the bleggs and rubes, we should do that on someone else’s website. Not here.
I mean, yes, there’s the allusion in the title! (The post wasn’t originally written for being shared on Less Wrong, it just seemed sufficiently sanitized to be shareable-here-without-running-too-afoul-of-anti-politics-norms after the fact.)
I read the title as just an allusion to Eliezer’s OP on bleggs and rubes. (Otoh, without having read the article just linked, I’m familiar with “egg” as transsexual jargon for someone exploring TS feelings, who (the ideology has it) will inevitably in the end “hatch” into a full-on TS.)
Yes, the dependence on intuition is definitely a weakness of this particular post. (I wish I knew as much math as Jessica Taylor! If I want to become stronger, I’ll have to figure out how fit more studying into my schedule!)
I don’t believe either of those things. If you have any specific wording suggestions on how I can write more clearly so as to better communicate to my readers that I don’t believe either of those things, I’m listening.
No, there is no such exact point; like many longtime Less Wrong readers, I, too, am familiar with the Sorities paradox.
Right. Another example of one of the things the particular algorithm-design trade-offs will depend on is the distribution of objects.
We could imagine a slightly altered parable in which the frequency distribution of objects is much more evenly spread out in color–shape–metal-content space: while cubeness has a reasonably strong correlation with redness and palladium yield, and eggness with blueness and vanadium yield, you still have a substantial fraction of non-modal objects: bluish-purple rounded cubes, reddish-purple squarish eggs, &c.
In that scenario, a natural-language summary of the optimal decision algorithm wouldn’t talk about discrete categories: you’d probably want some kind of scoring algorithm with thresholds for various tests and decisions as you describe, and no matter where you set the threshold for each decision, you’d still see a lot of objects just on either side of the boundary, with no good “joint” to anchor the placement of a category boundary.
In contrast, my reading of Yudkowsky’s original parable posits a much sparser, more tightly-clustered distribution of objects in configuration space. The objects do vary somewhat (some bleggs are purple, some rubes contain vanadium), but there’s a very clear cluster-structure: virtually all objects are close to the center of—and could be said to “belong to”—either the “rube” cluster or the “blegg” cluster, with a lot of empty space in between.
In this scenario, I think it does make sense for a natural-language summary of the optimal decision algorithm to talk about two distinct “categories” where the density in the configuration space is concentrated. Platonic essences are just the limiting case as the overlap between clusters goes to zero.
In my fanfiction, I imagine that some unknown entity has taken objects that were originally in the “rube” cluster, and modified them so that they appear, at first glance but not on closer inspection, to be members of the “blegg” cluster. At first, the protagonist wishes to respect the apparent intent of the unknown entity by considering the modified objects to be bleggs. But in the process of her sorting work, the protagonist finds herself wanting to mentally distinguish adapted bleggs from regular bleggs, because she can’t make the same job-relevant probabilistic inferences with the new “bleggs (either regular or adapted)” concept as she could with the old “bleggs (only standard bleggs)” concept.
To see why, forget about the category labels for a moment and just consider the clusters in the six-dimensional color–shape–texture–firmness–luminesence–metal-content configuration space.
Before the unknown entity’s intervention, we had two distinct clusters: one centered at {blue, egg, furry, flexible, luminescent, vanadium}, and another centered at {red, cube, smooth, hard, non-luminescent, palladium}.
After the unknown entity’s intervention, we have three distinct clusters: the two previously-existing clusters, and a new cluster centered at {blue, egg, furry, hard, non-luminescent, palladium}. This is a different situation! Workers on the sorting line might want different language in order to describe this new reality!
Now, if we were to project into the three-dimensional color–shape–texture subspace, then we would have two clusters again: with just these attributes, we can’t distinguish between bleggs and adapted bleggs. But since workers on the sorting line can observe hardness, and care about metal content, they probably want to use the three-cluster representation, even if they suspect the unknown entity might thereby feel disrespected.
Hmm. Why would the entity feel disrespected by how many clusters the workers use? I actually am aware that this is an allegory for something else. Moreover, I think that I disagree you with about the something else (although I am not sure since I am not entirely sure what’s your position about the something else is). Which is to say, I think that this allegory misses crucial aspects of the original situation and loses the crux of the debate.
That makes sense! As gjm noted, sometimes unscrupulous authors sneakily construct an allegory with the intent of leading the reader to a particular conclusion within the context of the allegory with the hope that the reader will map that conclusion back onto the real-world situation in a particular way, without doing the work of actually showing that the allegory and the real-world situation are actually analogous in the relevant aspects.
I don’t want to be guilty of that! This is a story about bleggs and rubes that I happened to come up with in the context of trying to think about something else (and I don’t want to be deceptive about that historical fact), but I definitely agree that people shouldn’t map the story onto some other situation unless they actually have a good argument for why that mapping makes sense. If we wanted to discuss the something else rather than the bleggs and rubes, we should do that on someone else’s website. Not here.
FWIW, I predicted it would be an allegory of transsexuality even before I read it or any of the comments.
I mean, yes, there’s the allusion in the title! (The post wasn’t originally written for being shared on Less Wrong, it just seemed sufficiently sanitized to be shareable-here-without-running-too-afoul-of-anti-politics-norms after the fact.)
I read the title as just an allusion to Eliezer’s OP on bleggs and rubes. (Otoh, without having read the article just linked, I’m familiar with “egg” as transsexual jargon for someone exploring TS feelings, who (the ideology has it) will inevitably in the end “hatch” into a full-on TS.)