This might be useful at a certain age. But for younger children, that just isn’t reasonable. They don’t have the development to understand that. For example, here is the basic script of the “False Belief” Test, that shows a lack of Theory of Mind.
Tester: [presents crayon box] What do you think is inside? Child (2-3 year old): Crayons! Tester: [opens box. shows that there are birthday candles inside box] Oh, look! What is actually inside the box? Child: birthday candles! Tester: [closes box] Before I opened the box, what did you think was inside the box? Child: Birthday candles! Tester: Your mom is outside the room. If she came in, and we showed her this [closed] box, what would your Mom think was inside the box? Child: Birthday candles!
So good luck getting them to actually understand cognitive biases!
what if… you told them, “Don’t believe what I say just because I tell you that you believe it.”
Then you are doing the exact same thing I am advocating for. You are manipulating their mind (by telling them what you want them to believe) to result in a positive outcome.
Does the child respond that way because they have no theory of mind, or because they don’t parse the questions well and are just hearing, “blah blah blah what’s inside the box?” (this interpretation still supports your point, this is just something I always wonder about when I hear that chlidren have no theory of mind.)
I would say that it is definitely that they do not have the cognitive/developmental abilities. There are MANY experiments, showing various fallacies at various ages. Here are some other examples:
Another possibility is a lack of sequencing events in time: if you’re not separating “what I see right now” from “what I thought before” consistently, you’re going to come up with funny answers.
I can’t pass the Sally-Ann tests, even now. The language confuses me. But I do know, now, that other people have minds, and they can think with them. About whatever they want. About me.
I don’t at all see how you can think that is a constructive comment. Downvoting.
Also, the quote you posted is from a non-neurotypical author. Saying that people with Autism (or other disorders) have trouble with the tests does not mean that they tests are “crap.” It more likely means that non-NTs have trouble with the concepts being tested, or with the testing methodologies.
The tests in question were designed to make autistics fail and defined as tests of theory of mind. Anyone even vaguely familiar with this will be very annoyed and likely to say things like “this test is crap” because it’s worthless at what it was ostensibly designed for.
Let me explain that again so you definitely understand why this makes people angry:
Scientists wanted to be able to test autistics’ theory of mind.
Scientists designed a test autistics failed and neurotypicals passed.
Scientists called it a test of theory of mind.
Scientists defined theory of mind ability as passing this test.
Scientists claimed that autistics lack empathy.
Scientists also claimed that sociopaths lack empathy.
Some people got a little confused here, leading to some terrible misconceptions that have caused a LOT of harm.
Do you want links to show this really happened this way?
I have not heard this interpretation of the tests in question and I also did not have much prior knowledge of what exactly the tests hoped to prove and the subsequent conclusions, so I would greatly appreciate any links you could provide that may cause me to update my beliefs.
Specifically, I find both your explanation and the more mainstream explanation (something like http://en.wikipedia.org/wiki/Sally%E2%80%93Anne_test) plausible, so non-trivial evidence would lead me to put more certainty in a ‘position’.
so non-trivial evidence would lead me to put more certainty in a ‘position’.
Because this particular test is getting a lot of (possibly earned) flak right now, I think it would be useful for people to actually SEE this test in action. I don’t know if this is considered “trivial”, but to me watching these tests is decent evidence that it is testing Theory of Mind as much as, if not more than, language skills.
Here is a TED talk on the subject. The entire talk is on the subject, but the part with the experiments is at 3:55- 7:30 . This experiment goes on to show that event though Theory of Mind is understood at age 4, that it’s not until age 7 that it is used to decide moral judgements. (If the pirate ate the wrong sandwich because his got moved without his knowledge, is he being naughty/should he be punished?)
In this video the three year old is at the stage where she realizes that she USED to think that crayons were in the box, so she is starting to learn Theory of Mind. She still gets the second question wrong though. This is because this isn’t a concept that one day you don’t have, and all of a sudden you get it. Learning ToM is a process that takes time.
Finally, here is one that shows not understanding other’s point of view.
I don’t know the history of these tests, so I will concede the point that perhaps these tests are used on non-NT’s in a negative way, and that perhaps they were designed with some nefarious purpose of judging non-NTs.
However saying that because of this fact that these tests are “crap” is like saying that because people die in car accidents, that therefore cars are “crap”. I think the test can be BOTH useful in demonstrating Theory of Mind that occurs in children 4 and under AND that the test can (possibly) be used in a negative way with non-NTs.
Perhaps to pass the test you need BOTH Theory of Mind, AND language skills at a 4 year-old level.
Even if it is just language skills, it still stands to reason to me, that if a child can’t pass the test, that you won’t be able to explain cognitive biases to them with any great success. (I am sure you could teach them the “Teacher’s Passcode”.) That is the reason I posted the test, and I think whether or not I am completely wrong on WHAT it tests, that the test still stands as good evidence supporting the claim I was making (can’t teach them abstract material).
And I didn’t even have to use this test specifically. I just wanted to show any example of the fact that children’s minds don’t operate on a developed enough level to yet understand abstract ideas.
Anyone even vaguely familiar with this will be very annoyed and likely to say things like “this test is crap”
You are using this as if it should EXCUSE the extremely rude grandparent comment, when instead it is an EXPLANATION. The two are not the same. You can explain bad behavior, without considering it an excuse.
Example- “I am late because I overslept” is an explanation not an excuse. “I am late because my car got a flat” is an acceptable excuse.
Though I didn’t know the details, I already understood from the tone and the link, that the grandparent had some personal grudge/negative feelings towards the test in question. I assume it has been used on him/her to negative effect. I would guess, from your knowledge of this test, that it has also been used negatively on you or one of your loved ones. I am very sorry about this for the both of you. But that does not mean that it is an excuse to then leave rude and cryptic remarks, as the grandparent did.
Here’s a person who obviously has theory of mind. She fails the test. Thus the test isn’t testing whether someone has theory of mind.
Sure, maybe autistic people are special exceptions and the test usually works. But how do we know that? If we meet another false negative, we can always just add another special exception. (Well, “they were designed to justify saying autistics lack empathy” would explain why they would usually work but fail precisely for them.) Is there any group other than “people who go around saying ‘I have theory of mind’” for whom we can verify the test result using another method?
Here’s a person who obviously has theory of mind. She fails the test. Thus the test isn’t testing whether someone has theory of mind.
The test succeeds at identifying something important that most people consider obvious, but that (surprisingly) some people fail at. Whether the something that the test measures is best called “theory of mind” is debatable, but I’m not sure there is a better name that would have stuck.
Having names for things is useful for thinking about them, as long as the focus is on the thing (“how could we call the thing this test measures”), and not on the name (“how could we design a test for the presence of a theory of mind?”). There’s a delicate balance to reach between avoiding sneaking in connotations (“let’s call it the Soul Test!”), and not having obscure names that don’t suggest anything (“let’s call it Plasmeomorphic Synchronism!”). I don’t see any reason to think that they struck a particularly bad balance in this case.
daenerys is building an explanation for children’s behaviour based on the premise that children can’t have a model of the world that contains a person being wrong about a fact. I’m saying the test doesn’t show that they can’t.
I was responding more to your “This test is crap” and subsequent explanations—though I’d consider “children can’t have a model of the world that contains a person being wrong about a fact” as a reasonable first approximation for young enough children.
Because it doesn’t have a specificity of 1, or another reason? Even if we are judging the test based on just this datapoint, it seems to me the author has difficulty manipulating their mental model of others’ minds, to the point where their inability to pass the Sally-Anne tests is informative.
Because it works better as a test of language ability. People can model others’ minds but get lost in the many clauses. (Higher levels increase difficulty by increasing number of clauses and difficulty of phrasing.)
This is common knowledge in the autistic community, but I hardly blame you for not knowing it. Most people don’t, unless all their friends are autistic or Aspies.
Because it works better as a test of language ability. People can model others’ minds but get lost in the many clauses.
That sounds plausible, but how would you determine that it’s language ability specifically that’s causing the issue? Do they pass the basic Sally-Anne test (“Where will Sally look for her marble?”) but fail more complicated versions? Do they pass clear versions but not wordy versions (passing “Where will Sally look for her marble?” but failing “Where would Sally tell us she believes the marble is?”)?
It seems to me that language failure could be because of theory of mind failure. For example, if I’m trying to trick someone trying to trick me, what I think he thinks I think he thinks is an unconsciously constructed object in my mental model. Describing it is a little tricky because there’s not a single word for it, but making predictions / planning actions based on it is not difficult. If someone doesn’t have that in their mental model, but has to construct it, then it seems to me the first place they’ll notice difficulty is parsing the question- they look inside for something with the tag “what I think he thinks I think he thinks,” find nothing, and conclude they probably didn’t hear / parse it correctly. But, this is speculation by a non-psychologist, and so evidence-driven opinions are more welcome.
Yes, people who pass the basic test fail on tests with more complicated language structures. (Hint: when your test is so poorly-designed that you can’t even be certain whether you’re testing a concept that exists, and even given that you are, whether your test is testing it, the test is crap even if it’s not biased against the people you purport to study.)
You have normal theory of mind, I would assume. This includes recursive theory of mind (I know you know I know). Do you think that you could still be confused by “Sally thinks that Harry thinks that Sally thinks that I think that Sally thinks that whatever” or something similar?
when your test is so poorly-designed that you can’t even be certain whether you’re testing a concept that exists, and even given that you are, whether your test is testing it, the test is crap even if it’s not biased against the people you purport to study.
It’s not my test, and I can’t comment on the certainty of people who devised it / administer it today, whose opinions I suspect are more informed than mine.
Do you think that you could still be confused by “Sally thinks that Harry thinks that Sally thinks that I think that Sally thinks that whatever” or something similar?
If spoken too quickly, sure. If the test were written (or spoken slowly), I think I would give the right answer to 6th order questions at least 90% of the time.
The paper they link to (here) doesn’t seem to be as strong as they present it in the post. I certainly agree that Baron-Cohen’s claim that ToM can’t be learned sounds wrong, unless he’s arguing about brain structure rather than performance (that is, they can learn how to answer the questions correctly but never as easily as a neurotypical).
I also followed the citation trail to come across this paper, which included picture-based tests. An example: A green apple was placed in front of the subject and they were given a green marker (with red ink). They drew the apple someplace they couldn’t see, and then the researcher put an identical red apple next to the green apple, then showed them their drawing, and asked “Which of these apples were you trying to draw?” and “When X enters the room, which apple will they think you were trying to draw?”
They tested normal 4 year-olds and deaf or autistic children (5 to 13, average age 9) on the false drawing task and a standard false belief task (what’s in the box? Not what’s on the label! What will X think is in the box? What did you think was in the box before I opened it?). The normals mostly passed the standard test and mostly failed the false drawing task; the deaf or autistic mostly failed the standard test and mostly passed the false drawing task. (Normal children of age average 9 were not tested; I presume they would mostly pass both tests.)
I now have a much better idea of what a non-verbal false belief test would look like, but I still think both varieties of test are useful at identifying ToM delays / deficiencies. That the normal 4 year olds do poorly on the pictorial false-belief tests suggests to me that it also is not just testing ToM, but something else as well.
This might be useful at a certain age. But for younger children, that just isn’t reasonable. They don’t have the development to understand that. For example, here is the basic script of the “False Belief” Test, that shows a lack of Theory of Mind.
Tester: [presents crayon box] What do you think is inside?
Child (2-3 year old): Crayons!
Tester: [opens box. shows that there are birthday candles inside box] Oh, look! What is actually inside the box?
Child: birthday candles!
Tester: [closes box] Before I opened the box, what did you think was inside the box?
Child: Birthday candles!
Tester: Your mom is outside the room. If she came in, and we showed her this [closed] box, what would your Mom think was inside the box?
Child: Birthday candles!
So good luck getting them to actually understand cognitive biases!
Then you are doing the exact same thing I am advocating for. You are manipulating their mind (by telling them what you want them to believe) to result in a positive outcome.
Does the child respond that way because they have no theory of mind, or because they don’t parse the questions well and are just hearing, “blah blah blah what’s inside the box?” (this interpretation still supports your point, this is just something I always wonder about when I hear that chlidren have no theory of mind.)
I would say that it is definitely that they do not have the cognitive/developmental abilities. There are MANY experiments, showing various fallacies at various ages. Here are some other examples:
Lack Conservation
Formal Operation
I’d read about those things before, but the videos were still cool, thanks.
Another possibility is a lack of sequencing events in time: if you’re not separating “what I see right now” from “what I thought before” consistently, you’re going to come up with funny answers.
This test is crap.
From Just Stimming
I don’t at all see how you can think that is a constructive comment. Downvoting.
Also, the quote you posted is from a non-neurotypical author. Saying that people with Autism (or other disorders) have trouble with the tests does not mean that they tests are “crap.” It more likely means that non-NTs have trouble with the concepts being tested, or with the testing methodologies.
The tests in question were designed to make autistics fail and defined as tests of theory of mind. Anyone even vaguely familiar with this will be very annoyed and likely to say things like “this test is crap” because it’s worthless at what it was ostensibly designed for.
Let me explain that again so you definitely understand why this makes people angry: Scientists wanted to be able to test autistics’ theory of mind. Scientists designed a test autistics failed and neurotypicals passed. Scientists called it a test of theory of mind. Scientists defined theory of mind ability as passing this test. Scientists claimed that autistics lack empathy. Scientists also claimed that sociopaths lack empathy. Some people got a little confused here, leading to some terrible misconceptions that have caused a LOT of harm.
Do you want links to show this really happened this way?
I have not heard this interpretation of the tests in question and I also did not have much prior knowledge of what exactly the tests hoped to prove and the subsequent conclusions, so I would greatly appreciate any links you could provide that may cause me to update my beliefs.
Specifically, I find both your explanation and the more mainstream explanation (something like http://en.wikipedia.org/wiki/Sally%E2%80%93Anne_test) plausible, so non-trivial evidence would lead me to put more certainty in a ‘position’.
Because this particular test is getting a lot of (possibly earned) flak right now, I think it would be useful for people to actually SEE this test in action. I don’t know if this is considered “trivial”, but to me watching these tests is decent evidence that it is testing Theory of Mind as much as, if not more than, language skills.
Here is a TED talk on the subject. The entire talk is on the subject, but the part with the experiments is at 3:55- 7:30 . This experiment goes on to show that event though Theory of Mind is understood at age 4, that it’s not until age 7 that it is used to decide moral judgements. (If the pirate ate the wrong sandwich because his got moved without his knowledge, is he being naughty/should he be punished?)
In this video the three year old is at the stage where she realizes that she USED to think that crayons were in the box, so she is starting to learn Theory of Mind. She still gets the second question wrong though. This is because this isn’t a concept that one day you don’t have, and all of a sudden you get it. Learning ToM is a process that takes time.
Finally, here is one that shows not understanding other’s point of view.
I don’t know the history of these tests, so I will concede the point that perhaps these tests are used on non-NT’s in a negative way, and that perhaps they were designed with some nefarious purpose of judging non-NTs.
However saying that because of this fact that these tests are “crap” is like saying that because people die in car accidents, that therefore cars are “crap”. I think the test can be BOTH useful in demonstrating Theory of Mind that occurs in children 4 and under AND that the test can (possibly) be used in a negative way with non-NTs.
Perhaps to pass the test you need BOTH Theory of Mind, AND language skills at a 4 year-old level.
Even if it is just language skills, it still stands to reason to me, that if a child can’t pass the test, that you won’t be able to explain cognitive biases to them with any great success. (I am sure you could teach them the “Teacher’s Passcode”.) That is the reason I posted the test, and I think whether or not I am completely wrong on WHAT it tests, that the test still stands as good evidence supporting the claim I was making (can’t teach them abstract material).
And I didn’t even have to use this test specifically. I just wanted to show any example of the fact that children’s minds don’t operate on a developed enough level to yet understand abstract ideas.
You are using this as if it should EXCUSE the extremely rude grandparent comment, when instead it is an EXPLANATION. The two are not the same. You can explain bad behavior, without considering it an excuse.
Example- “I am late because I overslept” is an explanation not an excuse. “I am late because my car got a flat” is an acceptable excuse.
Though I didn’t know the details, I already understood from the tone and the link, that the grandparent had some personal grudge/negative feelings towards the test in question. I assume it has been used on him/her to negative effect. I would guess, from your knowledge of this test, that it has also been used negatively on you or one of your loved ones. I am very sorry about this for the both of you. But that does not mean that it is an excuse to then leave rude and cryptic remarks, as the grandparent did.
Here’s a person who obviously has theory of mind. She fails the test. Thus the test isn’t testing whether someone has theory of mind.
Sure, maybe autistic people are special exceptions and the test usually works. But how do we know that? If we meet another false negative, we can always just add another special exception. (Well, “they were designed to justify saying autistics lack empathy” would explain why they would usually work but fail precisely for them.) Is there any group other than “people who go around saying ‘I have theory of mind’” for whom we can verify the test result using another method?
The test succeeds at identifying something important that most people consider obvious, but that (surprisingly) some people fail at. Whether the something that the test measures is best called “theory of mind” is debatable, but I’m not sure there is a better name that would have stuck.
Having names for things is useful for thinking about them, as long as the focus is on the thing (“how could we call the thing this test measures”), and not on the name (“how could we design a test for the presence of a theory of mind?”). There’s a delicate balance to reach between avoiding sneaking in connotations (“let’s call it the Soul Test!”), and not having obscure names that don’t suggest anything (“let’s call it Plasmeomorphic Synchronism!”). I don’t see any reason to think that they struck a particularly bad balance in this case.
daenerys is building an explanation for children’s behaviour based on the premise that children can’t have a model of the world that contains a person being wrong about a fact. I’m saying the test doesn’t show that they can’t.
I was responding more to your “This test is crap” and subsequent explanations—though I’d consider “children can’t have a model of the world that contains a person being wrong about a fact” as a reasonable first approximation for young enough children.
Because it doesn’t have a specificity of 1, or another reason? Even if we are judging the test based on just this datapoint, it seems to me the author has difficulty manipulating their mental model of others’ minds, to the point where their inability to pass the Sally-Anne tests is informative.
Because it works better as a test of language ability. People can model others’ minds but get lost in the many clauses. (Higher levels increase difficulty by increasing number of clauses and difficulty of phrasing.)
This is common knowledge in the autistic community, but I hardly blame you for not knowing it. Most people don’t, unless all their friends are autistic or Aspies.
That sounds plausible, but how would you determine that it’s language ability specifically that’s causing the issue? Do they pass the basic Sally-Anne test (“Where will Sally look for her marble?”) but fail more complicated versions? Do they pass clear versions but not wordy versions (passing “Where will Sally look for her marble?” but failing “Where would Sally tell us she believes the marble is?”)?
It seems to me that language failure could be because of theory of mind failure. For example, if I’m trying to trick someone trying to trick me, what I think he thinks I think he thinks is an unconsciously constructed object in my mental model. Describing it is a little tricky because there’s not a single word for it, but making predictions / planning actions based on it is not difficult. If someone doesn’t have that in their mental model, but has to construct it, then it seems to me the first place they’ll notice difficulty is parsing the question- they look inside for something with the tag “what I think he thinks I think he thinks,” find nothing, and conclude they probably didn’t hear / parse it correctly. But, this is speculation by a non-psychologist, and so evidence-driven opinions are more welcome.
Yes, people who pass the basic test fail on tests with more complicated language structures. (Hint: when your test is so poorly-designed that you can’t even be certain whether you’re testing a concept that exists, and even given that you are, whether your test is testing it, the test is crap even if it’s not biased against the people you purport to study.)
You have normal theory of mind, I would assume. This includes recursive theory of mind (I know you know I know). Do you think that you could still be confused by “Sally thinks that Harry thinks that Sally thinks that I think that Sally thinks that whatever” or something similar?
http://www.staff.ncl.ac.uk/daniel.nettle/liddlenettle.pdf Feel free to draw your own conclusions from an actual study using a theory of mind test. Here’s a critique of it: http://www.wrongplanet.net/postp3314609.html#3314609
This is a critique of the test in its usual usage, which isn’t for neurologically normal three-year-olds.
It’s not my test, and I can’t comment on the certainty of people who devised it / administer it today, whose opinions I suspect are more informed than mine.
If spoken too quickly, sure. If the test were written (or spoken slowly), I think I would give the right answer to 6th order questions at least 90% of the time.
The paper they link to (here) doesn’t seem to be as strong as they present it in the post. I certainly agree that Baron-Cohen’s claim that ToM can’t be learned sounds wrong, unless he’s arguing about brain structure rather than performance (that is, they can learn how to answer the questions correctly but never as easily as a neurotypical).
I also followed the citation trail to come across this paper, which included picture-based tests. An example: A green apple was placed in front of the subject and they were given a green marker (with red ink). They drew the apple someplace they couldn’t see, and then the researcher put an identical red apple next to the green apple, then showed them their drawing, and asked “Which of these apples were you trying to draw?” and “When X enters the room, which apple will they think you were trying to draw?”
They tested normal 4 year-olds and deaf or autistic children (5 to 13, average age 9) on the false drawing task and a standard false belief task (what’s in the box? Not what’s on the label! What will X think is in the box? What did you think was in the box before I opened it?). The normals mostly passed the standard test and mostly failed the false drawing task; the deaf or autistic mostly failed the standard test and mostly passed the false drawing task. (Normal children of age average 9 were not tested; I presume they would mostly pass both tests.)
I now have a much better idea of what a non-verbal false belief test would look like, but I still think both varieties of test are useful at identifying ToM delays / deficiencies. That the normal 4 year olds do poorly on the pictorial false-belief tests suggests to me that it also is not just testing ToM, but something else as well.