Hm, I’m not sure I follow how this is an objection to the quoted text. Agreed, it’ll use bits of the context to modify its predictions. But when the context is minimal (as it was in all of my prompts, and in many other examples where it’s smart), it clearly has a default, and the question is what we can learn from that default.
Clearly that default behaves as if it is much smarter and clearer than the median internet user. Ask it to draw a tikz diagram, and it’ll perform better than 99% of humans. Ask it about the Linda problem, and it’ll perform the conjunction fallacy. I was arguing that that is mildly surprising, if you think that the conjunction fallacy is something that 80% of humans get “wrong” (and, remember, 20% get “right”).
Where does the fact that it can be primed to speak differently disrupt that reasoning?
Hm, I’m not sure I follow how this is an objection to the quoted text. Agreed, it’ll use bits of the context to modify its predictions. But when the context is minimal (as it was in all of my prompts, and in many other examples where it’s smart), it clearly has a default, and the question is what we can learn from that default.
Clearly that default behaves as if it is much smarter and clearer than the median internet user. Ask it to draw a tikz diagram, and it’ll perform better than 99% of humans. Ask it about the Linda problem, and it’ll perform the conjunction fallacy. I was arguing that that is mildly surprising, if you think that the conjunction fallacy is something that 80% of humans get “wrong” (and, remember, 20% get “right”).
Where does the fact that it can be primed to speak differently disrupt that reasoning?