Get people to give 90% confidence intervals on 10 questions, and then at the end ask
“Ok, so who got all 10 within their intervals. 9? That’s what you should have got… ok, 8? Still no-one? Ok, how about 7?”
90% might not be the best number for demonstrating the idea of a confidence interval. It’s too close to 100%. There’s not much room to be underconfident. What about 50% confidence intervals?
Have you tried it? I have, and I can tell you most people I tried it on are over-confident when asked for 90% intervals.
Current theme: default
Less Wrong (text)
Less Wrong (link)
Arrow keys: Next/previous image
Escape or click: Hide zoomed image
Space bar: Reset image size & position
Scroll to zoom in/out
(When zoomed in, drag to pan; double-click to close)
Keys shown in yellow (e.g., ]) are accesskeys, and require a browser-specific modifier key (or keys).
]
Keys shown in grey (e.g., ?) do not require any modifier keys.
?
Esc
h
f
a
m
v
c
r
q
t
u
o
,
.
/
s
n
e
;
Enter
[
\
k
i
l
=
-
0
′
1
2
3
4
5
6
7
8
9
→
↓
←
↑
Space
x
z
`
g
Get people to give 90% confidence intervals on 10 questions, and then at the end ask
“Ok, so who got all 10 within their intervals. 9? That’s what you should have got… ok, 8? Still no-one? Ok, how about 7?”
90% might not be the best number for demonstrating the idea of a confidence interval. It’s too close to 100%. There’s not much room to be underconfident. What about 50% confidence intervals?
Have you tried it? I have, and I can tell you most people I tried it on are over-confident when asked for 90% intervals.