It does make sense, and the karma system is most assuredly untrustworthy, in the sense you mean it here. (I would say “noisy.:) Asking for feedback is also noisy, as it happens.
At some point, it becomes worthwhile to work out how to proceed given noisy and unreliable feedback.
For example, one useful principle if I think the feedback is net-reliable in the aggregate but has high variability is to damp down sensitivity to individual feedback-items and instead attend to the trend over time once it stabilizes. Conversely, if I think the feedback is unreliable even in the aggregate, it’s best to ignore it altogether.
Yeah, that’s what I try to do in the abstract. In-the-moment, the less rational parts of my brain tend to bump up urgency and try to convince me that I don’t have time to ignore the data and wait for the aggregate, and when I try to pause for reflection, those same parts of my brain tend to ratchet up the perceived urgency again and convince me that I don’t have time to examine whether I have the time to examine whether those parts of my brain are lying to me less or more than the data.
I’m working on a brainhack to mitigate that, but it’s slow going. Once I have something useful I hope to post an article on it.
those same parts of my brain tend to ratchet up the perceived urgency again and convince me that I don’t have time to examine whether I have the time to examine whether those parts of my brain are lying to me
It does make sense, and the karma system is most assuredly untrustworthy, in the sense you mean it here. (I would say “noisy.:) Asking for feedback is also noisy, as it happens.
At some point, it becomes worthwhile to work out how to proceed given noisy and unreliable feedback.
For example, one useful principle if I think the feedback is net-reliable in the aggregate but has high variability is to damp down sensitivity to individual feedback-items and instead attend to the trend over time once it stabilizes. Conversely, if I think the feedback is unreliable even in the aggregate, it’s best to ignore it altogether.
Yeah, that’s what I try to do in the abstract. In-the-moment, the less rational parts of my brain tend to bump up urgency and try to convince me that I don’t have time to ignore the data and wait for the aggregate, and when I try to pause for reflection, those same parts of my brain tend to ratchet up the perceived urgency again and convince me that I don’t have time to examine whether I have the time to examine whether those parts of my brain are lying to me less or more than the data.
I’m working on a brainhack to mitigate that, but it’s slow going. Once I have something useful I hope to post an article on it.
This is wonderfully put.