Is this because of the “damn it, I know I made a mistake, you telling me I did doesn’t help!” effect?
No, I react the same way whether I was previously aware of my mistake or not. I only experience that effect when I’m told to do something I am already doing.
A good thought experiment is that if I was making a type of mistake that I couldn’t automatically tell I was making on my own, I would prefer it to be pointed out, even if not in a concise detailed fashion–the idea of not knowing that I’m making a mistake is kind of scary. What would your reaction be in that situation?
Pragmatically, we as humans, just barely over the threshold into sapient intelligence, make mistakes we’re not aware of constantly. If we didn’t, we wouldn’t need a superintelligence to fix the world; we’d have already done it ourselves. So finding the concept scary seems kind of pointless.(Sort of like being hydrophobic about the water in one’s own body.) However, I would, of course, rather be aware of my mistakes than not.
But none of this is really on the topic, which was that the listed reinforcements don’t seem even remotely applicable to humans in a universal way.
So finding the concept scary seems kind of pointless. However, I would, of course, rather be aware of my mistakes than not.
My actions have impacts on others. In general, I prefer to help other people or at least not harm them–however, I may harm someone by mistake, and I really don’t want this to happen. If I make a mistake once and I realize it–fine, hopefully no harm done, I won’t do it again. If I make a mistake and I don’t know about it, well, maybe no harm done that time in particular, but I’m likely to keep making this mistake over and over, and possibly the first time I’ll find out is when there is harm done. I think that justifies finding it scary.
No, I react the same way whether I was previously aware of my mistake or not. I only experience that effect when I’m told to do something I am already doing.
Pragmatically, we as humans, just barely over the threshold into sapient intelligence, make mistakes we’re not aware of constantly. If we didn’t, we wouldn’t need a superintelligence to fix the world; we’d have already done it ourselves. So finding the concept scary seems kind of pointless.(Sort of like being hydrophobic about the water in one’s own body.) However, I would, of course, rather be aware of my mistakes than not.
But none of this is really on the topic, which was that the listed reinforcements don’t seem even remotely applicable to humans in a universal way.
My actions have impacts on others. In general, I prefer to help other people or at least not harm them–however, I may harm someone by mistake, and I really don’t want this to happen. If I make a mistake once and I realize it–fine, hopefully no harm done, I won’t do it again. If I make a mistake and I don’t know about it, well, maybe no harm done that time in particular, but I’m likely to keep making this mistake over and over, and possibly the first time I’ll find out is when there is harm done. I think that justifies finding it scary.