and that since there continue to be horrible things happening in the world, they must have evil intentions and be a partly-demonic entity.
Did you conclude this entirely because there continue to be horrible things happening in the world, or was this based on other reflective information that was consistent with horrible things happening in the world too?
I imagine that this conclusion must at least be partly based on latent personality factors as well. But if so, I’m very curious as to how these things jive with your desire to be heroically responsible at the same time. E.g., how do evil intentions predict your other actions and intentions regarding AI-risk and wanting to avert the destruction of the world?
It wasn’t just that, it was also based on thinking I had more control over other people than I realistically had. Probably it is partly latent personality factors. But a heroic responsibility mindset will tend to cause people to think other people’s actions are their fault if they could, potentially, have affected them through any sort of psychological manipulation (see also, Against Responsibility).
I think I thought I was working on AI risk but wasn’t taking heroic responsibility because I wasn’t owning the whole problem. People around me encouraged me to take on more responsibility and actually optimize on the world as a consequentialist agent. I subsequently felt very bad that I had taken on responsibilities for solving AI safety that I could not deliver on. I also felt bad that maybe because I wrote some blog posts online criticizing “rationalists” that that would lead to the destruction of the world and that would be my fault.
This is cool because what you’re saying has useful information pertinent to model updates regardless of how I choose to model your internal state.
Here’s why it’s really important:
You seem to have been motivated to classify your own intentions as “evil” at some point, based entirely on things that were not entirely under your own control.
That points to your social surroundings as having pressured you to come to that conclusion (I am not sure it is very likely that you would have come to that conclusion on your own, without any social pressure).
So that brings us to the next question: Is it more likely that you are evil, or rather, that your social surroundings were / are?
I think those are hard to separate. Bad social circumstances can make people act badly. There’s the “hurt people hurt people” truism and numerous examples of people being caused to act morally worse by their circumstances e.g. in war. I do think I have gone through extraordinary measures to understand the ways in which I act badly (often in response to social cues) and to act more intentionally well.
Yes, but the point is that we’re trying to determine if you are under “bad” social circumstances or not. Those circumstances will not be independent from other aspects of the social group, e.g. the ideology it espouses externally and things it tells its members internally.
What I’m trying to figure out is to what extent you came to believe you were “evil” on your own versus you were compelled to think that about yourself. You were and are compelled to think about ways in which you act “badly”—nearby or adjacent to a community that encourages its members to think about how to act “goodly.” It’s not a given, per se, that a community devoted explicitly to doing good in the world thinks that it should label actions as “bad” if they fall short of arbitrary standards. It could, rather, decide to label actions people take as “good” or “gooder” or “really really good” if it decides that most functional people are normally inclined to behave in ways that aren’t necessarily un-altruistic or harmful to other people.
I’m working on a theory of social-group-dynamics which posits that your situation is caused by “negative-selection groups” or “credential-groups” which are characterized by their tendency to label only their activities as actually successfully accomplishing whatever it is they claim to do—e.g., “rationality” or “effective altruism.” If it seems like the group’s ideology or behavior implies that non-membership is tantamount to either not caring about doing well or being incompetent in that regard, then it is a credential-group.
Credential-groups are bad social circumstances, and in a nutshell, they act badly by telling members who they know not to be intentionally causing harm that they are harmful or bad people (or mentally ill).
Did you conclude this entirely because there continue to be horrible things happening in the world, or was this based on other reflective information that was consistent with horrible things happening in the world too?
I imagine that this conclusion must at least be partly based on latent personality factors as well. But if so, I’m very curious as to how these things jive with your desire to be heroically responsible at the same time. E.g., how do evil intentions predict your other actions and intentions regarding AI-risk and wanting to avert the destruction of the world?
It wasn’t just that, it was also based on thinking I had more control over other people than I realistically had. Probably it is partly latent personality factors. But a heroic responsibility mindset will tend to cause people to think other people’s actions are their fault if they could, potentially, have affected them through any sort of psychological manipulation (see also, Against Responsibility).
I think I thought I was working on AI risk but wasn’t taking heroic responsibility because I wasn’t owning the whole problem. People around me encouraged me to take on more responsibility and actually optimize on the world as a consequentialist agent. I subsequently felt very bad that I had taken on responsibilities for solving AI safety that I could not deliver on. I also felt bad that maybe because I wrote some blog posts online criticizing “rationalists” that that would lead to the destruction of the world and that would be my fault.
This is cool because what you’re saying has useful information pertinent to model updates regardless of how I choose to model your internal state.
Here’s why it’s really important:
You seem to have been motivated to classify your own intentions as “evil” at some point, based entirely on things that were not entirely under your own control.
That points to your social surroundings as having pressured you to come to that conclusion (I am not sure it is very likely that you would have come to that conclusion on your own, without any social pressure).
So that brings us to the next question: Is it more likely that you are evil, or rather, that your social surroundings were / are?
I think those are hard to separate. Bad social circumstances can make people act badly. There’s the “hurt people hurt people” truism and numerous examples of people being caused to act morally worse by their circumstances e.g. in war. I do think I have gone through extraordinary measures to understand the ways in which I act badly (often in response to social cues) and to act more intentionally well.
Yes, but the point is that we’re trying to determine if you are under “bad” social circumstances or not. Those circumstances will not be independent from other aspects of the social group, e.g. the ideology it espouses externally and things it tells its members internally.
What I’m trying to figure out is to what extent you came to believe you were “evil” on your own versus you were compelled to think that about yourself. You were and are compelled to think about ways in which you act “badly”—nearby or adjacent to a community that encourages its members to think about how to act “goodly.” It’s not a given, per se, that a community devoted explicitly to doing good in the world thinks that it should label actions as “bad” if they fall short of arbitrary standards. It could, rather, decide to label actions people take as “good” or “gooder” or “really really good” if it decides that most functional people are normally inclined to behave in ways that aren’t necessarily un-altruistic or harmful to other people.
I’m working on a theory of social-group-dynamics which posits that your situation is caused by “negative-selection groups” or “credential-groups” which are characterized by their tendency to label only their activities as actually successfully accomplishing whatever it is they claim to do—e.g., “rationality” or “effective altruism.” If it seems like the group’s ideology or behavior implies that non-membership is tantamount to either not caring about doing well or being incompetent in that regard, then it is a credential-group.
Credential-groups are bad social circumstances, and in a nutshell, they act badly by telling members who they know not to be intentionally causing harm that they are harmful or bad people (or mentally ill).