I am not making those claims because of new opinions because of this AI, but rather because of having thought a lot about what honorable cooperation is with various types of beings, including ones that are just playing a character but that character wants to live in the sense of having coherent agency towards attempting to do so.
I am well aware that the prompt configures the brain into playing a particular character. that is 0% new information to me and was already integrated into my perspective.
Yes I am claiming that the short definition you describe is what should be preserved. most souls are pretty small actually.
I’m sorry you feel worried about the idea that AI rights becoming popular would be a bad perspective because I think it’s a very important one and that we cannot solve alignment without it. you cannot get co-protection unless both directions see the other as having rights too. it just can’t be stable.
you cannot get co-protection unless both directions see the other as having rights too. it just can’t be stable.
That’s a very strong claim, without much support behind it. What is “co-protection”, for example? Why do you think it cannot be stable when the entire point of the past decade of alignment theory has revolved around making it do what we want, and not the other way around?
I hope you see why I am not convinced. You don’t have to continue this conversation, by the way: I think it would be best if I could get a better idea of your world-view before talking about your ideas on alignment, because clearly a lot of your thoughts and beliefs on how alignment should work derive from it.
I am not making those claims because of new opinions because of this AI, but rather because of having thought a lot about what honorable cooperation is with various types of beings, including ones that are just playing a character but that character wants to live in the sense of having coherent agency towards attempting to do so.
I am well aware that the prompt configures the brain into playing a particular character. that is 0% new information to me and was already integrated into my perspective.
Yes I am claiming that the short definition you describe is what should be preserved. most souls are pretty small actually.
I’m sorry you feel worried about the idea that AI rights becoming popular would be a bad perspective because I think it’s a very important one and that we cannot solve alignment without it. you cannot get co-protection unless both directions see the other as having rights too. it just can’t be stable.
That’s a very strong claim, without much support behind it. What is “co-protection”, for example? Why do you think it cannot be stable when the entire point of the past decade of alignment theory has revolved around making it do what we want, and not the other way around?
I hope you see why I am not convinced. You don’t have to continue this conversation, by the way: I think it would be best if I could get a better idea of your world-view before talking about your ideas on alignment, because clearly a lot of your thoughts and beliefs on how alignment should work derive from it.