I entirely agree with you that various forms of mistaken and fraudulent identity, where entities falsely claim to be me or are falsely believed to be me, are problematic. Indeed, there are versions of that happening right now in the real world, and they are a problem. (That last part doesn’t have much to do with AI, of course.)
I agree that people being modified without their consent is problematic. That said, it’s not clear to me that I would necessarily be more subject to being modified without my consent as a computer than I am as whatever I am now—I mean, there’s already a near-infinite assortment of things that can modify me without my consent, and there do exist techniques for making accidental/malicious modification of computers difficult, or at least reversible. (I would really have appreciated error-correction algorithms after my stroke, for example, or at least the ability to restore my mind from backup afterwards. So the idea that the kind of thing I am right now is the ne plus ultra of unmodifiability rings false for me.)
Makes sense enough.
For my own part, two things:
I entirely agree with you that various forms of mistaken and fraudulent identity, where entities falsely claim to be me or are falsely believed to be me, are problematic. Indeed, there are versions of that happening right now in the real world, and they are a problem. (That last part doesn’t have much to do with AI, of course.)
I agree that people being modified without their consent is problematic. That said, it’s not clear to me that I would necessarily be more subject to being modified without my consent as a computer than I am as whatever I am now—I mean, there’s already a near-infinite assortment of things that can modify me without my consent, and there do exist techniques for making accidental/malicious modification of computers difficult, or at least reversible. (I would really have appreciated error-correction algorithms after my stroke, for example, or at least the ability to restore my mind from backup afterwards. So the idea that the kind of thing I am right now is the ne plus ultra of unmodifiability rings false for me.)