When reading the first part of the last paragraph my brain auto-completed with ”… so we must make sure that self modifications are always quick and easy, rather than requiring things like programming or careful deliberation on consequences, so that we ego-syntonic things writing this will Win over those darn Others that now control most of behaviour!”
Me too. Unless my wanting and liking systems learn how to influence the programming of an AGI I will not be regarding them as moral agents. Caveats: a) My approving system approves of liking systems feeling happy. b) This comment probably does not mean from a neurological standpoint what my approving system intends for it to mean.
When reading the first part of the last paragraph my brain auto-completed with ”… so we must make sure that self modifications are always quick and easy, rather than requiring things like programming or careful deliberation on consequences, so that we ego-syntonic things writing this will Win over those darn Others that now control most of behaviour!”
Me too. Unless my wanting and liking systems learn how to influence the programming of an AGI I will not be regarding them as moral agents. Caveats: a) My approving system approves of liking systems feeling happy. b) This comment probably does not mean from a neurological standpoint what my approving system intends for it to mean.