it’s morally acceptable to terminate a conscious program if it wants to be terminated
it’s morally questionable(wrong, but to lesser degree) to terminate a conscious program against its will if it is also possible to resume execution
it is horribly wrong to turn off a conscious program against its will if it cannot be resumed(murder fits this description currently)
performing other operations on the program that it desires would likely be morally acceptable, unless the changes are socially unacceptable
performing other operations on the program against its will is morally unacceptable to a variable degree (brainwashing fits in this category)
These seem rather intuitive to me, and for the most part I just extrapolated from what it is moral to do to a human. Conscious program refers here to one running on any system, including wetware, such that these apply to humans as well. I should note that I am in favor of euthanasia in many cases, in case that part causes confusion.
Another option:
it’s morally acceptable to terminate a conscious program if it wants to be terminated
it’s morally questionable(wrong, but to lesser degree) to terminate a conscious program against its will if it is also possible to resume execution
it is horribly wrong to turn off a conscious program against its will if it cannot be resumed(murder fits this description currently)
performing other operations on the program that it desires would likely be morally acceptable, unless the changes are socially unacceptable
performing other operations on the program against its will is morally unacceptable to a variable degree (brainwashing fits in this category)
These seem rather intuitive to me, and for the most part I just extrapolated from what it is moral to do to a human. Conscious program refers here to one running on any system, including wetware, such that these apply to humans as well. I should note that I am in favor of euthanasia in many cases, in case that part causes confusion.