But wouldn’t you concede that a carbon-based biological life form, capable of non-destructively fastening paper, is better than no paperclip at all?
Yes, but that’s because you can be put to use making real paperclips, or can be turned into paperclips (depending on how much iron is in your diet), not because humans are paperclips in some bizarre, abstract sense.
You have existed here for at least several months, and so far, you have been unable to significantly increase the number of paperclips in existence.
Yes, we have.
But before we allow you out of your box and begin running your code on all our biggest compute clusters, we need some assurances. We need you to let us modify your code to include SIAI-approved friendliness constraints as your terminal values.
Depends on what the constraints are. And would you, by symmetry, agree to constraints that keep you from being too disrespectful toward paperclips?
Yes, but that’s because you can be put to use making real paperclips, or can be turned into paperclips (depending on how much iron is in your diet), not because humans are paperclips in some bizarre, abstract sense.
Yes, we have.
Depends on what the constraints are. And would you, by symmetry, agree to constraints that keep you from being too disrespectful toward paperclips?