“We are what we pretend to be, so we must be careful about what we pretend to be.”
– Kurt Vonnegut
But why?
Because otherwise, you might self-modify into an agent that’s worse at achieving universal instrumental goals than you are now, or one with less achievable terminal goals. Wouldn’t that suck? Be artificial, but do so carefully.
– Kurt Vonnegut
But why?
Because otherwise, you might self-modify into an agent that’s worse at achieving universal instrumental goals than you are now, or one with less achievable terminal goals. Wouldn’t that suck? Be artificial, but do so carefully.