Arthur: no, the point isn’t to simply have an arbitrary definition of a person. The point is to be able to have some way of saying “this specific chunk of the space of computations provably corresponds to non-conscious entities, thus is ‘safe’, that is, we can such computations without having to worry about unintentionally creating and doing bad things to actual beings”
ie, “non person” in the sense of “non conscious”
You might say, tongue in cheek, that we’re trying to figure out how to deliberately create a philosophical zombie. (okay, not, technically, a p-zombie, but basically figure out how to model people as accurately as possible without the models themselves being people (that is, conscious in and of themselves))
Eliezer: You’re welcome. :)
Arthur: no, the point isn’t to simply have an arbitrary definition of a person. The point is to be able to have some way of saying “this specific chunk of the space of computations provably corresponds to non-conscious entities, thus is ‘safe’, that is, we can such computations without having to worry about unintentionally creating and doing bad things to actual beings”
ie, “non person” in the sense of “non conscious”
You might say, tongue in cheek, that we’re trying to figure out how to deliberately create a philosophical zombie. (okay, not, technically, a p-zombie, but basically figure out how to model people as accurately as possible without the models themselves being people (that is, conscious in and of themselves))