In theory I could treat myself as a black box, though even then I’m going to need at least a functional self model (i.e. model of what outputs yield what inputs) in order to get predictions out of the model for anything in my future light cone.
But usually I do assume that we want a “complete” world model, in the sense that we’re not ignoring any parts by fiat. We can be uncertain about what my internal structure looks like, but that still leaves us open to update if e.g. we see some FMRI data. What I don’t want is to see some FMRI data and then go “well, can’t do anything with that, because this here black box is off-limits”. When that data comes in, I want to be able to update on it somehow.
In theory I could treat myself as a black box, though even then I’m going to need at least a functional self model (i.e. model of what outputs yield what inputs) in order to get predictions out of the model for anything in my future light cone.
But usually I do assume that we want a “complete” world model, in the sense that we’re not ignoring any parts by fiat. We can be uncertain about what my internal structure looks like, but that still leaves us open to update if e.g. we see some FMRI data. What I don’t want is to see some FMRI data and then go “well, can’t do anything with that, because this here black box is off-limits”. When that data comes in, I want to be able to update on it somehow.