Possible objection: the proposal appears to fix U in terms of a mathematical description H of some current human brain. What happens in the future, when humans significantly self-modify?
H is used to start off the process. H is then able to interact with a hypothetical unbounded computer, which may eventually run many (potentially quite exotic) simulations, among them of the sorts of minds humans self-modify into.
But your point (as I understood it) is that all these exotic simulations don’t actually get run, they mostly just get reasoned about. If this is so, then as we go farther into future, U becomes increasingly obsolete.
Possible objection: the proposal appears to fix U in terms of a mathematical description H of some current human brain. What happens in the future, when humans significantly self-modify?
H is used to start off the process. H is then able to interact with a hypothetical unbounded computer, which may eventually run many (potentially quite exotic) simulations, among them of the sorts of minds humans self-modify into.
But your point (as I understood it) is that all these exotic simulations don’t actually get run, they mostly just get reasoned about. If this is so, then as we go farther into future, U becomes increasingly obsolete.