V.G., good theory but I think it’s ethnic rather than religious. Ayn Rand fell prey to the same failure mode with an agnostic upbringing. Anyway this is a kind of ad hominem called the Bulverism fallacy (“ah, I know why you’d say that”), not a substantive critique of Eliezer’s views.
Substantively: Eliezer, I’ve seen indications that you want to change the utility function that guides your everyday actions (the “self-help” post). If you had the power to instantly and effortlessly modify your utility function, what kind of Eliezer would you converge to? (Remember each change is influenced by the resultant utility function after the previous change.) I believe (but can’t prove) you would either self-destruct, or evolve into a creature the current you would hate. This is a condensed version of the FAI problem, without the AI part :-)
V.G., good theory but I think it’s ethnic rather than religious. Ayn Rand fell prey to the same failure mode with an agnostic upbringing. Anyway this is a kind of ad hominem called the Bulverism fallacy (“ah, I know why you’d say that”), not a substantive critique of Eliezer’s views.
Substantively: Eliezer, I’ve seen indications that you want to change the utility function that guides your everyday actions (the “self-help” post). If you had the power to instantly and effortlessly modify your utility function, what kind of Eliezer would you converge to? (Remember each change is influenced by the resultant utility function after the previous change.) I believe (but can’t prove) you would either self-destruct, or evolve into a creature the current you would hate. This is a condensed version of the FAI problem, without the AI part :-)