Wei_Dai2, it looks like you missed Eliezer’s main point:
Value isn’t just complicated, it’s fragile. There is more than one dimension of human value, where if just that one thing is lost, the Future becomes null. A single blow and all value shatters. Not every single blow will shatter all value—but more than one possible “single blow” will do so.
It doesn’t matter that “many” values survive, if Eliezer’s “value is fragile” thesis is correct, because we could lose the whole future if we lose just a single critical value. Do we have such critical values? Maybe, maybe not, but you didn’t address that issue.
Wei_Dai2, it looks like you missed Eliezer’s main point:
It doesn’t matter that “many” values survive, if Eliezer’s “value is fragile” thesis is correct, because we could lose the whole future if we lose just a single critical value. Do we have such critical values? Maybe, maybe not, but you didn’t address that issue.
I like the idea of replying to past selves and think it should be encouraged.
The added bonus is they can’t answer back.
“Yeah, past me is terrible, but don’t even get me started on future me, sheesh!”
Quite. I never expected LW to resemble classic scenes from Homestuck… except, you know, way more functional.