why isn’t the moral of this fable that pursuing subjective intuitions about correctness a wild goose chase?
Bacause those subjective intuitions are all we got. Sure, in an absolute sense, human intuitions on correctness are just as arbitrary as the pebblesorter’s intuitions(and vastly more complex), but we don’t judge intuitions in an absolute way, we judge them with are own intuitons.
You can’t unwind past your own intuitions. That was the point of Eliezer’s series of posts.
Bacause those subjective intuitions are all we got. Sure, in an absolute sense, human intuitions on correctness are just as arbitrary as the pebblesorter’s intuitions(and vastly more complex), but we don’t judge intuitions in an absolute way, we judge them with are own intuitons. You can’t unwind past your own intuitions. That was the point of Eliezer’s series of posts.