(There was a longer comment here but I found a way to make it shorter)
I think people can be reluctant to reveal some of their desires, by word or deed. So looking at policy isn’t the most natural way to learn these desires; looking inside the black box makes more sense.
Fair point, but I don’t think that addresses the final claim, which is that even if you are correct, analyzing the black box isn’t enough without actually playing out counterfactuals.
(There was a longer comment here but I found a way to make it shorter)
I think people can be reluctant to reveal some of their desires, by word or deed. So looking at policy isn’t the most natural way to learn these desires; looking inside the black box makes more sense.
Fair point, but I don’t think that addresses the final claim, which is that even if you are correct, analyzing the black box isn’t enough without actually playing out counterfactuals.