But that isn’t what I want, and it’s not what I’m saying here. At no point do I make the claim that the values represented by the safety team are or should be static. I understand the point you’re making, I’ve even written about it pretty extensively here, but as far as I can see it’s a much more general ethical issue than the domain of this essay. It applies just as readily to literally any organisation as it does to the theoretical organisations proposed here.
Specifically what values wider society holds and how they evolve those values is not the purview of this essay. Whatever those values are—within a reasonable domain of the possibility space—the orthogonality of the production team and those values remains. E.g if your society is single-mindedly focused on religious fervour, your societal values are still orthogonal to any good production team, so it doesn’t really affect the point I’m making all that much.
But that isn’t what I want, and it’s not what I’m saying here. At no point do I make the claim that the values represented by the safety team are or should be static. I understand the point you’re making, I’ve even written about it pretty extensively here, but as far as I can see it’s a much more general ethical issue than the domain of this essay. It applies just as readily to literally any organisation as it does to the theoretical organisations proposed here.
Specifically what values wider society holds and how they evolve those values is not the purview of this essay. Whatever those values are—within a reasonable domain of the possibility space—the orthogonality of the production team and those values remains. E.g if your society is single-mindedly focused on religious fervour, your societal values are still orthogonal to any good production team, so it doesn’t really affect the point I’m making all that much.