Agree with this. Law is downstream of a particular medium-scale ontology of human agency. A paperclip maximizer, as mythologized, would be working with a different notion of agency, by definition.
Querying check_legality(“clippy’s plan”), would be like checking the temperature of the number “100″. Sure, it might kinda sound like its hot, or illegal, but that’s not the kind of input that check_legality() currently takes.
check_legality() can’t even handle the agency of nation states …
Agree with this. Law is downstream of a particular medium-scale ontology of human agency. A paperclip maximizer, as mythologized, would be working with a different notion of agency, by definition.
Querying check_legality(“clippy’s plan”), would be like checking the temperature of the number “100″. Sure, it might kinda sound like its hot, or illegal, but that’s not the kind of input that check_legality() currently takes.
check_legality() can’t even handle the agency of nation states …