The other important thing is law. Law is the “offensive approach to the problem of security” in the sense I suspect you mean it (unless you mean something more like the military). Law is very highly evolved, the work of millions of people as smart or smarter than Yudkoswky over more than a millenium, and tested empirically against the real world of real agents with a real diversity of values every day. It’s not something you can ever come close to competing with by a philosophy invented from scratch.
As a lawyer, I strongly suspect this statement is false. As you seem to be referring to the term, Law is society’s organizational rules about how and when to implement coercive violence. In the abstract, this is powerful, but concretely, this power is implemented by individuals. Some of them (i.e. police officers), care relatively little about the abstract issues—in other words, they aren’t careful about the issues that are relevant to AI.
Further, law is filled with backdoors—they are called legislators. In the United States, Congress can make almost any judicially announced rule irrelevant by passing a statute. If you call that process “Law,” then you aren’t talking about the institution that draws on “the work of millions of smart people” over time.
Finally, individual lawyers’ day-to-day work has almost no relationship to the parts of Law that you are suggesting is relevant to AI. Worse for your point, lawyers don’t even engage with the policy issues of law with any frequency. For example, a lawyer litigating contracts might never engage with what promises should be enforced in her entire career.
In short, your paragraph about law is misdirected and misleading.
As a lawyer, I strongly suspect this statement is false. As you seem to be referring to the term, Law is society’s organizational rules about how and when to implement coercive violence. In the abstract, this is powerful, but concretely, this power is implemented by individuals. Some of them (i.e. police officers), care relatively little about the abstract issues—in other words, they aren’t careful about the issues that are relevant to AI.
Further, law is filled with backdoors—they are called legislators. In the United States, Congress can make almost any judicially announced rule irrelevant by passing a statute. If you call that process “Law,” then you aren’t talking about the institution that draws on “the work of millions of smart people” over time.
Finally, individual lawyers’ day-to-day work has almost no relationship to the parts of Law that you are suggesting is relevant to AI. Worse for your point, lawyers don’t even engage with the policy issues of law with any frequency. For example, a lawyer litigating contracts might never engage with what promises should be enforced in her entire career.
In short, your paragraph about law is misdirected and misleading.