Regarding Eliezer’s point #3 - I think this largely comes down to how strong one finds the argument for “tool A.I.” I agree that one shouldn’t expect SI to respond to every possible critique of its plans. But I think it’s reasonable to expect it to anticipate and respond to the stronger possible critiques.
If, as you say, “Tool” AI is different to “Oracle” AI, you are the first person to suggest it AFAICT. Regardless of it’s strength, it appears to be very difficult to invent; it seems unreasonable to expect someone to anticipate an argument when their detractors have also universally failed to do so (apart from you.)
If, as you say, “Tool” AI is different to “Oracle” AI, you are the first person to suggest it AFAICT. Regardless of it’s strength, it appears to be very difficult to invent; it seems unreasonable to expect someone to anticipate an argument when their detractors have also universally failed to do so (apart from you.)