Yeah, I hadn’t seen the other comments saying the same thing, or your replies to them. Maybe add that to the bottom or something?
I don’t think it quite answers my objection, though. Two points:
One: if a project is legitimately making progress on SIAI, in secret; exposing them will most likely create more unsafe projects rather than reducing existential risk (unless you think it’s REALLY CLOSE, this will shut them down permanently, and the next ones will be sufficiently slower to be worth it.)
Two: given one, how can we expect to encourage Snowden-esque consequentialist leakers? We would need, as Eliezer has put it elsewhere, a whole anti-epistemology to support our Noble Lie.
If actually leaking anything does serious harm, then persuading people that leaking is a good idea—in order to create an atmosphere of leaking—is lying, because leaking is a bad idea. Goes the theory.
It may or may not follow that encouraging leaking is also a bad idea—this gets tricky depending on whether you expect the paranoia to prevent any actual uFAI projects, and whether you can use that to persuade people to commit to leaking instead.
Would you expect this approach to actually prevent rather than compromise every project? That’s another argument, I guess, and one I haven’t commented on yet.
Yeah, I hadn’t seen the other comments saying the same thing, or your replies to them. Maybe add that to the bottom or something?
I don’t think it quite answers my objection, though. Two points:
One: if a project is legitimately making progress on SIAI, in secret; exposing them will most likely create more unsafe projects rather than reducing existential risk (unless you think it’s REALLY CLOSE, this will shut them down permanently, and the next ones will be sufficiently slower to be worth it.)
Two: given one, how can we expect to encourage Snowden-esque consequentialist leakers? We would need, as Eliezer has put it elsewhere, a whole anti-epistemology to support our Noble Lie.
Where’s the Noble Lie? The whole point is to decide if encouraging leaking is a good thing; a leaker by definition is encouraging leaks.
If actually leaking anything does serious harm, then persuading people that leaking is a good idea—in order to create an atmosphere of leaking—is lying, because leaking is a bad idea. Goes the theory.
It may or may not follow that encouraging leaking is also a bad idea—this gets tricky depending on whether you expect the paranoia to prevent any actual uFAI projects, and whether you can use that to persuade people to commit to leaking instead.
Would you expect this approach to actually prevent rather than compromise every project? That’s another argument, I guess, and one I haven’t commented on yet.