To be clear, when you say powerful you still mean less powerful than ASI, right?
What are your thoughts on whether this organisation will be able to secure the data they collect? My post has some my thoughts on why securing data may be difficult even if you’re politically powerful.
Yes, potentially less that ASI, and security is definitely an issue, But people breaching the security would hoard their access—there will be periodic high-profile spills (e.g. celebrities engaged in sexual activities, or politicians engaged in something inappropriate would be obvious targets), but I’d expect most of the time people would have at least an illusion of privacy.
The incentives pushing for the first actor to get broken into also push for the second actor to get broken into. On a longer timescale, more and more actors get the same data, until eventually it could be public. Nobody has a strong incentive to destroy their copy of the data, so the total number of copies of data in the world is more-or-less a non-decreasing function.
Hm, not sure about it being broadcast vs consumed by a powerful AI that somebody else has at least a partial control over.
To be clear, when you say powerful you still mean less powerful than ASI, right?
What are your thoughts on whether this organisation will be able to secure the data they collect? My post has some my thoughts on why securing data may be difficult even if you’re politically powerful.
Yes, potentially less that ASI, and security is definitely an issue, But people breaching the security would hoard their access—there will be periodic high-profile spills (e.g. celebrities engaged in sexual activities, or politicians engaged in something inappropriate would be obvious targets), but I’d expect most of the time people would have at least an illusion of privacy.
Sorry for delay.
The incentives pushing for the first actor to get broken into also push for the second actor to get broken into. On a longer timescale, more and more actors get the same data, until eventually it could be public. Nobody has a strong incentive to destroy their copy of the data, so the total number of copies of data in the world is more-or-less a non-decreasing function.