No, I wasn’t really talking about any specific implementation of democracy. My point was that, given the vast power that ASI grants to whoever controls it, the traditional checks and balances would be undermined.
Now, regarding your point that aligning AGI with what democracy is actually supposed to be, I have two objections:
To me, it’s not clear at all why it would be straightforward to align AGI with some ‘democratic ideal’. Arrow’s impossibility theorem shows that no perfect voting system exists, so an AGI trying to implement the “perfect democracy” will eventually have to make value judgments about which democratic principles to prioritize (although I do think that an AGI could, in principle, help us find ways to improve upon our democracies).
Even if aligning AGI with democracy would in principle be possible, we need to look at the political reality the technology will emerge from. I don’t think it’s likely that whichever group that would end up controlling AGI would willingly want to extend its alignment to other groups of people.
Yeah, I can see why that’s possible. But I wasn’t really talking about the improbable scenario where ASI would be aligned to the whole of humanity/country, but about a scenario where ASI is ‘narrowly aligned’ in the sense that it’s aligned to its creators/whoever controls it when it’s created. This is IMO much more likely to happen since technologies are not created in a vacuum.