This will likely elevate it to attention for adversarial actors who were not fully grasping its capabilities. There are plenty of adversarial actors who are grasping it of course, so this may be an acceptable tradeoff, but it might change the dynamics for weaker adversarial actors who would otherwise take a while to realize just how far they could go
I actually wrote a little about this last november, but before october 2023, I was dangerously clueless about this very important dynamic, and I still haven’t properly grappled with it.
Like, what if only 5% of the NSA knows about AI-optimized influence, and they’re trying to prevent 25% of the NSA from finding out because that could be a critical mass and they don’t know what it would do to the country and the world if awareness spread that far?
What if in 2019 the US and Russia and Chinese intelligence agencies knew that the tech was way too powerful, but Iran and South Africa and North Koreans didn’t, and the world becomes worse if they do?
What if IBM or JP Morgan found out in 2022 and started trying to join in the party? What if Disney predicted a storm is coming and took a high-risk strategy to join the big fish before it was too late (@Valentine)?
If we’re in an era of tightening nooses, world modelling becomes so much more complicated when you expand the circle beyond the big American and Chinese tech companies and intelligence agencies.
I actually wrote a little about this last november, but before october 2023, I was dangerously clueless about this very important dynamic, and I still haven’t properly grappled with it.
Like, what if only 5% of the NSA knows about AI-optimized influence, and they’re trying to prevent 25% of the NSA from finding out because that could be a critical mass and they don’t know what it would do to the country and the world if awareness spread that far?
What if in 2019 the US and Russia and Chinese intelligence agencies knew that the tech was way too powerful, but Iran and South Africa and North Koreans didn’t, and the world becomes worse if they do?
What if IBM or JP Morgan found out in 2022 and started trying to join in the party? What if Disney predicted a storm is coming and took a high-risk strategy to join the big fish before it was too late (@Valentine)?
If we’re in an era of tightening nooses, world modelling becomes so much more complicated when you expand the circle beyond the big American and Chinese tech companies and intelligence agencies.