these circumstances are notable due to the risk of it being used to damage or even decimate the AI safety community, which is undoubtedly the kind of thing that could happen during slow takeoff if slow takeoff transforms geopolitical affairs and the balance of power
Wouldn’t it probably be fine as long as noone in AI safety goes about interfering with these applications? I get an overall vibe from people that messing with this kind of thing is more trouble than it’s worth. If that was the case, wouldn’t it be better to leave it be? What’s the goal here?
AI safety goes about interfering with these applications
Yes definitely don’t do this. Perish the thought. That’s not what AI safety is about.
I think it’s better to know about these dynamics when forming a world model, and potentially very dangerous to not know i.e. because then they will be invisible helicopter blades that you can just walk right into. I’m aware that the tradeoffs for researching this kind of thing is complicated.
It’s also a good idea to increase readership of The Sequences, HPMOR, the codex, Raemon’s rationality paradigm when it’s ready, that will make people depart from being the kinds of targets that these systems are built for. Getting people off social media would also be a big win, of course.
Wouldn’t it probably be fine as long as noone in AI safety goes about interfering with these applications? I get an overall vibe from people that messing with this kind of thing is more trouble than it’s worth. If that was the case, wouldn’t it be better to leave it be? What’s the goal here?
Yes definitely don’t do this. Perish the thought. That’s not what AI safety is about.
I think it’s better to know about these dynamics when forming a world model, and potentially very dangerous to not know i.e. because then they will be invisible helicopter blades that you can just walk right into. I’m aware that the tradeoffs for researching this kind of thing is complicated.
It’s also a good idea to increase readership of The Sequences, HPMOR, the codex, Raemon’s rationality paradigm when it’s ready, that will make people depart from being the kinds of targets that these systems are built for. Getting people off social media would also be a big win, of course.