Strong upvoted, I’m glad to see people thinking about this particular problem. Looking forward to a continuation of this dialog, which I will also use to help research game-changing community dynamics and defense from external threats.
I think that a big element here, that puts things OOD in interesting ways, is that a lot is at stake- money, for example (billions have been moved into OpenAI and Anthropic alone).
As a side note, I think that a sufficiently intelligent person is often flexible enough to succeed in the role of the creator or the sociopath, whereas other people are effectively “locked in” to being sociopaths/impostors, fanatics, or mobs. The ratio of flexible to inflexible people should also be far higher here, in addition to intelligence.
However, rare math skill, e.g. intuitive multidimensional thinking, places hard constraints on who can become alignment rockstars and who is stuck with routinely stealing ideas (or cutting reasonable deals with ghostwriters), similar to guitar-playing fine motor skills and music composition skill are required in order for someone to be a creator instead of settling for one of the other roles.
Strong upvoted, I’m glad to see people thinking about this particular problem. Looking forward to a continuation of this dialog, which I will also use to help research game-changing community dynamics and defense from external threats.
I think that a big element here, that puts things OOD in interesting ways, is that a lot is at stake- money, for example (billions have been moved into OpenAI and Anthropic alone).
Normal subcultures don’t have infosec requirements, let alone infosec requirements effective enough for intelligence agencies, let alone warding off megacorporations with unprecedented technological capabilities and incredible financial incentives to coopt or hijack large portions of the scene (yes, I did in fact write that 5 days before the OpenAI incident, although 5 days is like 30 days in 2019 time).
Furthermore, rationalists at least aspire to be at the cutting edge of epistemics and/or empowering people, with the Sequences, the first chapter of the CFAR handbook, prediction markets, and projectlawful being notable probably-successes.
As a side note, I think that a sufficiently intelligent person is often flexible enough to succeed in the role of the creator or the sociopath, whereas other people are effectively “locked in” to being sociopaths/impostors, fanatics, or mobs. The ratio of flexible to inflexible people should also be far higher here, in addition to intelligence.
However, rare math skill, e.g. intuitive multidimensional thinking, places hard constraints on who can become alignment rockstars and who is stuck with routinely stealing ideas (or cutting reasonable deals with ghostwriters), similar to guitar-playing fine motor skills and music composition skill are required in order for someone to be a creator instead of settling for one of the other roles.
This link is broken
Fixed, thank you.