Types of organizations that conduct alignment research, differentiated by funding model and associated market forces:
Academic research groups (e.g., Krueger’s lab at Cambridge, UC Berkeley CHAI, NYU ARG, MIT AAG);
Research nonprofits (e.g., ARC Theory, MIRI, FAR AI, Redwood Research);
“Mixed funding model” organizations:
“Alignment-as-a-service” organizations, where the product directly contributes to alignment (e.g., Apollo Research, Aligned AI, ARC Evals, Leap Labs);
“Alignment-on-the-side” organizations, where product revenue helps funds alignment research (e.g., Conjecture);
Scaling labs, where alignment research is mostly directed towards improving product (e.g., Anthropic, DeepMind, OpenAI).
Types of organizations that conduct alignment research, differentiated by funding model and associated market forces:
Academic research groups (e.g., Krueger’s lab at Cambridge, UC Berkeley CHAI, NYU ARG, MIT AAG);
Research nonprofits (e.g., ARC Theory, MIRI, FAR AI, Redwood Research);
“Mixed funding model” organizations:
“Alignment-as-a-service” organizations, where the product directly contributes to alignment (e.g., Apollo Research, Aligned AI, ARC Evals, Leap Labs);
“Alignment-on-the-side” organizations, where product revenue helps funds alignment research (e.g., Conjecture);
Scaling labs, where alignment research is mostly directed towards improving product (e.g., Anthropic, DeepMind, OpenAI).