We have a lot of experience and knowledge of building systems that are broadly beneficial and safe, while operating in the human capabilities regime.
What? A major reason we’re in the current mess is that we don’t know how to do this. For example we don’t seem to know how to build a corporation (or more broadly an economy) such that its most powerful leaders don’t act like Hollywood villains (race for AI to make a competitor ‘dance’)? Even our “AGI safety” organizations don’t behave safely (e.g., racing for capabilities, handing them over to others, e.g. Microsoft, with little or no controls on how they’re used). You yourself wrote:
Unfortunately, given that most other actors are racing for as powerful and general AIs as possible, we won’t share much in terms of technical details for now.
What? A major reason we’re in the current mess is that we don’t know how to do this.
Well, we are not very good at it, but generally speaking, however capitalism seems to be acting to degrade our food, food companies are not knowingly routinely putting poisonous additives in food.
And however bad medicine is, it does seem to be a net positive these days.
Both of these things are a big improvement on Victorian times!
So maybe we are a tiny bit better at it than we used to be?
What? A major reason we’re in the current mess is that we don’t know how to do this. For example we don’t seem to know how to build a corporation (or more broadly an economy) such that its most powerful leaders don’t act like Hollywood villains (race for AI to make a competitor ‘dance’)? Even our “AGI safety” organizations don’t behave safely (e.g., racing for capabilities, handing them over to others, e.g. Microsoft, with little or no controls on how they’re used). You yourself wrote:
How is this compatible with the quote above?!
Well, we are not very good at it, but generally speaking, however capitalism seems to be acting to degrade our food, food companies are not knowingly routinely putting poisonous additives in food.
And however bad medicine is, it does seem to be a net positive these days.
Both of these things are a big improvement on Victorian times!
So maybe we are a tiny bit better at it than we used to be?
Not convinced it actually helps, mind....
Food companies are adding sesame (an allergen for some) to food in order to not be held responsible for it not containing sesame. Alloxan is used to whiten dough https://www.sciencedirect.com/science/article/abs/pii/S0733521017302898 for the it’s false comment. And is also used to induce diabetes in the lab https://www.sciencedirect.com/science/article/abs/pii/S0024320502019185 RoundUp is in nearly everything.
https://en.m.wikipedia.org/wiki/List_of_withdrawn_drugs#Significant_withdrawals plenty of things keep getting added to this list.
We have never made a safe human. CogEms would be safer than humans though because they won’t unionize and can be flipped off when no longer required.
Edit: sources added for the x commenter.