If we held anything in the nascent field of Artificial General Intelligence to the lesser standards of engineering rigor that apply to a bridge meant to carry a couple of thousand cars, the entire field would be shut down tomorrow.
What are examples that can help to see this tie more clearly? Procedures that works similarly enough to say “we do X during planning and building a bridge and if we do X in AI building...”. Is there are even exist such X that can be applied to enginering a bridge and enginering an AI?
I was hoping that he meant some concrete examples but did not elaborate on this due this being letter in magazine and not a blog post. The only thing that comes to my mind in somehow measure unexpected behavior and if bridge some times lead people in circles then it will be definitely cause for concern and reevaluation of used technics.
If we held anything in the nascent field of Artificial General Intelligence to the lesser standards of engineering rigor that apply to a bridge meant to carry a couple of thousand cars, the entire field would be shut down tomorrow.
What are examples that can help to see this tie more clearly? Procedures that works similarly enough to say “we do X during planning and building a bridge and if we do X in AI building...”. Is there are even exist such X that can be applied to enginering a bridge and enginering an AI?
X = “use precise models”.
Use tables for concrete loads and compare experimentally with the to be poured concrete, if a load its off, reject it.
We dont even have the tables about ML. Start making tables, dont build big bridges until you got the fucking tables right.
Enforce bridge making no larger than the Yudkowski Airstrike Threshold.
Do we have an idea of how this tables about ML should look like? I dont know about ML that much.
Well, Evals and that stuff OpenAI did with predicting loss could be a starting point to work in the tables.
But we dont really know, I guess that’s the point EY is trying to make.
I was hoping that he meant some concrete examples but did not elaborate on this due this being letter in magazine and not a blog post. The only thing that comes to my mind in somehow measure unexpected behavior and if bridge some times lead people in circles then it will be definitely cause for concern and reevaluation of used technics.