timtyler comments on Students asked to defend AGI danger update in favor of AGI riskiness

[timtyler]

The point is that the first time you run the seed AI it will attempt to take over the world, so you don’t have the luxury of debugging it.

That is not a very impressive argument, IMHO.

We will have better test harnesses by then—allowing such machines to be debugged.