I remember that post and agree with the point from its comments section that any solution must be resilient against an adversarial environment.
Which is the core problem of the distillation and amplification approach: It fundamentally assumes it is possible to engineer the environment to be non-adversarial. Every reply I’ve seen you write to this point, which has come in many guises over the years, seemed to dodge the question. I therefore don’t trust you to think clearly enough to not destroy the world.
Providing context for readers: here is a post someone wrote a few years ago about issues (ii)+(iii) which I assume is the kind of thing Czynski has in mind. The most relevant thing I’ve written on issues (ii)+(iii) are Universality and consequentialism within HCH, and prior to that Security amplification and Reliability amplification.
I remember that post and agree with the point from its comments section that any solution must be resilient against an adversarial environment.
Which is the core problem of the distillation and amplification approach: It fundamentally assumes it is possible to engineer the environment to be non-adversarial. Every reply I’ve seen you write to this point, which has come in many guises over the years, seemed to dodge the question. I therefore don’t trust you to think clearly enough to not destroy the world.