A team which is ready to adopt a variety of imperfect heuristic techniques will have a decisive lead on approaches based on pure theory [...] even if the Friendliness theory provides the basis for intelligence, the nitty-gritty of SI’s implementation will still be far away, and will involve real-world heuristics and other compromises.
Citation very much needed. Neither of the two approaches has come anywhere near to self-improving AI.
SI should evangelize AGI safety to other researchers
Citation very much needed. Neither of the two approaches has come anywhere near to self-improving AI.
I think they’re already aware of this.