Solid, aside from the faux-pass self-references. If anyone wonders why people would have a high p(doom), especially Yudkowsky himself, this doc solves the problem in a single place. Demonstrates why AI safety is superior to most other elite groups; we don’t just say why we think something, we make it easy to find as well. There still isn’t much need for Yudkowsky to clarify further, even now.
I’d like to note that my professional background makes me much better at evaluating Section C than Sections A and B. Section C is highly quotable, well worth multiple reads, and predicted trends that ended up continuing even today. I’m not so impressed with people’s responses at the time (including my own).
Edit: I still think I am right about everything in this review. I would further recommend that everyone reread the entire doc on a ~1.5 year cycle, like the ~4 year cycle for the Sequences and the single reread of HPMOR before 10 years pass. It is, in fact, all in one place.
The “even today” link sometimes breaks, it is supposed to go directly to the paragraph about international treaties in this section.
Solid, aside from the faux-pass self-references. If anyone wonders why people would have a high p(doom), especially Yudkowsky himself, this doc solves the problem in a single place. Demonstrates why AI safety is superior to most other elite groups; we don’t just say why we think something, we make it easy to find as well. There still isn’t much need for Yudkowsky to clarify further, even now.
I’d like to note that my professional background makes me much better at evaluating Section C than Sections A and B. Section C is highly quotable, well worth multiple reads, and predicted trends that ended up continuing even today. I’m not so impressed with people’s responses at the time (including my own).
Edit: I still think I am right about everything in this review. I would further recommend that everyone reread the entire doc on a ~1.5 year cycle, like the ~4 year cycle for the Sequences and the single reread of HPMOR before 10 years pass. It is, in fact, all in one place.
The “even today” link sometimes breaks, it is supposed to go directly to the paragraph about international treaties in this section.