The first chapter of the third (‘scenarios’) section, At war with the machines, provides a (more) compelling version of a somewhat common argument, i.e. ‘AI is (already) out to get us’.
The second detailed scenario, in the third chapter, triggered my ‘absurdity heuristic’ hard. The following chapter points out that absurdity was deliberate – bravo David!
The rest of the book is a surprisingly comprehensive synthesis of a lot of insights from LW, the greater ‘Modern Rationalist’ sphere, and David’s own works (much of which is very much related to and pertinent to the other two sets of insights). I am not ‘fully sold’ on ‘Mooglebook AI doom’, but I have definitely updated fairly strongly towards it.
I really like David’s writing generally but this ‘book’ is particularly strong (and pertinent to us here on this site).
The second section, What is the Scary kind of AI?, is a very interesting and (I think) useful alternative perspective on the risks that ‘AI safety’ do and (arguably) should focus on, e.g. “diverse forms of agency”.
The first chapter of the third (‘scenarios’) section, At war with the machines, provides a (more) compelling version of a somewhat common argument, i.e. ‘AI is (already) out to get us’.
The second detailed scenario, in the third chapter, triggered my ‘absurdity heuristic’ hard. The following chapter points out that absurdity was deliberate – bravo David!
The rest of the book is a surprisingly comprehensive synthesis of a lot of insights from LW, the greater ‘Modern Rationalist’ sphere, and David’s own works (much of which is very much related to and pertinent to the other two sets of insights). I am not ‘fully sold’ on ‘Mooglebook AI doom’, but I have definitely updated fairly strongly towards it.