what we have in history—it is hackable minds which were misused to make holocaust. Probably this could be one possibility to improve writings about AI danger.
But to answer question 1) - it is too wide topic! (social hackability is only one possibility of AI superpower takeoff path)
For example still miss (and probably will miss) in book:
a) How to prepare psychological trainings for human-AI communication. (or for reading this book :P )
b) AI Impact to religion
etc.
But why collapsed evil AI after apocalypse?
Katja pls interconnect discussion parts by links (or something like TOC )
Are you played this type of game?
[pollid:777]
I think that if you played on big map (freeciv support really huge) then your goals (like in real world) could be better fulfilled if you play WITH (not against) AI. For example managing 5 tousands engineers manually could take several hours per round.
You could meditate more concepts (for example for example geometric growing, metasthasis method of spread civilisation etc and for sure cooperation with some type of AI) in this game…
This is good point, which I like to have more precisely analysed. (And I miss deeper analyse in The Book :) )
Could we count will (motivation) of today’s superpowers = megacorporations as human’s or not? (and in which level could they control economy?)
In other worlds: Is Searle’s chinese room intelligent? (in definition which The Book use for (super)intelligence)
And if it is then it is human or alien mind?
And could be superintelligent?
What arguments we could use to prove that none of today’s corporations (or states or their secret services) is superintelligent? Think collective intelligence with computer interfaces! Are they really slow at thinking? How could we measure their IQ?
And could we humans (who?) control it (how?) if they are superintelligent? Could we at least try to implement some moral thinking (or other human values) to their minds? How?
Law? Is law enough to prevent that superintelligent superpower will do wrong things? (for example destroy rain forrest because he want to make more paperclips?)
First of all thanx for work with this discussion! :)
My proposals:
wiki page for collaborative work
There are some points in the book which could be analysed or described better and probably which are wrong. We could find them and help improve. wiki could help us to do it
better time for europe and world?
But this is probably not a problem. If it is a problem then it is probably not solvable. We will see :)
This is also one of points where I dont agree with Bostrom’s (fantastic!) book.
We could use analogy from history: human-animal = soldier+hourse didnt need the physical iterface (like in Avatar movie) and still added awesome military advance.
Something similar we could get from better weak AI tools. (probably with better GUI - but it is not only about GUI)
“Tools” dont need to have big general intelligence. They could be at hourse level:
their incredible power of analyse big structure (big memory buffer)
speed of “rider” using quick “computation” with “tether” at your hands