Also I think there are other problem sets if physics is such that AI hits a limit for a while and is only very powerful rather than stupidly powerful. E.g. not powerful enough to takeover the whole world but powerful enough to destroy the whole world.
Then you have to deal with potential communities of AIs and their dynamics. Which might fit into poor predictions (but is magnified by having a multiplicity of AI).
Also I think there are other problem sets if physics is such that AI hits a limit for a while and is only very powerful rather than stupidly powerful. E.g. not powerful enough to takeover the whole world but powerful enough to destroy the whole world.
Then you have to deal with potential communities of AIs and their dynamics. Which might fit into poor predictions (but is magnified by having a multiplicity of AI).