I really don’t get how you can go from being online to having a ball of nanomachines, truly. Imagine AI goes rogue today. I can’t imagine one plausible scenario where it can take out humanity without triggering any bells on the way, even without anyone paying attention to such things. But we should pay attention to the bells, and for that we need to think of them. What the signs might look like? I think it’s really, really counterproductive to not take that into account at all and thinking all is lost if it fooms. It’s not lost. It will need humans, infrastructure, money (which is very controllable) to accomplish its goals. Governments already pay a lot of attention to their adversaries who are trying to do similar things and counteract them semi-successfully. Any reason why they can’t do the same to a very intelligent AI? Mind you, if your answer is to simulate and just do what it takes, true to life simulations will take a lot of compute and time; that won’t be available from the start. We should stop thinking of rogue AI as God, it would only help it accomplish it’s goals.
I really don’t get how you can go from being online to having a ball of nanomachines, truly.
Imagine AI goes rogue today. I can’t imagine one plausible scenario where it can take out humanity without triggering any bells on the way, even without anyone paying attention to such things.
But we should pay attention to the bells, and for that we need to think of them. What the signs might look like?
I think it’s really, really counterproductive to not take that into account at all and thinking all is lost if it fooms. It’s not lost.
It will need humans, infrastructure, money (which is very controllable) to accomplish its goals. Governments already pay a lot of attention to their adversaries who are trying to do similar things and counteract them semi-successfully. Any reason why they can’t do the same to a very intelligent AI?
Mind you, if your answer is to simulate and just do what it takes, true to life simulations will take a lot of compute and time; that won’t be available from the start.
We should stop thinking of rogue AI as God, it would only help it accomplish it’s goals.