I think it’s about a 0.75 probability, conditional upon smarter-than-human AI being developed. Guess I’m kind of an optimist. TL;DR I don’t think it will be very difficult to impart your intentions into a sufficiently advanced machine.
I don’t think it will be very difficult to impart your intentions into a sufficiently advanced machine
Counterargument: it will be easy to impart an approximate version of your intentions, but hard to control the evolution of those values as you crank up the power. E.g. evolution, humans, make us want sex, we invent condoms.
No-one will really care about this until it’s way too late and we’re all locked up in nice padded cells and drugged up, or something equally bad but hard for me to imagine right now.
I think it’s about a 0.75 probability, conditional upon smarter-than-human AI being developed. Guess I’m kind of an optimist. TL;DR I don’t think it will be very difficult to impart your intentions into a sufficiently advanced machine.
Counterargument: it will be easy to impart an approximate version of your intentions, but hard to control the evolution of those values as you crank up the power. E.g. evolution, humans, make us want sex, we invent condoms.
No-one will really care about this until it’s way too late and we’re all locked up in nice padded cells and drugged up, or something equally bad but hard for me to imagine right now.