“How well would your life, or the life of your child go, if you took your only purpose in life to be the first thing your child asked you to do for them? When we make an Artificial Intelligence smarter than us, we will be giving it as well defined of a goal as we know how. Unfortunately, the same as a 5 year old doesn’t know what would happen if their parent dropped everything to do what they request, we won’t be able to think through the consequences of what we request.” (Policymaker)
Better-worded version:
“Back when you 5 years old, you may’ve asked your parents for a lot of things. What would’ve happened if they’d done everything you asked for? If humanity eventually invents smart AI, we’d have our own literal-minded ‘parent’ catering to our explicit demands. This could go very wrong.”
“How well would your life, or the life of your child go, if you took your only purpose in life to be the first thing your child asked you to do for them? When we make an Artificial Intelligence smarter than us, we will be giving it as well defined of a goal as we know how. Unfortunately, the same as a 5 year old doesn’t know what would happen if their parent dropped everything to do what they request, we won’t be able to think through the consequences of what we request.” (Policymaker)
Better-worded version: “Back when you 5 years old, you may’ve asked your parents for a lot of things. What would’ve happened if they’d done everything you asked for? If humanity eventually invents smart AI, we’d have our own literal-minded ‘parent’ catering to our explicit demands. This could go very wrong.”
Nice work there!