There are humans with a remarkable knack for coming up with new nanotech inventions. I don’t think they (we?) have systematically different and worse motivations than normal humans. If they had even more of a remarkable knack—outside the range of humans—I don’t immediately see what would go wrong.
If you personally had more time to think and reflect, and more working memory and attention span, would you be concerned about your motivations becoming malign?
(We might be having one of those silly arguments where you say “it might fail, we would need more research” and I say “it might succeed, we would need more research”, and we’re not actually disagreeing about anything.)
There are humans with a remarkable knack for coming up with new nanotech inventions. I don’t think they (we?) have systematically different and worse motivations than normal humans. If they had even more of a remarkable knack—outside the range of humans—I don’t immediately see what would go wrong.
If you personally had more time to think and reflect, and more working memory and attention span, would you be concerned about your motivations becoming malign?
(We might be having one of those silly arguments where you say “it might fail, we would need more research” and I say “it might succeed, we would need more research”, and we’re not actually disagreeing about anything.)