Let’s agree that the first step towards AI alignment is to refrain from building intelligent machines that are designed to kill people.
I don’t get it; why would ‘refraining from designing intelligent machines to kill people’ help prevent AI from killing everyone? That’s a really bold and outlandish claim that I think you have to actually defend and not just tell people to agree with… Like, from my perspective, you’re just assuming the hard parts of the problem don’t exist, and replacing all the hard parts with an easier problem (‘avoid designing AIs to kill people’). It’s the hard parts of the problem that seem on track to kill us; solving the easier problem doesn’t seem to help.
Yes, we need to solve the harder alignment problems as well. I suggested limited intelligent weapons as the first step, because these are the most obviously misanthropic AI being developed, and the clearest vector of attack for any rogue AI. Why don’t we focus on that first, before we focus on the more subtle vectors.
The end of the post you linked said, basically, “we need a plan”. Do you have a better one?
I don’t get it; why would ‘refraining from designing intelligent machines to kill people’ help prevent AI from killing everyone? That’s a really bold and outlandish claim that I think you have to actually defend and not just tell people to agree with… Like, from my perspective, you’re just assuming the hard parts of the problem don’t exist, and replacing all the hard parts with an easier problem (‘avoid designing AIs to kill people’). It’s the hard parts of the problem that seem on track to kill us; solving the easier problem doesn’t seem to help.
Yes, we need to solve the harder alignment problems as well. I suggested limited intelligent weapons as the first step, because these are the most obviously misanthropic AI being developed, and the clearest vector of attack for any rogue AI. Why don’t we focus on that first, before we focus on the more subtle vectors.
The end of the post you linked said, basically, “we need a plan”. Do you have a better one?