It’s hard to manufacture things, but it’s not that hard to do so in a way that pretty much can’t kill you. Just keep the computation that is you at somewhat of a distance from the physical experiment, and don’t make stuff that might consume the whole earth. Making a general intelligence is an extraordinary special case: if you’re actually doing it, it might self-improve and then kill you.
It’s hard to manufacture things, but it’s not that hard to do so in a way that pretty much can’t kill you. Just keep the computation that is you at somewhat of a distance from the physical experiment, and don’t make stuff that might consume the whole earth. Making a general intelligence is an extraordinary special case: if you’re actually doing it, it might self-improve and then kill you.