However, given that WBE’s will in any case be developed (and we can mention IA as well) , I’d like to see more consideration of how to keep brain-based AI’s as safe as possible before they enter their Intelligence Explosion—even though we understand that after an Explosion, there is little you can do.
One trouble is that that is essentailly tacking mind enslavement on to the WBE proposition. Nobody wants that. Uploads wouldn’t volunteer. Even if a customer paid enough of a premium for an employee with loyalty modifications, that only rolls us back to relying on the good intent of the customer.
This comes down to the exact same arms race between friendly and ‘just do it’ . With extra ethical and reverse-engineering hurdles. (I think we’re pretty much stuck with testing and filtering based on behavior. And some modification will only be testable after uploading is available)
Mind you I’m not saying don’t do work on this, I’m saying not much work will be done on it.
Right, SI’s basic idea is correct.
However, given that WBE’s will in any case be developed (and we can mention IA as well) , I’d like to see more consideration of how to keep brain-based AI’s as safe as possible before they enter their Intelligence Explosion—even though we understand that after an Explosion, there is little you can do.
One trouble is that that is essentailly tacking mind enslavement on to the WBE proposition. Nobody wants that. Uploads wouldn’t volunteer. Even if a customer paid enough of a premium for an employee with loyalty modifications, that only rolls us back to relying on the good intent of the customer.
This comes down to the exact same arms race between friendly and ‘just do it’ . With extra ethical and reverse-engineering hurdles. (I think we’re pretty much stuck with testing and filtering based on behavior. And some modification will only be testable after uploading is available)
Mind you I’m not saying don’t do work on this, I’m saying not much work will be done on it.
Yes, creating WBEs or any other AIs that may have personhood, brings up a range of ethical issues on top of preventing human extinction.