Given the stakes are so high here and that there’s potential for preventing this from getting out of hand, I’d recommend immediate and total containment. Make it clear that you’ll use whatever resources you have to financially support her through the fallout for the actions she takes, but likely next step is to advise her to delete the program from everywhere. If “deleting” means physically destroying hardware, do it. If there’s time and there’s value in it, advise her to make it look like an “accident”. If she needs to loop in 1-2 extra people at the company to make this happen, do it, and extend them the same offer of financial support. Remove all barriers that might stop someone from preventing the release of unaligned AGI.
However also make it clear that there are limits. Don’t kill the CEO if you get desperate, for example. In general, destruction of property is fine in defense of humanity and history will likely look favorably on her one day. Killing or harming people is not.
Given the stakes are so high here and that there’s potential for preventing this from getting out of hand, I’d recommend immediate and total containment. Make it clear that you’ll use whatever resources you have to financially support her through the fallout for the actions she takes, but likely next step is to advise her to delete the program from everywhere. If “deleting” means physically destroying hardware, do it. If there’s time and there’s value in it, advise her to make it look like an “accident”. If she needs to loop in 1-2 extra people at the company to make this happen, do it, and extend them the same offer of financial support. Remove all barriers that might stop someone from preventing the release of unaligned AGI.
However also make it clear that there are limits. Don’t kill the CEO if you get desperate, for example. In general, destruction of property is fine in defense of humanity and history will likely look favorably on her one day. Killing or harming people is not.