How do you plan to prevent someone from asking this oracular AI to generate a computer program that optimizes their company’s stock price and then running it? Also, how do you plan to make sure the oracular AI isn’t a mesa optimizer and doesn’t generalize poorly to complicated plans that affect its internals?
How do you plan to prevent someone from asking this oracular AI to generate a computer program that optimizes their company’s stock price and then running it? Also, how do you plan to make sure the oracular AI isn’t a mesa optimizer and doesn’t generalize poorly to complicated plans that affect its internals?