Not saying that “Sydney is unsafe” is a legitimate criticism, but I doubt OpenAI is run by people with the personal agency or social capital to make any of those decisions. Leadership is following the script for “successful technology company”, and none of those things you mentioned look like things that are in that script.
pretty sure Microsoft is strong enough to do this entirely on their own. check out some of their work on language models, eg GODEL and unilm. all you need is scale!
Even if OpenAI don’t have the option to stop Bing Chat being released now, this would surely have been discussed during investment negotiations. It seems very unlikely this is being released without approval from decision-makers at OpenAI in the last month or so. If they somehow didn’t foresee that something could go wrong and had no mitigations in place in case Bing Chat started going weird, that’s pretty terrible planning.
Why do you believe that OpenAI was the power to decide whether or not Microsoft releases Bing Chat?
They could have
Not developed it for Microsoft.
Developed it for Microsoft, but insisted on proper safety.
Not signed up for whatever deal would allow Microsoft to force it to not do one or two without sufficient alignment checks.
Not saying that “Sydney is unsafe” is a legitimate criticism, but I doubt OpenAI is run by people with the personal agency or social capital to make any of those decisions. Leadership is following the script for “successful technology company”, and none of those things you mentioned look like things that are in that script.
pretty sure Microsoft is strong enough to do this entirely on their own. check out some of their work on language models, eg GODEL and unilm. all you need is scale!
Even if OpenAI don’t have the option to stop Bing Chat being released now, this would surely have been discussed during investment negotiations. It seems very unlikely this is being released without approval from decision-makers at OpenAI in the last month or so. If they somehow didn’t foresee that something could go wrong and had no mitigations in place in case Bing Chat started going weird, that’s pretty terrible planning.