Yeah, exactly. That said I don’t think the event in the story is a “stupid” user error. It’s quite a reasonable one. Suppose nobody considered this problem and this language model was installed in a next-gen smart home assistant, and someone asked it to order them the best possible pizza… in general, I think it’s dangerous to assume anyone is “smart enough” to avoid anything, because if common sense was common the world would make more sense.
Yeah, exactly. That said I don’t think the event in the story is a “stupid” user error. It’s quite a reasonable one. Suppose nobody considered this problem and this language model was installed in a next-gen smart home assistant, and someone asked it to order them the best possible pizza… in general, I think it’s dangerous to assume anyone is “smart enough” to avoid anything, because if common sense was common the world would make more sense.