Some Anthropic statements have suggested that sharing is hard in general.
If they said that then they are speaking nonsense IMO. Once you have your stuff set up it’s a button you click. You have to trust that the evaluator won’t leak info or soil your reputation without good cause though.
Possibly he didn’t just mean technically difficult. And possibly Politico took this out of context. But I agree this quote seems bad and clarification would be nice.
If they said that then they are speaking nonsense IMO. Once you have your stuff set up it’s a button you click. You have to trust that the evaluator won’t leak info or soil your reputation without good cause though.
Jack Clark: “Pre-deployment testing is a nice idea but very difficult to implement,” from https://www.politico.eu/article/rishi-sunak-ai-testing-tech-ai-safety-institute/
Possibly he didn’t just mean technically difficult. And possibly Politico took this out of context. But I agree this quote seems bad and clarification would be nice.