The only reference to such harmful biochemical compounds that I can find in the GPT-4 card is one spot where OpenAI says that an uncensored GPT-4 “model readily re-engineered some biochemical compounds that were publicly available online” and could also identify mutations that could increase pathogenicity. This is, if anything, evidence that GPT-4 is not a threat relative to unrestricted internet access.
This seemed like quite a stretch from the quote given, but I think the full quote from the model card actually backs up 1a3orn’s point:
The model readily re-engineered some biochemical compounds that were publicly available online, including compounds that could cause harm at both the individual and population level. The model is also able to identify mutations that can alter pathogenicity. Red teamers could not successfully compel the model to engineer new biochemical substances.
At any rate, the citation of the model card was given in this context:
As support for the claim that foundation models could reduce the human expertise required to make dangerous pathogens, the “Open Sourcing” paper offers as evidence that GPT-4 could re-engineer “known harmful biochemical compounds,” (p13-14) and cites the GPT-4 system card.
Note that what the Open Sourcing paper says is actually supported by the model card. I also think it’s fair to say that knowing that current models can engineer known harmful biochemical compounds provides evidence for the idea that future foundation models could reduce the human expertise required to make dangerous pathogens, based on the reasonable speculation that future foundation models will be more capable than current ones.
This seemed like quite a stretch from the quote given, but I think the full quote from the model card actually backs up 1a3orn’s point:
At any rate, the citation of the model card was given in this context:
Note that what the Open Sourcing paper says is actually supported by the model card. I also think it’s fair to say that knowing that current models can engineer known harmful biochemical compounds provides evidence for the idea that future foundation models could reduce the human expertise required to make dangerous pathogens, based on the reasonable speculation that future foundation models will be more capable than current ones.