Edit: looks like habryka had the same thought slightly before I did.
Nitpick: I think your title is perhaps slightly misleading, here’s an alterative title that feels slightly more accurate to me:
RAND experiment found current LLMs aren’t helpful for bioweapons attack planning
In particular:
I don’t think (based on what I’ve quickly read) that RAND made a statement about their overall belief.
The experiments are specifically related to “biological weapon attack planning” which might not cover all phases of development (I’m overall ensure exactly what fraction of bioweapons development this corresponds to). Regardless, it certainly is considerable evidence for current LLMs not being non-trivially helpful with any part of bioweapons development even if it doesn’t test this directly.
Thanks for the link post!
Edit: looks like habryka had the same thought slightly before I did.
Nitpick: I think your title is perhaps slightly misleading, here’s an alterative title that feels slightly more accurate to me:
RAND experiment found current LLMs aren’t helpful for bioweapons attack planning
In particular:
I don’t think (based on what I’ve quickly read) that RAND made a statement about their overall belief.
The experiments are specifically related to “biological weapon attack planning” which might not cover all phases of development (I’m overall ensure exactly what fraction of bioweapons development this corresponds to). Regardless, it certainly is considerable evidence for current LLMs not being non-trivially helpful with any part of bioweapons development even if it doesn’t test this directly.