Thanks! There are 17k virus genomes in public online databases with metadata (and plenty of metadata embedded in GPT-JT regarding lethality, transmissibility, etc of well known viruses).
Considering the hobbyist group with the most hands-on experience fine-tuning models are the guys using SD to make porn, how long until one of them (one!) gets bored and downloads GPT-JT and fine-tunes it on viruses for the lolz?
12 months? 6?
Then how long until someone (one!) with lab access decides to synthesize a few instead of shooting up a school?
Mod note: I wasn’t quite sure what to do with this post, but have now approved it, but made it not appear for logged out users.
Thanks! There are 17k virus genomes in public online databases with metadata (and plenty of metadata embedded in GPT-JT regarding lethality, transmissibility, etc of well known viruses).
Considering the hobbyist group with the most hands-on experience fine-tuning models are the guys using SD to make porn, how long until one of them (one!) gets bored and downloads GPT-JT and fine-tunes it on viruses for the lolz?
12 months? 6?
Then how long until someone (one!) with lab access decides to synthesize a few instead of shooting up a school?
24 months?
Two wackos away from a nightmare scenario.
Also, the Future of Life just released a podcast where a researcher trying to make low-lethality drugs just switched the prompt to high-lethality to see what would happen… Turns out the model independently discovered VX nerve agent 🤦♂️: https://twitter.com/flixrisk/status/1611364739539427329?s=46&t=RG78qN0CmOSULwUFowilUA
I could be wrong but it seems like engineering pandemic candidates is within the reach of fine-tuning hobbyists today.
This realistically seems like the first Bostrom black ball. Only hope I see is aligned ASI but few people expect it within the next 3 years.