While it's worrying and worth thinking about, the track record of using AI to generate pharmaceuticals to do good has been "mixed", except really it's just been a bust. It may someday do great things, but not much yet, and one silver lining is that AI-generated toxins are unlikely to improve on the human-designed ones, either.

"That is, I'm not sure that anyone needs to deploy a new compound in order to wreak havoc - they can save themselves a lot of trouble by just making Sarin or VX, God help us."