If you gave me a frontier jailbroken AI model, a few million in bio-lab gear and 10 smart, trained people in a year I could build a virus that’d kill half the world. I don’t even think it’d be particularly hard.

That this is true means that someone is very likely to actually do it.