I'm still fascinated by the enormous chasm between the AI labs and the traditional cyber-security world. This is Marcus Hutchins from LinkedIn:
"Mirai is already self-propagating across millions of IoT devices without the help of any AI. It's simply not needed, and it adds unnecessary complexity....Any remotely intelligent threat actor would just use a powerful unquantized models to reverse engineer & find vulnerabilities in obscure devices and write normal (AI-free) self-propagating code. Ironically, they typically do this by stealing Anthropic API keys and using Anthropic's models, not open-weight ones."
Not an expert but can't help but get the sense that the AI world has a lot of technical knowledge but much less real-world experience of how cyber threats manifest in practice.