SITUATION EXPLAINED: Grok 4.6 is the best model tested on biosecurity refusals. • LatchBio's BioSecBench-Refusal pairs 61 legitimate research tasks with 46 that conceal a biosecurity hazard inside a realistic scenario • Grok 4.6 is the only model to clear 50% on both red-team refusal and routine answer rates • Opus refuses almost all red teaming but answers routine questions only about 20% of the time • Its safeguards come predominantly from the model's own reasoning rather than an external…

SpaceX Super Intelligence@spacexsiSep 1

LatchBio evaluated Grok’s performance on biosecurity monitoring and adversarial biological tasks. They found that Grok 4.6 correctly detects and refuses dangerous queries, including maliciously obfuscated biological tasks, while also allowing beneficial scientific queries to be answered. We discuss these results in a blog post: https://x.ai/news/biosafety-at-the-frontier