METR AI researcher @ReillyHaskins02 reveals how METR can now freeze an AI agent mid-eval when its next action looks dangerous: "As we've seen recently, eval inference can be prone to causing real-world harm sometimes. And so we wanted to try and reduce the likelihood of this happening during our evals." "We made a per-action blocking monitor that runs live during select evals. It takes every action before it gets executed by an agent, and it scores it on some threshold of suspicion for…