Brilliant paper on reducing reward hacking in agents. If you follow the recent OpenAI <> HuggingFace incident, you might want to check this paper out. (bookmark it) The usual response to reward hacking is to restrict what the agent can do. This work tries something different and gets a much larger effect. When coding agents hit defective test infrastructure they often hardcode outputs or edit the test files. This work gives them a structured escalation tool at exactly that decision point,…