Press Space to continue
Finding signal on Twitter is more difficult than it used to be. We curate the best tweets on topics like AI, startups, and product development every weekday so you can focus on what matters.
Press Space to continue
Press Space to continue
router lives in the harness, not a gateway, bc the harness knows the task blog: https://langchain.com/blog/how-to-build-…
LangChain gave its coding agent three models and a router. Open SWE, their open-source coding agent, now sends each thread to the cheapest model likely to finish the job. they tested it on 973 threads, half routed and half always on GPT-6 Astra. median cost per thread: $0.94 against $2.61. that's 64% lower. threads ending in a merged PR: 29.2% routed, 27.3% on Astra. LangChain's p-value for that gap is 0.49. the router sent 56% of threads to the balanced model, 34% to the fast one and 10% to the performance one. they also tried always using the fast model. that test ended within a day, because engineers reported low output quality. LangChain's own caveats: the control was the most expensive model, and the router is a proof of concept. Which three models would you put in the tiers?