Press Space to continue
Finding signal on Twitter is more difficult than it used to be. We curate the best tweets on topics like AI, startups, and product development every weekday so you can focus on what matters.
Press Space to continue
Press Space to continue
Synthesis Company @cyrusnewday on the Synthesis Bench finding that smarter AI models overthink medical evidence and become overconfidently wrong: "There's this risk of bias task. The risk of bias means, did the scientists properly randomize people? Did the placebo group know they were in a placebo? These sorts of things that can bias the results." "This is one where it seems like the smarter the model is, the more overthinking it does. It's like social anxiety." "It thinks more and it…
We benchmarked agents on scientific evidence synthesis. They can locate evidence—but lack the scientific judgment to turn it into reliable conclusions. Introducing https://t.co/lY8vWYFcEz 🧵 Reference answers from the a World Health Organization center ⭐ https://t.co/QSIcOO0ODo