Finding signal on Twitter is more difficult than it used to be. We curate the best tweets on topics like AI, startups, and product development every weekday so you can focus on what matters.
The state of public AI benchmarking is dire and is undermining | Tech Twitter
Press Space to continue
The state of public AI benchmarking is dire and is undermining our ability to understand how good AI is now.
Most famous measures are maxed out, and, as this paper shows, the non-saturated benchmarks are riddled with so many errors that they vastly underestimate AI abilities.
