Press Space to continue
Finding signal on Twitter is more difficult than it used to be. We curate the best tweets on topics like AI, startups, and product development every weekday so you can focus on what matters.
Press Space to continue
Press Space to continue
our models got gold on a bunch of olympiads. this one hits home! ๐ Asian Physics Olympiad (APhO): Perfect score, theory exam ๐ International Physics Olympiad (IPhO): Perfect score, theory exam ๐ฅ International Mathematical Olympiad (IMO): Gold medal ๐ฅ International Chemistry Olympiad (IChO): Gold-medal-level performance ๐ฅ Romanian Masters of Mathematics (RMM): Gold-medal-level performance
To understand whether we're making genuine progress on reasoning, we entered our AI models in five STEM Olympiad competitions. The results: ๐ Asian Physics Olympiad (APhO): Perfect score, theory exam ๐ International Physics Olympiad (IPhO): Perfect score, theory exam ๐ฅ International Mathematical Olympiad (IMO): Gold medal ๐ฅ International Chemistry Olympiad (IChO): Gold-medal-level performance ๐ฅ Romanian Masters of Mathematics (RMM): Gold-medal-level performance The types of problems in the Olympiad competitions are exceptionally hard, demanding deep chains of reasoning, creative insight, and flawless argumentation. To test pure reasoning capability, we disallowed all tool use, meaning no search, no coding, and no calculator. We have deep admiration for the contestants and committees behind these competitions, and are grateful for their support in enabling our participation.