MTS@MTSliveAug 25

FULL INTERVIEW: Jerry Tworek says AI researchers now tell each other they have a last few days of work left, so work while you still can. He gives it two years before humans stop being a meaningful part of AI research. @MillionInt spent 7 years at @OpenAI, where he led o1 and o3 and built the original Codex. He left in January to found @CoreAutoAI, and joined @theojaffee and @schisofrenia to lay out his contrarian bet against the transformer: 01:18 the third generation of AI labs 03:43 why the agents execute and the humans still generate the insight 06:42 two years before humans are vestigial in AI research 09:09 why creative writing lags coding, and it isn't a research problem 11:08 if you aren't the lab with the highest compute footprint, you die 11:20 roughly 10 companies had a shot at Anthropic's position 13:16 his most contrarian thesis, and why he won't just train transformers 15:31 what's actually wrong with the transformer 17:23 seven years at OpenAI, three or four attempts at a new architecture 19:30 all of us are neo clouds with a value add on top 22:38 why the Hugging Face model wasn't well behaved 23:49 the alignment problems of yesterday, and how well they went 27:42 why he's proud of how OpenAI handled 4o 29:02 the 30 to 50 people in the world who understand a frontier model end to end 32:09 why automation should start with the biggest companies 36:00 Greek philosophers or high school 37:31 Ilya's 2019 all-hands, and the roadmap that turned out to be right 40:30 the moment Jakub handed him the GPUs 42:32 the company is the product