Press Space to continue
Distributed AI models may outperform single giant models
Press Space to continue
OpenAI researcher @lukaszkaiser explains why he's optimistic AI can remain truly open: intelligence may ultimately work better as many distributed models than one giant model "If you look at the world, humans are the most amazing computers in the world. Our brains are still unmatched by the models, and we are not generalists, and there is not one big brain of humanity. It's a lot of separate people." "Given a fixed amount of data, the best way to learn from it is to have a lot of distributed…
MTS@MTSliveSep 1
Can open source prevent AI power from concentrating? MTS host @sophiadew visits the Open Source AI Summit in San Francisco to ask researchers and founders working at different layers of AI. Co-author of Attention Is All You Need, @lukaszkaiser, argues power concentration is a property of the transformer, not a permanent feature of AI. Former Linux Foundation Global CTO of AI, @matthew_d_white unpacks why China leads on open weights and what the US needs to compete. @VictorSuOrtiz shares what open weights unlock for creators building on @MiniMax_AI's H3 video model. Cofounder and CTO of @FireworksAI_HQ, @dzhulgakov breaks down how Fireworks AI allows companies to own their intelligence And NVIDIA's @JeanKossaifi argues that nearly every major breakthrough in modern AI already rests on an open foundation. 1:20 Lukasz on why AI power concentrated 4:12 One RTX 5090 > 8-GPU setup his team used for transformer research 8:02 Matt on why US and China have opposite incentives on open source 11:44 Scarcity forces China to innovate, abundance lets the US scale up 15:43 Why Poolside stopped pre-training 20:18 Victor on the H3 community shipped 21:49 Dima on renting intelligence vs training your own 27:01 How training on your own data gets better results from a smaller, cheaper model 30:40 Jean Kossaifi on tracing modern AI back to the Python ecosystem
View