Open-source AI labs are building on each other's research | Tech Twitter
Open-source AI labs are building on each other's research
Press Space to continue
DeepSeek-V4 uses the Muon optimizer with Kimi's recipe to scale it for LLM training. meanwhile, Kimi K2 (and K2.6) uses DeepSeek-V3's architectural techniques (ultra-sparse MoE + MLA). open-source AI labs are compounding on each other's research, and it's the way it should be.