Finding signal on Twitter is more difficult than it used to be. We curate the best tweets on topics like AI, startups, and product development every weekday so you can focus on what matters.
SkyRL Tinker implementation is so cool, but still early days so | Tech Twitter
Press Space to continue
SkyRL Tinker implementation is so cool, but still early days so I went ahead and implemented a basic chunked cross-entropy for 23x less memory usage!
Now most models fit much more seamlessly in memory when combined with Megatron.
