Press Space to continue
Curated tech Twitter/X posts on AI, startups, and product development—signal without the doomscroll, updated on weekdays.
Press Space to continue
Press Space to continue
The distinction between next token prediction and RL post-training is easily overstated. An RL pipeline can be reframed as a next token prediction objective and vice versa. What gets learned in either case is jointly determined by the learning objective and the training distribution. From the model's POV, it's gradient updates all the way down. Suppose you generate many successful reasoning trajectories and use this as data for a pre-training corpus. Next-token prediction then teaches the…