.@gwern saw AI scaling coming before almost anyone outside OpenAI. How was he able to predict this trend? He told me that his core idea was that intelligence is just compute, data, and parameters - no clever algorithm needed. He didn't come to this view in a eureka moment. He just read paper after paper and nudged his priors a little each time, until the trend seemed obvious.