Every time an AI types one word, a chip somewhere re-reads the entire model from scratch. For a 70B model that's 140 gigabytes, about 35,000 songs' worth, for a single word. Then it does it all again for the next word. When you hit enter, the GPU reads your whole prompt in one shot and the math units stay busy. Then it starts writing the answer one token at a time, and every token needs the full set of weights dragged through the memory bus before the next one can start. The math takes…