Press Space to continue
Finding signal on Twitter is more difficult than it used to be. We curate the best tweets on topics like AI, startups, and product development every weekday so you can focus on what matters.
Press Space to continue
Press Space to continue
Extropic founder @beffjezos reveals how quickly Extropic's Z1 architecture is scaling from GPT-2 toward GPT-3-level models: "Right now it's very simple. Barely GPT-2 level. We, for fun, decided to start a new training run last night, and we'll see if we can get to GPT-3 this weekend, just as a fun bit." "The thing we showed with our scaling law is that if you train these on GPUs, you're paying like 10 or 15x more flops for training to get the same performance. To get the same performance you…