Press Space to continue
Finding signal on Twitter is more difficult than it used to be. We curate the best tweets on topics like AI, startups, and product development every weekday so you can focus on what matters.
Press Space to continue
Press Space to continue
General Compute, an inference cloud for alternative chips, is buying Cerebras systems to run beside its Nvidia GPUs. Every request gets split in two, with the GPUs reading the prompt and Cerebras writing the answer. Putting two rival chipmakers on a single request sounds backwards. Here's the mechanism behind the split. Prefill reads your whole prompt in one pass, a parallel math job GPUs were built for. Decode writes the answer one token at a time, and that part is limited by how fast the…
🚨 BREAKING: Super excited to announce we're deploying the world's fastest inference with @Cerebras. Talk to any developer and they're excited to build with 20x faster AI... the problem is there's almost no compute available. We're here to solve that. Using GPUs for prefill - it's now more affordable than ever too. Thank you to the whole Cerebras team and excited to grow this partnership. First tokens live Q127 🚀