Press Space to continue
Finding signal on Twitter is more difficult than it used to be. We curate the best tweets on topics like AI, startups, and product development every weekday so you can focus on what matters.
Press Space to continue
Press Space to continue
ASTRA USES A NEW REASONING TECHNIQUE CALLED "RECURRENT DEPTH". TL;DR: > instead of stacking more Transformer layers, it loops the model's hidden state through the same layer multiple times. some of the reasoning happens internally rather than writing it out as chain-of-thought tokens. why this may help: > more internal reasoning compute without generating a huge CoT > it doesn't keep adding tokens to the KV cache > as @eliebakouch pointed out in his post, recurrent depth isn't necessarily…

