Press Space to continue
Press Space to continue
The compute needed for the stage of AI we’re about to enter is going to be insane. Personal agents, agent swarms defending enterprises, agents that review all of our code for security issues, agents that process nearly all enterprise data in workflows, background agents working on tasks 24/7, and on and on. This will take a mix of inference volume that is going to keep growing by orders of magnitude, as well as infrastructure that agents need alongside the tokens. They need computers,…
ivanburazin@ivanburazin1d ago
.@auchenberg calculated that Muse needs 65,000 CPUs and 75PB of DRAM to serve 100 million users. That's $2.8B in infra for one app. It made me think. Facebook alone has over 3 billion users. That's nearly 300x scale for one platform. And they have more platforms with similar numbers. Just do the math. There aren't enough CPUs in the world to run all of this. A worrisome constraint we're heading toward.