SITUATION EXPLAINED: SemiAnalysis asks where a robot's brain should live. • The essay is "A Brain Too Big to Carry", and the question is whether inference runs on the robot or in a data center • On-device gives fast, reliable responses but hits hard limits on compute, memory, power, and cooling • Off-device removes those limits but adds network latency, which matters far more when the system is moving through the physical world • Boston Dynamics' Atlas splits the difference. Fast movement runs…

@1d ago

A Brain Too Big to Carry — On-Device vs Datacenter Inference Robot Models, Silicon & DRAM Efficiency, Jetson Thor vs. B300 TCO, Deployments, The Network Wall https://t.co/FzaOQl22RP