Press Space to continue
Finding signal on Twitter is more difficult than it used to be. We curate the best tweets on topics like AI, startups, and product development every weekday so you can focus on what matters.
Press Space to continue
Press Space to continue
Apple's new M5 Ultra is a local AI powerhouse. > 512GB unified memory > 1.2TB/s memory bandwidth > 4.5x peak AI compute vs M3 Ultra > can run hundreds of billions of param LLMs The catch: it starts at $5,499, 37.5% more than the M3 Ultra. https://x.com/Hesamation/status/20922433…
Huge upgrade for local AI: Apple introduces M6 and M5 Ultra for a "big leap in performance and AI compute." Capable of running even quantized 70B-class models locally The new M6 model offers (tl;dr): - Up to 4.8x faster LLM prompt processing than M4 - 42% more memory bandwidth at 170GB/s - 12-core CPU and GPU - Dual 16-core Neural Engine - Up to 32GB unified memory The M5 Pro version goes up to 64GB RAM and 307GB/s, making it capable of running even quantized 70B-class models locally. The catch: 32GB limits the regular M6 to smaller models. It should be excellent for 7B–14B models and usable for quantized 30B models, but serious local AI users should choose the 64GB M5 Pro. Anyways, really really cool release!!
