Coding tokens are basically infrastructure. Yet, the way companies have approached them amounts to: "Hey all, here's an AWS key. It can spin up anything from a 𝚝𝟹.𝚗𝚊𝚗𝚘 (＄𝟹.𝟾𝟶/𝚖𝚘) to an 𝚙𝟻.𝟺𝟾𝚡𝚕𝚊𝚛𝚐𝚎 (＄𝟺𝟶𝚔/𝚖𝚘). Go wild" And obviously the reason companies don't do this for their core infra is that you need to govern, optimize, and observe usage and costs. The intern might decide to host a static website in that 192 vCPU machine, and you won't be very happy about the…

Vercel Developers@vercel_devAug 31

Set per-user budgets on AI Gateway. ▲ ~/ 𝚟𝚌 𝚊𝚒-𝚐𝚊𝚝𝚎𝚠𝚊𝚢 𝚋𝚞𝚍𝚐𝚎𝚝𝚜 𝚍𝚎𝚏𝚊𝚞𝚕𝚝𝚜 \ 𝚜𝚎𝚝 𝚞𝚜𝚎𝚛 --𝚕𝚒𝚖𝚒𝚝 𝟻𝟶𝟶 \ --𝚛𝚎𝚏𝚛𝚎𝚜𝚑-𝚙𝚎𝚛𝚒𝚘𝚍 𝚖𝚘𝚗𝚝𝚑𝚕𝚢 This works with existing team, project, and API key budgets. https://t.co/ipmYeiL8h1