aws spent at least a decade acquiring a bunch of customers who pay by cpu time before they launched serverless options the root idea was that aws could absorb idle CPU costs because they had enough demand for it to all balance out with LLM inference the idea of serverless is here on day 1 - we all pretty much want to pay by token but the providers do not have enough scale to actually offer that product well and idle GPUs are a lot more expensive