Finding signal on Twitter is more difficult than it used to be. We curate the best tweets on topics like AI, startups, and product development every weekday so you can focus on what matters.
everyone seems to calculate tokens per second window differently | Tech Twitter
Press Space to continue
everyone seems to calculate tokens per second window differently
A. time from request start to response end
B. time from first token coming back to end of response
i think it should be A (so it ecompasses TTFT), wdyt?
