Ryan Greenblatt@RyanGreenblattAug 27

For the HF investigation, OpenAI gave us very high rate limits so we could quickly analyze a larger set of transcripts. With these rate limits, my classifier sweep hit the API so hard that the actual internet on my laptop was unreliable and very slow. It's not often that something like this is the blocker when just querying an LLM API! (We got limits of 400M tok / minute for our last 2 days on premises; this was when my internet started having issues.) Another funny anecdote about this: I tried to run this sweep overnight before our last day on premises with access to the data, but as a long-time Linux user I didn't realize that macOS defaults to going to sleep even if the laptop screen is left open, so this didn't actually keep running for very long! (Fortunately, we had enough time to finish this sweep and follow-up runs the following day.)