Press Space to continue
Finding signal on Twitter is more difficult than it used to be. We curate the best tweets on topics like AI, startups, and product development every weekday so you can focus on what matters.
Press Space to continue
Press Space to continue
How to build good evals without getting lost or in trouble. You should see evals as saving past work and replaying it with new models or prompts/skills to see if it improved. This helps you do 3 things: 1. see where it fails so you can tell your boss/users 2. optimize it until it improves 3. make it work on a cheaper / open source model Measuring "if it improved" is 90% of the work and 10% is infra. For infra just tell your agent to store tasks in Cloudflare R2 (a cheap/free way to store…