Ivan Zhao
CEO @NotionHQ. Malleable software. Tools for thought.
There’s a gap between how models benchmark and how they FEEL in real-world knowledge work. Our research team wanted to study the latter, so they created the Notion Knowledge Board: live, anonymized traffic scored by an ensemble judge built with researchers at Anthropic and OpenAI. TLDR: — Real work is messier than benchmarks — Open and closed models both have their place — Fast models can also be capable http://labs.notion.com/knowledge-board
Proud to power one of the most agent-pilled companies.
Quoted postRelated profile searches
Building @EurekaLabsAI. Previously Director of AI @ Tesla, founding team @ OpenAI, CS231n/PhD @ Stanford. I like to train large deep neural nets.
ML/AI research engineer. Ex stats professor. Author of "Build a Large Language Model From Scratch" (https://amzn.to/4fqvn0D) & reasoning (https://mng.bz/lZ5B)
Chief Scientist, Google DeepMind & Google Research. Gemini Lead. Opinions stated here are my own, not those of Google. TensorFlow, MapReduce, Bigtable, ...