Finding signal on Twitter is more difficult than it used to be. We curate the best tweets on topics like AI, startups, and product development every weekday so you can focus on what matters.

Googlebot crawls more web pages than OpenAI or Microsoft

Cloudflare CEO Matthew Prince says Googlebot sees 3.2x more of the web than OpenAI, and 4.8x more than Microsoft. And he worries this advantage will allow Google to run away with the AI race, with no one else being able to catch them. "For every one page that OpenAI sees, Google is seeing 3.2." "What I worry about is, because Google has this unique access to the web that nobody else has, the game might just go to them. Because at the end of the day, whoever has the most data wins in the era of AI."

Video thumbnail
View

Topics

Read the stories that matter.

Save hours a day in 5 minutes