Press Space to continue
How Perplexity Handles Search Results at Scale
Press Space to continue
A deep dive into how Perplexity serves search results at scale: embeddings for ranking, GPU-based model inference, request batching, running inference servers, and handling latency/throughput trade-offs.
Perplexity@perplexity_aiSep 4
Every answer in Perplexity starts with embedding and ranking models picking the most relevant results for the query. Today we published research on how we built SoTA serving infrastructure behind those models. Read the research: https://t.co/6Rt2XlxoXA https://t.co/ORGt9TjkR0