Hugging Face

We have been shipping 🛳️❤️ 📦 Community Evals & Benchmark Datasets: Benchmark datasets host benchmark leaderboards, you can now contribute eval results by opening a PR to model repositories, all PRs are fed to benchmark datasets 📦 Chat with datasets: agents live in Data Studio, you can ask questions about datasets 📦 Select sections in datasets: Data Studio now has a spreadsheet-like UX, allowing quick selections 📦 MLX compatibility: Find hardware compatible for MLX models and quantized versions in model repositories 📦 You can now save blog drafts and access them from the editor 📖 📦 Datasets now support LanceDB format 📦 Model repositories show snippets for SGLang

We just shipped Community Evals and Benchmark repositories for decentralized evals 🤗 > Scores you and model authors report are on leaderboards 🙌🏻 > Benchmark datasets host live leaderboards of reported results 🚀 > You can open PRs to add scores, they live in model repositories. Community Evals will expose scores currently distributed across model cards, papers, and benchmarks. It won’t solve the differences in scores, but it is transparent!