Press Space to continue
Finding signal on Twitter is more difficult than it used to be. We curate the best tweets on topics like AI, startups, and product development every weekday so you can focus on what matters.
Press Space to continue
Press Space to continue
Timeline of open-weight models (roughly chronological): 2023: open weight models are toys. Llama 1/2 are fun to fine-tune but terrible to actually rely on. Everyone quietly still calls the closed-source API when the task matters. The gap is common knowledge and nobody argues about it. Early 2024: Mixtral shows up and it's the first time a lot of people believe this could be usable. Mid-late 2024: Llama 3 / 3.1 405B lands and for the first time an open weight model is being benchmarked…