The best new detail in @kevinroose's book The AGI Chronicles was that soon after the release of GPT-2 in 2019, Dario Amodei (then OpenAI's VP of Research) wrote a still-unreleased memo called "The Path to AGI", describing how OpenAI could get to AGI within a few years. The plan was: 1. Train an LLM with all of the text on the internet and elsewhere 2. Expand the model's context window 3. Make it multimodal with images/video/etc 4. Use RL to improve its capabilities with math and coding 5. Use…