Elasticity Institute's @cherylwoooo draws the line between RSI and "foom," saying self-sustaining acceleration can happen without an intelligence explosion: "When I say RSI, I meant a self-sustaining acceleration. You could fix the other inputs, but with more and more AI progress, you could have acceleration in capabilities." "Those math results and TasteVal update me toward there will be some type of acceleration in capabilities." "I'm less updated on whether there will be a fast takeoff or…

Theo Jaffee@theojaffee3d ago

SF people are increasingly conflating “RSI” with “foom”, as though automating AI R&D will *certainly* cause huge discontinuous speedups in the rate of model capability advancements on *all* tasks. In practice this could be much slower and more jagged