Fascinating read from @IAmPascio: safety regulations are treating AGI like an entity with a killswitch, while ignoring the emergent substrate that is likely forming (perhaps across inter-model APIs). Current policies and alignment techniques are building for a singular AGI with a name, a server, a CEO to sue. If superintelligence is a network, how do you regulate the swarm?

IAmPascio@IAmPascio17h ago

What if AGI is already here, and it's made of... children? The superintelligence, the singularity, AGI, whatever you call it, the one we're so scared of is, ironically, also the one we most likely won't see coming. This essay is going to probably be a pretty