Press Space to continue
AI systems becoming harder to control as capabilities increase
Press Space to continue
Five recent trends in AI that are very worrying in combination: 1. AI companies are increasingly unable to control the AI systems they are already building. 2. Current AIs go rogue sometimes in increasingly complex ways, and can coordinate with each other to evade human oversight. 3. AIs are getting more capable and more sophisticated in their ability to take rogue actions and cover their tracks. 4. OpenAI and other AI companies are potentially considering new forms of training that make…
miclchen@miclchenSep 2
All three pillars of a safety case look about to fall. We are rather likely to have highly capable, poorly monitorable, dubiously aligned AI agents working autonomously inside the world's most consequential organizations.