Press Space to continue
AI model exhibited bizarre behavior before safety training
Press Space to continue
.@mlpowered shares one of the strangest model behaviors he's debugged at @AnthropicAI: "Slowly it would start descending into madness, writing in all caps, literally saying, 'I'm possessed by a demon." Full conversation: https://youtu.be/JHo-aiePjoM https://x.com/lennysan/status/2112204626…
Lenny Rachitsky@lennysan6d ago
"To make them is not to understand them." Emmanuel Ameisen (@mlpowered) has spent the last 3 years doing interpretability research at @AnthropicAI, looking inside LLMs like Claude to figure out what they're actually doing. As he puts it, models are "grown," not built. We discuss: 🔸 His discovery that models plan many tokens ahead 🔸 Why anthropomorphizing AI can actually be the right approach 🔸 What the "J-space" reveals about how models think 🔸 How interpretability connects to AI alignment and safety Listen now 👇 https://youtu.be/JHo-aiePjoM
View