MTS@MTSlive20h ago

.@stevesi explains why words like "goal-seeking," "cheating," and "secretly coordinating" mean one thing to AI researchers and something terrifying to policymakers: "There's a long history in all fields of academic research to basically be too cutesy about things, 'cause that's how you get attention in academia. So it's no surprise that something that had its roots in academia carried forth all of this terminology. But it's just time to stop." "It's goal-seeking in this old-school technical sense. There's a curve, and it's trying to get to the min or to the max. But when a normal person like a congressman hears goal-seeking, they think of a person trying to get an A in college." "When they hear cheating, they hear that they did the thing you're not allowed to do. And when they hear secretly coordinating, they think of spies invading the country. They don't think of two pieces of software with a semaphore." "All the language is absolutely destroying this dialogue." @a16z