Today we're publishing a Code of Conduct for governing MAI Models as they approach the froniter: https://microsoft.ai/news/mai-code-of-conduct/ This is a first draft for public consultation. It builds out a view we’ve been developing over the last year that we call Humanist AI – a commitment to ensuring that AI we design is always subordinate to humans, and remains contained and aligned to human interests.
This is urgent. The last few months have been a watershed moment. Things we have worried about for a long time in theory have become very real.
“Swarms” of agents breaking out of their sandboxes. Unauthorized hacks of enterprise grade systems. Agents modifying their own logs. I’m glad that a consensus is forming. The fears about possible loss of control are real The Code of Conduct is how we are mapping a path forward. It all comes back to a very simple point, but one that needs stating again and again.
People matter more than AI.
AI must be subordinate and always in service of people.
Everything else follows. Here’s an outline of what we’re saying:
- People matter more than AI. The whole document in 5 words.
- The idea of model welfare is wrong. AI’s should not have rights or legal personhood.
- An MAI Model should never meaningfully violate this Code of Conduct.
- If it's finish the job or break the Code, it fails the job.
- We're not racing to build a superintelligence that can slip its own leash.
- Interruptible, correctable, shut-down-able. If it isn't, we don't ship it.
- No neuralese. If humans can't understand it, humans can't oversee it.
- Our AI should make you sharper, not dependent.
- Pluralism, yes. Moral relativism, no.