It would be great to move from this kind of (hugely impressive!) privately-arranged ad-hoc investigation toward a more formal role for third-party organisations. In the short term, USG could name a roster of qualified third party orgs and increasingly involve them in investigating incidents or assessing framework compliance as it becomes necessary. There are a few benefits of formalising, most obviously: - As @BethMayBarnes points out, OpenAI went for this voluntarily - we don’t know if…

OpenAI@OpenAIAug 26

We have conducted a thorough investigation into the Hugging Face incident. We are releasing a technical report and accompanying blog post that reconstruct the agents’ activity, explain why existing safeguards failed, and detail how we’re preventing recurrence. https://openai.com/index/hugging-face-incident-and-the-road-ahead/