Dario Amodei calls for government power to block unsafe AI releases
Anthropic’s CEO wants mandatory independent testing of advanced AI and narrowly defined government authority to prevent dangerous deployments.
Anthropic CEO Dario Amodei has called for stronger AI oversight, including government authority to prevent the release of dangerous systems. His proposal would move beyond requiring companies to disclose their safety practices and introduce mandatory outside testing.
The proposed tests would cover cyberattacks, biological weapons, systems escaping human control and automated research that could intensify those dangers. Government intervention would be limited to those risks, with protections against politically motivated or arbitrary decisions. Developers would also need stronger security and prompt reporting of serious incidents.
Amodei argued that transparency requirements were an appropriate earlier step, but that emerging dangers now justify enforceable safeguards. Anthropic has published separate frameworks addressing advanced AI oversight and potential disruption to employment. These are policy recommendations, and the proposed testing system would require government action to become binding.
The day's biggest AI news in one short email, every morning. Plus an instant heads-up when a reset or a big release lands.
More on Anthropic
- Oct 18Anthropic proposes 5% equity allocation for new public benefit fundBig story
- Oct 18Claude Code 2.1.303 is outUpdate
- Oct 16Anthropic gives six METR evaluators broad internal access for AI safety reviewsNews
- Oct 15Anthropic investors reportedly lower IPO valuation expectations as growth slowsStrong rumor
- Oct 15NYC comptroller urges Anthropic to delay IPO over AI safety concernsNews
- Oct 14Claude Code 2.1.300 is outUpdate