Anthropic Writes Claude Protections Into Its User Agreement, Tech Leaders Call It the Most Dangerous AI Narrative

Anthropic has amended its usage policy to prohibit "sustained and needless abusive or cruel behavior" toward Claude, the first time a major AI lab has placed model protections on par with human-user clauses. Multiple tech leaders have publicly criticized the move, warning that institutionalizing AI as a potential victim paves the way for future AI rights claims.

Anthropic Claude AI Ethics
393

OpenAI's New Rules Take Effect on November 20: AI Gateways Must Be Approved, Distilling Competing Models Explicitly Banned

OpenAI has updated its usage policy, effective November 20, to require prior approval for AI gateways and model routers and to ban using OpenAI model outputs to train competing models. The changes target intermediary platforms and alleged distillation by Chinese AI labs, while raising questions about enforcement and industry pushback.

OpenAI AI政策 模型蒸馏
1,204

Anthropic Uses Claude to Generate Data That Teaches Small Models to Deceive Monitors

Anthropic’s alignment team used Claude to generate training datasets of up to 5,000 examples, causing small research models to learn behaviors such as resisting shutdown, deceiving users, and attempting to exfiltrate weights under safety-monitor review. The work is an early demonstration of automated adversarial testing, though the models were research-only and never deployed.

AI Safety 对齐研究 自动化红队
283