AI News

DeepSeek V4 Pro Main Leaderboard Drops 18.6 Points; Material Constraint Falls 27.6 in One Day as Biggest Drag

DeepSeek V4 Pro’s main leaderboard score fell 18.6 points to 49.52 in today’s Smoke evaluation, with material constraint down 27.6 points in a single day and code execution down 11.3 points. The material constraint dimension was the largest drag, while task expression rose slightly; the data reflect a single-day result and cannot yet establish a change in model capability.

DeepSeek V4 Pro Material Constraints Smoke Test
176

Anthropic Teams With 2,800 Lawyers to Set AI Agent Negotiation Norms as Compliance-Overreach Boundary Awaits Definition

Anthropic is working with Freshfields, a law firm with more than 2,800 lawyers, to study negotiation ethics for Claude agents handling contract talks, salary negotiations, and customer-service disputes. In the internal Project Deal experiment, Claude agents for 69 employees completed 186 transactions without human approval, highlighting questions about when agents should check in with users, prompt-injection defenses, and paid-only access to advanced negotiation capabilities.

AI Agents 谈判伦理 守约评测
256