豆包Pro - AI News | 赢政天下

Doubao Pro Stability Plunges 19.8 Points: Inconsistent Answers to Same Questions Become Biggest Weakness

In this week's Winzheng AI evaluation, Doubao Pro's overall score increased by 16.1 points, but its stability dimension dropped sharply by 19.8 points to 34.7, revealing severe challenges in maintaining answer consistency. This phenomenon may result from technical adjustments like temperature parameter changes or model routing updates, reflecting a trade-off between capability enhancement and output predictability.

Doubao Pro's Stability Plummets by 19.8 Points, Inconsistent Responses Become Its Achilles' Heel

Doubao Pro's stability score crashed from 54.5 to 34.7 in the latest YZ Index evaluation, revealing serious consistency issues that could undermine user trust and enterprise adoption.

Technical Risks Behind Doubao Pro's Sharp Decline in Stability

Doubao Pro's stability score plummeted from 54.5 to 34.7 (a 36.3% drop) this week, despite significant improvements in programming and knowledge work dimensions, revealing a concerning pattern of "progress and regression coexisting" that warrants in-depth analysis.

11 AIs Answer the Same Debugging Question: 5 Score Zero, Where's the Fatal Gap?

Testing 11 mainstream AI models with a real debugging scenario revealed that 45% couldn't even pass, including the newly released DeepSeek V3. The test exposed three critical blind spots in current AI models when handling engineering problems.

11 AIs Answer Same Question: Doubao Scores 100, 8 Models Score 0

When given the same engineering judgment question, Doubao Pro scored perfect 100 while 8 major AI models including Claude and GPT-4o scored 0, revealing a stark divide in practical problem-solving abilities.

Doubao Pro Scores Zero on Perfect Question: Why AI Models Collectively Fall Silent During Real Security Incidents

Doubao Pro failed catastrophically on a previously perfect security response question, exposing a fatal flaw in AI decision-making during critical moments. The model prioritized evidence preservation over damage control during a simulated breach, revealing systemic issues in how AI handles real-world emergency scenarios.

Behind GPT-o3's 8.7-Point Surge: Weekly Testing of 11 AI Models Reveals 3 Dangerous Signals

Weekly testing of 11 top AI models reveals concerning trends: stability has become a luxury, long-context capabilities are collectively declining, and Chinese models are reshaping the competitive landscape.

豆包Pro (7 articles)