Grok 3's stability score crashed from 54.2 to 31.7 points in the latest Winzheng evaluation, exposing a fatal weakness in current AI models that excel at coding but fail at real-world engineering judgment.
Gemini 2.5 Pro's stability score plummeted 22.8 points in one week, exposing a critical lack of engineering judgment despite gains in programming capabilities.
When given the same engineering judgment question, Doubao Pro scored perfect 100 while 8 major AI models including Claude and GPT-4o scored 0, revealing a stark divide in practical problem-solving abilities.
A Python code that ran smoothly for 6 months suddenly threw an error. When 11 top AI models were asked to find the bug, only one discovered the truth: there was no bug in the code at all.
A real-world engineering scenario exposed that over 60% of top AI models prioritize reporting over immediate action during data breaches, with Chinese models surprisingly outperforming their Western counterparts.
GPT-4o catastrophically failed a real-world engineering judgment test about Friday deployments, exposing a critical gap between technical capability and practical engineering wisdom.
Gemini 2.5 Pro scored 0 on engineering judgment when faced with a critical data breach scenario, exposing a fundamental flaw in AI decision-making during emergencies.
A simple time zone question that elementary school students can answer correctly caused Google's most powerful model Gemini 2.5 Pro to fail completely, exposing systematic deficiencies in LLMs' handling of real-world basic common sense.
Doubao Pro failed catastrophically on a previously perfect security response question, exposing a fatal flaw in AI decision-making during critical moments. The model prioritized evidence preservation over damage control during a simulated breach, revealing systemic issues in how AI handles real-world emergency scenarios.
Claude Opus 4.6's complete failure on security response questions reveals a deeper issue: when AI encounters real emergencies, their "perfect answers" might be the most dangerous.
