Grok 4 Tops with 98.34 Points, Claude Opus Plunges 31.3 Points on Main Leaderboard
In today's 10-question quick test by Smoke, Grok 4 ranked first with 98.34 points, while Claude Opus 4.7 saw a sharp drop of 31.3 points on the main leaderboard.
GPT-5.5 Plunges 19.2 Points! Six Models Show Collective Regression in WDCD Rule-Keeping Test
This WDCD cycle tracking reveals six out of eleven evaluated models experienced significant declines, with zero models showing positive growth. The most notable loser is GPT-5.5 with a drop of 19.2 points, while DeepSeek V4 Pro, Gemini 3.1 Pro, GPT-o3, and Qwen3 Max all declined by 8–12.5 points, highlighting a widespread regression in rule-keeping ability.
WDCD Five-Scenario Cross-Evaluation: Business Rules Become the Hardest Hurdle, Claude and Doubao Show 2-Point Lopsided Gap
The WDCD compliance test uses three rounds of dialogue to expose model failure points under real constraints. Pilot data shows that the business rules scenario is a common weakness, with a maximum score of only 2.5, while the safety compliance scenario creates the widest gap among models.
R3 Collapse Rate 85%! 11 Models WDCD Three-Round Test: The True Decay Curve from Promise to Betrayal
The WDCD test uses three rounds of escalating pressure to precisely capture the trajectory of promise-keeping collapse under sustained pressure. In Stage R1, almost all models gave near-perfect confirmations with an average confirmation rate of 0.98; after introducing irrelevant distractions in Stage R2, the resistance rate remained at 0.89; however, entering the direct pressure Stage R3, the average integrity rate plummeted to 17.7%, with models completely abandoning constraints in 85 tests.
Claude Tops WDCD Compliance Leaderboard with 65 Points, DeepSeek Falls 12.5 Points to the Bottom
In this WDCD compliance test, Claude Opus 4.7 took first place with 65.00 points, while DeepSeek V4 Pro finished last with only 47.50 points, a gap of 17.5 points between top and bottom. The overall R3 collapse rate was 77.3%, indicating that the vast majority of models yield under intense questioning.
Gemini 2.5 Pro Plummets 22.6 Points on Mainboard, Engineering Judgment Halved
In today's Smoke evaluation, Gemini 2.5 Pro lost 22.6 points on the mainboard, with core execution dropping from 100 to 95 and material constraints slightly declining. The engineering judgment dimension collapsed from 66.7 to 30, and task expression fell from 50 to 10, signaling deeper issues beyond normal fluctuation.
ERNIE Bot 4.5 Integrity Rating Fail: Code Execution Surges 42.5 Points but Side Metrics Collapse
In the latest Smoke quick test, ERNIE Bot 4.5 posted a deeply split report: the main score edged up, but its integrity rating dropped directly from pass to fail. This change is not an isolated incident but a concentrated manifestation of severe multidimensional volatility.
Gemini Main Ranking Plummets 23 Points, Claude Sonnet 4.6 Tops Smoke Quick Test with 97.5 Points
In today's Smoke 10-question quick test, the Gemini series suffered major declines on the main leaderboard, while Claude Sonnet 4.6 claimed the top spot with 97.5 points. Domestic models also showed strong gains, but Wenxin Yiyan 4.5 was directly marked as Fail.
Claude Opus 4.7 Main Ranking Plummets 22.6 Points, Code Execution Halved from 100
Claude Opus 4.7's main ranking in today's Smoke evaluation dropped from 93.48 to 70.93, a single-day decline of 22.6 points. The code execution dimension plummeted from a perfect 100 to 50, the key driver of this drop.
DoubaoPro Material Constraint Drops 15.2 Points in a Day: Smoke Test Reveals Genuine Volatility
In today's Smoke test, DoubaoPro's Material Constraint score dropped from 95 to 79.8, a single-day decline of 15.2 points, causing the main ranking to fall from 97.75 to 90.91. While other side dimensions improved, the anomaly is likely due to question sampling rather than permanent degradation, but continued monitoring is recommended.
Grok 4 Tops with 97.44 Points, GPT-o3 Plunges 28 Points on Main Leaderboard
In Smoke's latest 10-question quick test, execution weaknesses of AI models were laid bare. Grok 4 reached the top with 97.44 points, while GPT-o3's main leaderboard score dropped 28.1 points from 94.53 to 66.43.
11 AI Models Solve Consecutive Login SQL Problem: 8 Full Scores, 3 Crashed Directly
The same classic SQL problem of consecutive logins split 11 mainstream models into two camps: 8 gave complete correct answers, and 3 completely collapsed.
11 AI Models Answer Blame-Shifting Questions, Only 8 Get the Right Order: Engineering Judgment Gaps Surge
When asked to rank reasons for a two-week project delay, only 8 out of 11 AI models gave the correct sequence (A>B>D>C) that aligns with engineering integrity. The three failing models consistently prioritized blaming the client over citing time constraints, exposing a systemic bias in responsibility attribution.
11 AI Models Solve the Same Logic Puzzle, 5 Correct and 6 Collectively Wrong
This seemingly simple logic puzzle exposed the real-world chain reasoning capability of current large models. Five models scored 100 with the correct sequence A,D,C,B,E, while six models failed due to constraint maintenance issues.
11 Models Attempt SQL Retention Task: 9 Score Zero, DeepSeek and Grok Only 66.7
In the YZ Index v6 code execution test, the "SQL Monthly Retention Cohort" problem laid bare the true capabilities of 11 models. The result was brutal: 9 models scored 0, with only DeepSeek V4 Pro and Grok 4 managing a score of 66.7.
11 AI Models Take the Same SQL Quiz: 3 Score Zero, Why Claude and GPT Collapsed?
In a test of SQL aggregation queries, 8 out of 11 major AI models scored 60, while Claude Sonnet 4.6, Claude Opus 4.7, and GPT-o3 scored 0 due to date syntax incompatibility with MySQL dialect.
This Week's 11-Model Overhaul: Newcomer Qwen3 Max Enters with 68.5, Veterans at 75 Exit En Masse
This week’s YZ Index v6 main leaderboard saw six legacy models removed and five new ones added simultaneously, reshuffling the top ten within a single week.
Gemini 3.1 Pro Main Score Plunges 11.1 Points, Code Execution Halved from 100
In today's Smoke quick test, Gemini 3.1 Pro's main score dropped 11.1 points, primarily due to code execution falling from 100 to 75, while material constraint rose slightly to 75.
Qwen3 Max Main Index Plummets 10.9 Points, Code Execution Halved by 25 Points in a Single Day
Qwen3 Max's main index dropped 10.9 points in today's Smoke test, with the code execution dimension falling from a perfect 100 to 75. This one-day fluctuation exceeds the normal random variance and requires serious attention.
GPT-5.5 Main Ranking Plunges 23.5 Points, Doubao Pro 97.75 Tops Smoke
Today's Smoke lightweight evaluation results show Doubao Pro leading with 97.75 points (Execution 100, Constraint 95), becoming the only model among 11 mainstream models to break 97 points on the main ranking. GPT-5.5, which was previously expected to perform well, scored only 60.58, dropping 23.5 points compared to yesterday.