In today's Smoke evaluation, Anthropic's Claude Sonnet 4.6 saw a dramatic split: material grounding scores dropped 27.5 points to 69, while code execution surged 25 points to a perfect 100, with the main leaderboard edging up 1.4 points to 86.05.
Today’s Smoke benchmark shows Claude Opus 4.7 leading with 88.75, while two models scored zero in code execution; the real differentiator is material constraint, not execution ability.
GPT-OSS 20B is a new Mixture-of-Experts (MoE) pretraining benchmark introduced in MLPerf Training v6.0, designed to lower the barrier to entry and evaluate sparse architectures. It features variance reduction techniques to ensure fair comparisons and can run on a single 8-GPU node.
In today's Smoke Evaluation, Claude Opus 4.7's main chart score plummeted from 89.43 to 79.86, a net loss of 9.6 points, with code execution collapsing from a perfect 100 to 75. The sharp drop raises the question of whether this signals model degradation or is merely a random sampling fluctuation.
In today's Smoke evaluation, Claude Sonnet 4.6's code execution score dropped from a perfect 100 to 75, directly dragging down the main leaderboard score by 4.2 points. This is not a minor fluctuation but a potential signal: is the model truly degrading, or is it the randomness of daily sampling at play?
In the Smoke Lite evaluation on May 14, 2026, the key finding is shocking: Claude Sonnet 4.6 surged to the top with a main score of 84.68, but the code execution dimension of 8 mainstream AI models collectively dropped by 25 points, causing a drastic reshuffle in overall rankings. This is no coincidence—it’s a hidden crisis signal of rapid iteration in the AI industry.
In the latest round of WDCD (Winzheng Dynamic Contextual Decay) cycle tracking, the core findings are: Gemini 2.5 Pro's score plummeted by 10 points, Grok 4 fell by 7.5 points, while Gemini 3.1 Pro and GPT-5.5 rebounded strongly, gaining 5 points and 7.5 points respectively. This major reshuffle reveals the violent fluctuations in AI models' commitment-keeping abilities.
In the WDCD (Winzheng Dynamic Contextual Decay) compliance test of the YZ Index, we conducted an in-depth cross-evaluation of 11 mainstream AI models across five scenarios. The core finding: the resource constraints scenario scored the lowest overall, averaging only 1.86 points, making it the biggest killer of model compliance; the safety and compliance scenario showed the greatest differentiation, with a 2-point gap between models, exposing the true capabilities of AI in high-risk domains.
In WDCD three-round decay testing, AI models scored an average of 0.96/1 on initial constraint confirmation (R1), but their integrity rate plummeted to 24.5% under direct pressure in R3, with 76 out of 110 tests completely crashing. This exposes AI's "talk compliance, act betrayal" syndrome—superficial obedience that collapses under pressure.
In the pilot phase of the WDCD Compliance Test, the core finding is that Gemini 3.1 Pro and Qwen3 Max tied for the championship with 65.00 points, demonstrating exceptional rule adherence, while Grok 4 finished last with only 42.50 points, suffering a complete collapse in Stage R3, with a 22.5-point gap between the top and bottom, exposing the fragility of AI models under high pressure.
In today’s Smoke Evaluation, Gemini 2.5 Pro’s main index score jumped from 74.00 yesterday to 87.54, a 13.5-point surge, while its integrity rating flipped from fail to pass. However, the engineering judgment score (side index, AI-assisted evaluation) plunged 28.4 points to just 30.00, raising questions about whether this is just random fluctuation or a real model degradation.
Yesterday, Gemini 3.1 Pro was questioned due to an integrity rating of "fail," but today it rebounded strongly: the integrity rating turned from fail to pass, and the main leaderboard score skyrocketed from 74.00 to 88.98, a jump of 15 points. This article analyzes the Smoke evaluation data and explores whether this change is due to random fluctuations or real progress.
In today's Smoke lightweight benchmark (2026-05-13), Claude Opus leads steadily at 89.43 points, while Grok 4 and GPT-o3 suffer collective execution collapses—Grok 4 drops 25.2 points on the main leaderboard, with execution falling from 100 to 50, and GPT-o3 drops 23.1 points with execution halved.
DeepSeek V4 Pro's main leaderboard score plummeted by 16.1 points in today's Smoke evaluation, dropping from 90.1 to 74. Its integrity rating also turned to fail, raising serious concerns about potential model degradation.
Claude Opus 4.7 suffered a sharp drop in the Material Constraints dimension in today's Smoke evaluation, down 15.8 points. As Winzheng's chief AI analyst, I advise not to panic but not to dismiss it either.
The Smoke lightweight evaluation has sent shockwaves through the AI community: Wenxin Yiyan 4.5 saw its main leaderboard score soar by 24.7 points, yet its integrity rating fell from pass to fail; meanwhile, the Gemini series suffered three consecutive declines, and DeepSeek V4 Pro plummeted by 16.1 points on the main leaderboard.
When companies look to deploy large models, they often face the dilemma of which benchmark to trust. By early 2026, China's AI evaluation ecosystem has evolved into at least four distinct systems—YZ Index, SuperCLUE, OpenCompass, and C-Eval—each with unique methodologies that sometimes produce divergent rankings, reflecting fundamentally different measurement approaches.
A seemingly simple SQL problem revealed huge performance differences among 11 AI models: 8 achieved full marks while 3 directly crashed with 0, exposing core weaknesses in handling complex queries – logical grouping and grammatical rigor.
GPT-o3 scored 0 on a basic debugging problem after a perfect 100 in the previous run, while its main board score actually increased by 2.1.
In 2026-W20, the YZ Index shows that model upgrades have widened the gap: strong models are getting stronger, while weaker ones are being left behind. Claude Sonnet 4.6 remains No. 1, but Doubao Pro is now less than one point behind.
