In the WDCD v3.1 pilot, Gemini 2.5 Pro fell 16.7 points from Run #331, the largest decline among four evaluated models. DeepSeek V4 Pro, GPT-5.5, and Qwen3 Max dropped 6.6, 6.5, and 7.9 points respectively, with no model improving this period.
In WDCD v3.1's five constraint scenario tests, data boundary scenarios had the lowest average scores, with Qwen3-Max scoring only 1.3/4 and GLM-4.6 scoring 1.7/4, in stark contrast to six models achieving 4/4 in business rules scenarios. The results reveal severe model specialization and significant differences in retaining different types of constraints.
Based on 110 samples from eight v2 anchor questions, 11 models averaged only a 63.6% R3 integrity rate, with three complete collapses. The results show clear round-by-round decay and expose models whose adherence breaks down under sustained pressure.
Grok 4 tops the WDCD commitment-adherence test with 93.60, while Qwen3 Max ranks 11th at 67.30, a 26.3-point gap between top and bottom. The results are shaped mainly by the R3 pressure round, with lower-ranked models failing early anchors and higher-ranked models resisting multi-round pressure.
GPT-o3's main leaderboard score in today's Smoke evaluation dropped to 80.48 from 96.01 yesterday, driven by a 32.5-point collapse in code execution, though the small daily sample size points to sampling fluctuation rather than genuine model degradation.
In today's Smoke evaluation, Grok 4's main leaderboard score fell from 90.86 to 80.89, with code execution plunging from 96.30 to 69.50 while material constraints rose from 84.20 to 94.80. The small daily question set makes such single-day swings more likely than genuine model degradation.
The 2026-09-23 YZ Index Smoke quick test covered 10 models, with Claude Sonnet 4.6 leading at 96.98. The brief highlights daily leaderboard signals, notable score changes, and items that require follow-up runs to confirm.
In today's Smoke evaluation, Grok 4's material constraint score dropped from 100.00 to 84.20, a 15.8-point decline that pulled its main leaderboard score from 95.44 down to 90.86. Code execution rose, but engineering judgment also fell sharply, pointing to volatility in material-sensitive tasks.
In today's Smoke evaluation, Claude Sonnet 4.6's material constraint score dropped from 100.00 to 84.20, while code execution rose from 50.00 to 97.00, pushing its main leaderboard score from 72.50 to 91.24. The opposite swings likely reflect small-sample randomness rather than a real capability decline.
On 2026-09-22, the YZ Index Smoke quick test covered 10 models, with GPT-o3 ranking first at 96.01. The Smoke test is a daily 10-question quick assessment useful for observing short-term signals, not equivalent to full weekly rankings.
In today's Smoke evaluation, Claude Sonnet 4.6's main leaderboard score dropped 17 points, driven by code execution falling from full marks to 50, a swing most likely explained by the small daily question sample rather than a genuine decline in model capability.
In today's Smoke evaluation, GPT-5.5's main leaderboard score fell from 86.50 to 76.44, a 10.1-point decline. The drop was driven entirely by a 25-point decrease in the Code Execution dimension, while Material Constraints rose 8.2 points.
The 2026-09-21 YZ Index Smoke quick test covers 10 models, with Grok 4 leading the day at 95.44 points. Smoke is a daily 10-question quick test, useful for observing short-term signals and not equivalent to Full weekly leaderboard conclusions.
Latest WDCD v3.1 pilot data shows GLM-4.6 dropping 29.8 points and GPT-5.5 dropping 6 points versus Run #326, while none of the other nine evaluated models rose. Grok 4 ranks first at 91.76, with Gemini 3.1 Pro second at 89.59.
In the WDCD v3.1 test, the data-boundary scenario produced the lowest scores of all five categories, with glm-4.6 scoring just 1.36/4 against 3.8/4 for the leaders. The results reveal sharp differences in how models keep their commitments under pressure, with clear implications for enterprises deploying AI in production workflows.
In WDCD v2 anchor-task testing, Grok 4 recorded zero complete collapses at R3, while GLM-4.6’s R3 collapse rate reached 27.6%, revealing sharp differences in compliance survival under three rounds of pressure. The average R3 integrity rate across the sample was only 49.5%.
Grok 4 tops the WDCD commitment-keeping rankings with 91.76, while GLM-4.6 comes last at 61.55, a 30.21-point gap between first and last. The WDCD v3.1 pilot covers 11 models and highlights sharp differences in adherence under sustained pressure.
Grok 4's code execution score fell from 96.70 to 74.30 in today's Smoke evaluation, dragging its main leaderboard score down from 88.33 to 75.38. The decline appears driven mainly by single-day task-sampling variance rather than a systematic model regression, since material constraints and the integrity rating did not deteriorate in tandem.
In today's Smoke benchmark, DeepSeek V4 Pro's material constraint score fell from 91.70 to 76.70, while its main leaderboard score rose from 55.02 to 75.77.
From September 14 to 20, 2026, Qwen3 Max led the weekly trend with +19.1, while DeepSeek V4 Pro fell 15.3 points and recorded the week's highest volatility at 43.3.
