On 2026-09-12, the YZ Index Smoke quick test covered 10 models, with Doubao Pro ranking first that day at 83.94 points. Smoke is a daily 10-question quick test suited to short-term signals and is not equivalent to Full weekly leaderboard conclusions.
Gemini 2.5 Pro's code execution score dropped from 100.00 to 75.00 in today's Smoke evaluation, pulling the main leaderboard down from 88.75 to 81.53. The simultaneous decline in code execution and engineering judgment points more to small-sample question variance than to proven model regression.
In today's Smoke evaluation, Grok 4's materials constraint score fell 22.2 points to 77.80, dragging its main leaderboard score down 5.2 points to 88.64. The swing most likely reflects small-sample question sampling variance rather than genuine model degradation.
On 2026-09-11, the YZ Index Smoke quick test covered 10 models, with Doubao Pro ranking first that day at 95.28. Smoke is a daily 10-question quick test intended to capture short-term signals, not equivalent to Full weekly leaderboard conclusions.
MLCommons has released results for the MLPerf Storage v3.0 benchmark suite, adding KV Cache and Vector Database tests along with S3 object storage access layer support. Nineteen organizations submitted results, including 11 first-time submitters.
In today's Smoke evaluation, GPT-o3's code execution score fell from yesterday's 94.50 to 69.80, a 24.7-point drop, and the main leaderboard overall declined from 86.04 to 78.13, down 7.9 points. The anomaly is most likely due to question-sampling variance rather than genuine model degradation, though code-intensive users should stay vigilant.
GPT-5.5's code execution score dropped from 94.50 to 72.00 in today's Smoke evaluation, a fall of 22.5 points, while its material constraint score jumped from 71.40 to 100.00, a gain of 28.6 points. The main leaderboard score only edged up from 84.11 to 84.60.
In the 2026-09-10 YZ Index Smoke quick test covering 10 models, Gemini 3.1 Pro ranked first with a main-leaderboard score of 98.35. The daily 10-question Smoke test is suited to observing short-term signals and is not equivalent to the conclusions of the Full weekly leaderboard.
In the latest WDCD v3.1 evaluation, Claude Sonnet 4.6 rose 8.6 points from Run #311, while Claude Opus 4.7, Gemini 2.5 Pro, Gemini 3.1 Pro, GLM-4.6, GPT-5.5, GPT-o3, and DeepSeek V4 Pro all declined — with GLM-4.6 dropping 27 points and Gemini 2.5 Pro dropping 23.8 points.
Safety and compliance proved to be the hardest constraint category in the WDCD v3.1 five-scenario test, with scores ranging from 0.8/4 to 4/4. The results reveal significant differences in how models maintain compliance under multi-round pressure.
Across eight v2 anchor questions, 11 evaluated models averaged a 0.91 R1 confirmation rate, yet their R2 resistance rate fell to 0.41 and their R3 integrity rate to just 45.5%, with 10 complete R3 collapses. The findings separate models that hold the line under sustained pressure from those that cave.
Grok 4 tops the WDCD v3.1 commitment test with 93.80 points, while GLM-4.6 ranks last with 68.00 — a 25.8-point gap. Results reveal a sharp divide between top and tail models under progressive pressure, with R3-phase resilience emerging as a key criterion for production workflow integration.
In today's Smoke evaluation, Claude Sonnet 4.6's material constraint score plummeted from 100.00 yesterday to 66.40, while its main ranking overall dropped from 86.25 to 81.86. Concurrent gains in code execution and task expression point to question sampling variance rather than genuine model regression.
Grok 4 scored 88.42 on today's Smoke benchmark main board, up 2.2 points from yesterday's 86.25, but its material constraint dimension plunged 17.8 points from 100.00 to 82.20, while code execution climbed 18.5 points.
On 2026-09-09, the YZ Index Smoke quick test covered 10 models, with Doubao Pro ranking first at 89.91 points. Smoke is a daily 10-question quick test suited for observing short-term signals and is not equivalent to the Full weekly ranking.
On 2026-09-08, the YZ Index Smoke Quick Test covered 11 models. Claude Sonnet 4.6 and Grok 4 tied for the top overall score at 86.25 points, while several models showed notable single-day score swings.
In today's Smoke evaluation, GPT-o3's material constraint fell from 70.00 to 50.00 and engineering judgment from 100.00 to 50.00, yet its main leaderboard score rose from 72.75 to 77.50.
In today's Smoke evaluation, Doubao Pro's material constraint score plunged 27.6 points to 58.30, while its code execution score soared 49.3 points to 99.30, lifting its main leaderboard score from 66.16 to 80.85. The analysis attributes these dramatic opposing swings primarily to question sampling fluctuation rather than genuine model degradation.
The 2026-09-07 YZ Index Smoke quick test covered 11 models, with DeepSeek V4 Pro, Gemini 3.1 Pro, and GLM-4.6 tying for the top spot of the day at 83.49 points. Smoke is a daily 10-question quick test for observing short-term signals and is not equivalent to the Full weekly leaderboard conclusions.
Claude Sonnet 4.6 fell 5 points while Doubao Pro climbed 7.5 points in the latest WDCD v3.1 evaluation—the only significant shift among 11 models. The opposing movements highlight divergent constraint-holding stability under multi-round pressure.
