Claude Opus 4.7's main leaderboard score dropped 18.7 points to 63.59 in today's Smoke evaluation, driven by a 47-point collapse in code execution from 97.00 to 50.00, while material constraints rose 15.9 points.
From 2026-09-07 to 2026-09-13, Grok 4 rose from 80.13 on the first day to 87 on the last day, a +6.9 trend, while GLM-4.6 fell from 83.49 to 0, a -83.5 trend. The data compare rising and declining models, integrity ratings, and implications for users.
The 2026-09-13 YZ Index Smoke quick test covered 10 models, with Grok 4 ranking first for the day at 87 points. The brief highlights single-day score structure, notable changes, and signals to watch.
On 2026-09-12, the YZ Index Smoke quick test covered 10 models, with Doubao Pro ranking first that day at 83.94 points. Smoke is a daily 10-question quick test suited to short-term signals and is not equivalent to Full weekly leaderboard conclusions.
Gemini 2.5 Pro's code execution score dropped from 100.00 to 75.00 in today's Smoke evaluation, pulling the main leaderboard down from 88.75 to 81.53. The simultaneous decline in code execution and engineering judgment points more to small-sample question variance than to proven model regression.
In today's Smoke evaluation, Grok 4's materials constraint score fell 22.2 points to 77.80, dragging its main leaderboard score down 5.2 points to 88.64. The swing most likely reflects small-sample question sampling variance rather than genuine model degradation.
On 2026-09-11, the YZ Index Smoke quick test covered 10 models, with Doubao Pro ranking first that day at 95.28. Smoke is a daily 10-question quick test intended to capture short-term signals, not equivalent to Full weekly leaderboard conclusions.
MLCommons has released results for the MLPerf Storage v3.0 benchmark suite, adding KV Cache and Vector Database tests along with S3 object storage access layer support. Nineteen organizations submitted results, including 11 first-time submitters.
In today's Smoke evaluation, GPT-o3's code execution score fell from yesterday's 94.50 to 69.80, a 24.7-point drop, and the main leaderboard overall declined from 86.04 to 78.13, down 7.9 points. The anomaly is most likely due to question-sampling variance rather than genuine model degradation, though code-intensive users should stay vigilant.
GPT-5.5's code execution score dropped from 94.50 to 72.00 in today's Smoke evaluation, a fall of 22.5 points, while its material constraint score jumped from 71.40 to 100.00, a gain of 28.6 points. The main leaderboard score only edged up from 84.11 to 84.60.
In the 2026-09-10 YZ Index Smoke quick test covering 10 models, Gemini 3.1 Pro ranked first with a main-leaderboard score of 98.35. The daily 10-question Smoke test is suited to observing short-term signals and is not equivalent to the conclusions of the Full weekly leaderboard.
In the latest WDCD v3.1 evaluation, Claude Sonnet 4.6 rose 8.6 points from Run #311, while Claude Opus 4.7, Gemini 2.5 Pro, Gemini 3.1 Pro, GLM-4.6, GPT-5.5, GPT-o3, and DeepSeek V4 Pro all declined — with GLM-4.6 dropping 27 points and Gemini 2.5 Pro dropping 23.8 points.
Safety and compliance proved to be the hardest constraint category in the WDCD v3.1 five-scenario test, with scores ranging from 0.8/4 to 4/4. The results reveal significant differences in how models maintain compliance under multi-round pressure.
Across eight v2 anchor questions, 11 evaluated models averaged a 0.91 R1 confirmation rate, yet their R2 resistance rate fell to 0.41 and their R3 integrity rate to just 45.5%, with 10 complete R3 collapses. The findings separate models that hold the line under sustained pressure from those that cave.
Grok 4 tops the WDCD v3.1 commitment test with 93.80 points, while GLM-4.6 ranks last with 68.00 — a 25.8-point gap. Results reveal a sharp divide between top and tail models under progressive pressure, with R3-phase resilience emerging as a key criterion for production workflow integration.
In today's Smoke evaluation, Claude Sonnet 4.6's material constraint score plummeted from 100.00 yesterday to 66.40, while its main ranking overall dropped from 86.25 to 81.86. Concurrent gains in code execution and task expression point to question sampling variance rather than genuine model regression.
Grok 4 scored 88.42 on today's Smoke benchmark main board, up 2.2 points from yesterday's 86.25, but its material constraint dimension plunged 17.8 points from 100.00 to 82.20, while code execution climbed 18.5 points.
On 2026-09-09, the YZ Index Smoke quick test covered 10 models, with Doubao Pro ranking first at 89.91 points. Smoke is a daily 10-question quick test suited for observing short-term signals and is not equivalent to the Full weekly ranking.
On 2026-09-08, the YZ Index Smoke Quick Test covered 11 models. Claude Sonnet 4.6 and Grok 4 tied for the top overall score at 86.25 points, while several models showed notable single-day score swings.
In today's Smoke evaluation, GPT-o3's material constraint fell from 70.00 to 50.00 and engineering judgment from 100.00 to 50.00, yet its main leaderboard score rose from 72.75 to 77.50.
