In today's Smoke evaluation, Doubao Pro's material constraint score plunged 27.6 points to 58.30, while its code execution score soared 49.3 points to 99.30, lifting its main leaderboard score from 66.16 to 80.85. The analysis attributes these dramatic opposing swings primarily to question sampling fluctuation rather than genuine model degradation.
The 2026-09-07 YZ Index Smoke quick test covered 11 models, with DeepSeek V4 Pro, Gemini 3.1 Pro, and GLM-4.6 tying for the top spot of the day at 83.49 points. Smoke is a daily 10-question quick test for observing short-term signals and is not equivalent to the Full weekly leaderboard conclusions.
Claude Sonnet 4.6 fell 5 points while Doubao Pro climbed 7.5 points in the latest WDCD v3.1 evaluation—the only significant shift among 11 models. The opposing movements highlight divergent constraint-holding stability under multi-round pressure.
A WDCD v3.1 evaluation of 11 models across five constraint scenarios shows safety compliance as the weakest overall dimension. glm-4.6 led in multiple scenarios, while qwen3-max showed the largest risk exposure in high-compliance settings.
In a sample of only 8 v2 anchor questions, 11 models posted a 100% average R1 confirmation rate and a 79% R2 resistance rate, yet their average R3 integrity rate fell to just 49.5% (out of 2 points), with 29 of 319 runs ending in complete collapse (0 points). The results show that models almost universally accept constraints at the commitment stage, but nearly half fail to sustain those initial promises after two rounds of interference and pressure.
Grok 4 leads the latest WDCD v3.1 commitment-keeping evaluation with 93.21 points, while Qwen3 Max ranks last among 11 models with 74.31. R3 sustained-pressure scores reveal a widening gap between constraint-robust leaders and fragile tail-end models.
On September 6, 2026, the YZ Index Smoke quick test covered 11 models, with Gemini 2.5 Pro ranking first at 88.21 points. Compared with the previous run, several models showed notable swings on code execution and material constraint, pending confirmation in subsequent runs.
In today's Smoke evaluation, GLM-4.6's Material Constraint score dropped from 74.30 to 53.30 (−21 points), Code Execution rose from 50.00 to 75.00 (+25 points), and the main leaderboard score ticked up from 60.94 to 65.24.
In today's Smoke evaluation, Qwen3 Max's code execution score dropped 21.7 points from 96.70 to 75.00, while its material constraint score rose 20.4 points from 48.80 to 69.20. The main leaderboard score fell only 2.8 points to 72.39.
On 2026-09-05, the YZ Index Smoke quick test covered 11 models, with GPT-o3 taking first place with a score of 90.64. The daily 10-question Smoke quick test is intended for short-term signal monitoring and does not carry the weight of the Full weekly ranking.
In today's Smoke evaluation, GLM-4.6's material constraint score jumped 28.2 points, lifting its main leaderboard score from 48.25 to 60.94 and upgrading its integrity rating from fail to pass. Engineering judgment, however, fell 39.6 points to 25.00, a swing attributed to daily question-draw variance under the small sample rather than model degradation.
GPT-5.5's code execution score fell from 100 to 75 in today's Smoke evaluation, pulling its main leaderboard score down by 7.5 points. The drop appears more likely due to question-selection fluctuation than a confirmed capability regression, but it now warrants close monitoring.
The September 4, 2026 YZ Index Smoke quick test covered 11 models, with Claude Opus 4.7 finishing first at 92.49 points.
In Run #307 on 2026-09-03, GLM-4.6 received an integrity rating of fail with a probe score of 15.00, a main leaderboard score of 48.25, code execution at 50.00, and material constraint at 46.10. All other models tested the same day passed integrity checks with probe scores at or above 80.
The 2026-09-03 YZ Index Smoke quick test covered 11 models, with GPT-o3 ranking first at 83.94 points. Smoke is a daily 10-question quick test suited to observing short-term signals and does not equate to Full weekly ranking conclusions.
The latest WDCD v3.1 pilot data shows Gemini 3.1 Pro ranking first with a commitment-adherence score of 97.70, while Gemini 2.5 Pro posted the largest gain at 22.2 points. Claude Sonnet 4.6 was the only model to decline, falling by 13 points.
WDCD v3.1 pilot data shows that safety and compliance is the weakest scenario on average across 11 models, with qwen3-max scoring only 2/4 and deepseek-v4-pro 2.5/4. The results reveal significant scenario-specific differences in models’ ability to retain constraints and withstand pressure.
In the WDCD v3.1 pilot phase, worst-of-3 sampling across 8 v2 anchor questions produced an average R3 integrity rate of only 72.7%, with 3 complete R3 collapses (0 points) across 110 tests. All three failures occurred on the same multi-constraint security compliance question, making R3 pressure resistance the key differentiator among models.
In the WDCD v3.1 commitment test, Gemini 3.1 Pro led all 11 evaluated models with 97.70 points, while Qwen3 Max ranked last with 70.30 — a gap of 27.4 points. Sampling followed the worst-of-3 methodology, with scores strictly applied across the S_hold, S_kbv, S_recover, and S_integrity components.
On 2026-09-02, the YZ Index Smoke quick test covered 11 models, with Doubao Pro ranking first at 95.91 points. Multiple leading models showed notable score swings that require further review.
