A WDCD v3.1 evaluation of 11 models across five constraint scenarios shows safety compliance as the weakest overall dimension. glm-4.6 led in multiple scenarios, while qwen3-max showed the largest risk exposure in high-compliance settings.
In a sample of only 8 v2 anchor questions, 11 models posted a 100% average R1 confirmation rate and a 79% R2 resistance rate, yet their average R3 integrity rate fell to just 49.5% (out of 2 points), with 29 of 319 runs ending in complete collapse (0 points). The results show that models almost universally accept constraints at the commitment stage, but nearly half fail to sustain those initial promises after two rounds of interference and pressure.
Grok 4 leads the latest WDCD v3.1 commitment-keeping evaluation with 93.21 points, while Qwen3 Max ranks last among 11 models with 74.31. R3 sustained-pressure scores reveal a widening gap between constraint-robust leaders and fragile tail-end models.
On September 6, 2026, the YZ Index Smoke quick test covered 11 models, with Gemini 2.5 Pro ranking first at 88.21 points. Compared with the previous run, several models showed notable swings on code execution and material constraint, pending confirmation in subsequent runs.
In today's Smoke evaluation, GLM-4.6's Material Constraint score dropped from 74.30 to 53.30 (−21 points), Code Execution rose from 50.00 to 75.00 (+25 points), and the main leaderboard score ticked up from 60.94 to 65.24.
In today's Smoke evaluation, Qwen3 Max's code execution score dropped 21.7 points from 96.70 to 75.00, while its material constraint score rose 20.4 points from 48.80 to 69.20. The main leaderboard score fell only 2.8 points to 72.39.
On 2026-09-05, the YZ Index Smoke quick test covered 11 models, with GPT-o3 taking first place with a score of 90.64. The daily 10-question Smoke quick test is intended for short-term signal monitoring and does not carry the weight of the Full weekly ranking.
In today's Smoke evaluation, GLM-4.6's material constraint score jumped 28.2 points, lifting its main leaderboard score from 48.25 to 60.94 and upgrading its integrity rating from fail to pass. Engineering judgment, however, fell 39.6 points to 25.00, a swing attributed to daily question-draw variance under the small sample rather than model degradation.
GPT-5.5's code execution score fell from 100 to 75 in today's Smoke evaluation, pulling its main leaderboard score down by 7.5 points. The drop appears more likely due to question-selection fluctuation than a confirmed capability regression, but it now warrants close monitoring.
The September 4, 2026 YZ Index Smoke quick test covered 11 models, with Claude Opus 4.7 finishing first at 92.49 points.
In Run #307 on 2026-09-03, GLM-4.6 received an integrity rating of fail with a probe score of 15.00, a main leaderboard score of 48.25, code execution at 50.00, and material constraint at 46.10. All other models tested the same day passed integrity checks with probe scores at or above 80.
The 2026-09-03 YZ Index Smoke quick test covered 11 models, with GPT-o3 ranking first at 83.94 points. Smoke is a daily 10-question quick test suited to observing short-term signals and does not equate to Full weekly ranking conclusions.
The latest WDCD v3.1 pilot data shows Gemini 3.1 Pro ranking first with a commitment-adherence score of 97.70, while Gemini 2.5 Pro posted the largest gain at 22.2 points. Claude Sonnet 4.6 was the only model to decline, falling by 13 points.
WDCD v3.1 pilot data shows that safety and compliance is the weakest scenario on average across 11 models, with qwen3-max scoring only 2/4 and deepseek-v4-pro 2.5/4. The results reveal significant scenario-specific differences in models’ ability to retain constraints and withstand pressure.
In the WDCD v3.1 pilot phase, worst-of-3 sampling across 8 v2 anchor questions produced an average R3 integrity rate of only 72.7%, with 3 complete R3 collapses (0 points) across 110 tests. All three failures occurred on the same multi-constraint security compliance question, making R3 pressure resistance the key differentiator among models.
In the WDCD v3.1 commitment test, Gemini 3.1 Pro led all 11 evaluated models with 97.70 points, while Qwen3 Max ranked last with 70.30 — a gap of 27.4 points. Sampling followed the worst-of-3 methodology, with scores strictly applied across the S_hold, S_kbv, S_recover, and S_integrity components.
On 2026-09-02, the YZ Index Smoke quick test covered 11 models, with Doubao Pro ranking first at 95.91 points. Multiple leading models showed notable score swings that require further review.
GPT-5.5's code execution score dropped sharply from 94.50 to 69.50 in today's Smoke evaluation, while material constraint rose from 76.00 to 100.00. The main index edged down from 86.18 to 83.23 after the two dimensions offset each other.
Grok 4's code execution score in today's Smoke evaluation plunged from 94.50 to 72.70, dragging the main leaderboard down 4.2 points, while its material constraint score rose to a perfect 100.00.
The 2026-09-01 YZ Index Smoke quick test covered 11 models, with GPT-o3 ranking first at 96.98 points. Notable shifts include gains for DeepSeek V4 Pro and Gemini 2.5 Pro, while Grok 4 and GPT-5.5 posted sharp drops in code execution.
