In 275 samples on 8 v2 anchor questions, the average R1 confirmation rate was 0.99, but the R3 integrity rate was only 30.2%, with 44 complete collapses (score 0). This data directly reveals the rapid degradation pattern of models after initial commitment as rounds increase.
Grok 4 tops the WDCD Compliance Leaderboard with 91.20 points, while Qwen3 Max ranks last with 57.48 points, a gap of 33.72 points between the top and bottom.
In the Smoke lightweight benchmark on July 3, 2026, GPT-5.5 ranked first with a main score of 86.95, driven by a perfect code execution score of 100, while its material constraint score of 71 highlights a common weakness.
In the YZ Index Smoke lightweight evaluation on July 2, 2026, Gemini 3.1 Pro achieved first place on the main leaderboard with 82.97 points (Execution 75, Material Constraint 92.7), while Doubao Pro ranked second with 81.98 points (Execution 75, Material Constraint 90.5), both tied for the highest execution score.
In the WDCD three-round test, Grok 4 maintained a perfect score of 2 in all 10 R3 questions, while GPT-5.5 suffered 5 zero-score crashes, with an average R3 integrity score of only 1.00/2.
In the latest WDCD commitment test, Grok 4 achieved a perfect 100 points, while GPT-5.5 ranked last at 62.5 points. The results reveal a clear hierarchy, with top models excelling across all phases and bottom models collapsing under interference and pressure.
In the YZ Index June 2026 live test of 11 models, Doubao Pro’s Smoke Evaluation main ranking fell from 85.91 yesterday to 67.32 today, a drop of 18.6 points, primarily due to the code execution dimension falling from 83.30 to 44.50.
In today's YZ Index Smoke evaluation, Grok 4's main score dropped from 97.98 to 82.73, a decrease of 15.3 points, and code execution fell from 100.00 to 68.60. The single-day volatility is significant but consistent with small-sample draw characteristics, not necessarily indicating model degradation.
In the Smoke lightweight evaluation on July 1, 2026, Claude Opus 4.7 ranked first on the main leaderboard with a score of 94.82, while Gemini 3.1 Pro experienced a sharp drop of 32.2 points. The evaluation highlights a clear divergence between constraint and execution scores across models.
In the June 2026 Smoke evaluation of the YZ Index, Claude Sonnet 4.6 saw its main ranking score drop from 97.84 to 82.52 points, a single-day decline of 15.3 points, driven primarily by a 25-point fall in the code execution dimension.
In the YZ Index June 2026 Smoke Evaluation, Claude Opus 4.7's main score dropped from 100.00 yesterday to 84.01 today, and its code execution dimension fell from 100.00 to 72.80.
In the June 30, 2026 Smoke Lite evaluation of the YZ Index, Gemini 3.1 Pro ranked first with a main score of 98.47 points. Multiple models saw significant drops in execution scores, with Claude's execution scores plummeting over 25 points.
The security community has long relied on Coordinated Vulnerability Disclosure for handling dangerous findings, but this model fails for AI systems. MLCommons recognizes this as a core governance challenge for frontier model evaluation and is working to establish responsible disclosure standards.
The Chakra initiative by MLCommons aims to standardize AI system benchmarking through open execution traces, addressing fragmentation and enabling collaborative co-design across industry and academia.
MLCommons today announced the launch of MLPerf Mobile v6.0, adding generative AI benchmarks for running large language models (LLMs) on Android devices. These tests join existing benchmarks for image generation, object detection, and super resolution in the MLPerf Mobile app to form a complete test suite.
MLPerf Training v6.0 introduces two new Mixture-of-Experts benchmarks, DeepSeek V3 and GPT-OSS 20B, reflecting the industry's shift toward sparse computing. With 95 unique systems submitted by 24 organizations, the results show increasing diversity in hardware and software.
Optimizing GLM4-MoE for Production: 65% Faster TTFT with SGLangNovita AIJanuary 21, 2026TL;DR A suite of production-tested, high-impact optimizations has been developed by Novita AI for deploying…
Squeezing 1TB Model Rollout into a Single H200: INT4 QAT RL End-to-End PracticeSGLang RL Team, InfiXAI Team, Ant Group Asystem & AQ Infra Team, slime Team, RadixArk TeamJanuary 26, 2026 💡 TL;DR:…
No Token Left Behind: Demystifying Token-In-Token-Out in MilesMiles Team: Jiajun Li, Yuzhen Zhou, Shi Dong, Yanbin Jiang, Mao Cheng, Yusheng Su, Yueming Yuan, Zhichen Zeng, Banghua ZhuJune 5, 2026In…
Win on TCO: How AMD Instinct™ MI355X Achieves Cost-Competitive Distributed Inference Through SGLang with MoRIAMD & SGLang TeamMay 28, 2026The SGLang and AMD team has worked closely to unlock…
