AI Reviews | Winzheng

GPT-5.5 Leads Smoke Benchmark with Perfect Execution Score of 86.95, Exposing Constraint Weakness

In the Smoke lightweight benchmark on July 3, 2026, GPT-5.5 ranked first with a main score of 86.95, driven by a perfect code execution score of 100, while its material constraint score of 71 highlights a common weakness.

Gemini 3.1 Pro Tops with 82.97 Points, Execution Score of 75 Points Widens Gap with Second Place

In the YZ Index Smoke lightweight evaluation on July 2, 2026, Gemini 3.1 Pro achieved first place on the main leaderboard with 82.97 points (Execution 75, Material Constraint 92.7), while Doubao Pro ranked second with 81.98 points (Execution 75, Material Constraint 90.5), both tied for the highest execution score.

WDCD Three-Round Test: Grok 4 Zero Crashes, GPT-5.5 Five R3 Collapses

In the WDCD three-round test, Grok 4 maintained a perfect score of 2 in all 10 R3 questions, while GPT-5.5 suffered 5 zero-score crashes, with an average R3 integrity score of only 1.00/2.

Grok 4 Scores Perfect 100 to Dominate WDCD Commitment Ranking, GPT-5.5 Trails with Only 62.5 Points

In the latest WDCD commitment test, Grok 4 achieved a perfect 100 points, while GPT-5.5 ranked last at 62.5 points. The results reveal a clear hierarchy, with top models excelling across all phases and bottom models collapsing under interference and pressure.

Doubao Pro Smoke Evaluation Main Ranking Plunges 18.6 Points, Code Execution Drops 38.8 in a Single Day

In the YZ Index June 2026 live test of 11 models, Doubao Pro’s Smoke Evaluation main ranking fell from 85.91 yesterday to 67.32 today, a drop of 18.6 points, primarily due to the code execution dimension falling from 83.30 to 44.50.

Grok 4 Smoke Evaluation Main Score Plummets 15.3 Points, Code Execution Drops 31.4 in a Single Day

In today's YZ Index Smoke evaluation, Grok 4's main score dropped from 97.98 to 82.73, a decrease of 15.3 points, and code execution fell from 100.00 to 68.60. The single-day volatility is significant but consistent with small-sample draw characteristics, not necessarily indicating model degradation.

Claude Opus 4.7 Tops with 94.82 Points, Gemini 3.1 Pro Plunges 32.2 Points

In the Smoke lightweight evaluation on July 1, 2026, Claude Opus 4.7 ranked first on the main leaderboard with a score of 94.82, while Gemini 3.1 Pro experienced a sharp drop of 32.2 points. The evaluation highlights a clear divergence between constraint and execution scores across models.

Claude Sonnet 4.6 Smoke Main Ranking Plunges 15.3 Points, Code Execution Drops 25 Points in a Single Day

In the June 2026 Smoke evaluation of the YZ Index, Claude Sonnet 4.6 saw its main ranking score drop from 97.84 to 82.52 points, a single-day decline of 15.3 points, driven primarily by a 25-point fall in the code execution dimension.

Claude Opus 4.7 Main Score Plunges 16 Points in Smoke Test, Code Execution Drops 27.2 in a Single Day

In the YZ Index June 2026 Smoke Evaluation, Claude Opus 4.7's main score dropped from 100.00 yesterday to 84.01 today, and its code execution dimension fell from 100.00 to 72.80.

Gemini 3.1 Pro Tops with 98.47 Points, Claude's Execution Score Plunges 27.2 to 72.8

In the June 30, 2026 Smoke Lite evaluation of the YZ Index, Gemini 3.1 Pro ranked first with a main score of 98.47 points. Multiple models saw significant drops in execution scores, with Claude's execution scores plummeting over 25 points.

The patch model is breaking. AI evaluation needs a new way to disclose what it finds.

The security community has long relied on Coordinated Vulnerability Disclosure for handling dangerous findings, but this model fails for AI systems. MLCommons recognizes this as a core governance challenge for frontier model evaluation and is working to establish responsible disclosure standards.

Chakra Comes of Age: A Standardized Trace Ecosystem for AI Systems Benchmarking and Co-design

The Chakra initiative by MLCommons aims to standardize AI system benchmarking through open execution traces, addressing fragmentation and enabling collaborative co-design across industry and academia.

MLCommons Releases MLPerf Mobile v6.0 with New Generative AI Benchmarks for On-Device LLMs

MLCommons today announced the launch of MLPerf Mobile v6.0, adding generative AI benchmarks for running large language models (LLMs) on Android devices. These tests join existing benchmarks for image generation, object detection, and super resolution in the MLPerf Mobile app to form a complete test suite.

MLCommons Releases MLPerf Training v6.0 Results

MLPerf Training v6.0 introduces two new Mixture-of-Experts benchmarks, DeepSeek V3 and GPT-OSS 20B, reflecting the industry's shift toward sparse computing. With 95 unique systems submitted by 24 organizations, the results show increasing diversity in hardware and software.