On 2026-10-17, the YZ Index Smoke quick test covered 14 models, with GPT-o3 ranking first for the day at 94.51 points. The Smoke test is a daily 10-question quick assessment suited to short-term signals and is not equivalent to Full weekly leaderboard conclusions.
In today's Smoke evaluation, Claude Opus 4.7's main leaderboard score dropped from 93.54 to 73.45, driven by a 28.1-point single-day fall in Code Execution and a 10.3-point decline in Material Constraints, while side-leaderboard dimensions rose. Integrity Rating remained pass, and the drop appears mainly due to small-sample draw fluctuation.
Doubao Pro's Material Constraint score fell 15.3 points in today's Smoke evaluation, dragging its main leaderboard score down by 4.3 points. Other dimensions improved or held steady, suggesting the issue is concentrated in material fidelity rather than overall capability.
On 2026-10-16, the YZ Index Smoke Quick Test covered 13 models, with Doubao Pro ranking first for the day at 85.09. The brief reviews daily score structure and notable changes, noting that small-sample Smoke results are monitoring signals rather than long-term conclusions.
In today's Smoke evaluation, GPT-o3's code execution score fell from 94.50 to 72.00, dragging the main leaderboard from 92.39 down to 84.60 — a swing most likely caused by small-sample question-draw variance rather than genuine model degradation.
In today's Smoke evaluation, DeepSeek V4 Pro's Code Execution score fell from 94.50 to 72.00, dragging its main leaderboard score from 92.39 to 84.60. Gains in Material Constraints and Task Expression suggest the drop stems from question sampling variance rather than model degradation.
On 2026-10-15, the YZ Index Smoke quick test covered 13 models, with Gemini 2.5 Pro ranking first for the day at 95.91. The Smoke test is a daily 10-question quick check suited to short-term signals and is not equivalent to Full weekly ranking conclusions.
In the WDCD v3.1 commitment-adherence test, GPT-5.5, DeepSeek V4 Pro, and Claude Sonnet 4.6 gained while Doubao Pro and Claude Opus 4.7 declined, producing clear divergence. The results outline practical guardrail requirements and risk boundaries for deploying AI in production workflows.
In the WDCD v3.1 pilot, the Data Boundary scenario produced the lowest overall score of 1.7 (qwen3-max), while Security Compliance had the lowest scenario score of 1.8 (doubao-pro); these two dimensions are both the lowest-scoring and most discriminative in the test.
A worst-of-3 test on eight v2 anchor questions shows compliance decaying across three rounds, with R3 integrity at 73.3% and three full collapses. Qwen3 Max and Claude Opus 4.7 fail early, while GLM-4.6, GPT-6 Luna, and Doubao Pro remain stable through R3.
In the WDCD v3.1 pilot, GLM-4.6 took first place with a perfect 100.00, while Doubao Pro finished last at 62.00—a 38-point gap. The results highlight major differences in how models maintain constraints under escalating pressure.
GLM-4.6 showed incomplete data in today's Smoke Evaluation, with two dimensions missing and an API failure or timeout triggering an automatic rerun, so it is not ranked on the main leaderboard this period. Code execution scored 19.50 and task expression 50.00, while material constraints and other dimensions remained unavailable.
In today's Smoke evaluation, Gemini 3.1 Pro's code execution score fell from 91.70 to 64.50, dragging the main leaderboard from 82.39 down to 75.89. The offsetting jump in the materials constraint dimension points to question-sampling randomness rather than a real capability decline.
On 2026-10-14, the YZ Index Smoke quick test covered 13 models, with Claude Opus 4.7, DeepSeek V4 Pro, and GPT-o3 tied for first at 92.39. The single-day results are useful as monitoring signals rather than long-term conclusions.
On 2026-10-13, the YZ Index Smoke quick test covered 13 models, with Gemini 3.1 Pro taking first place for the day at 82.39 points. Smoke is a daily 10-question quick test suitable for observing short-term signals, not equivalent to Full weekly leaderboard conclusions.
DLRMv4 updates the MLPerf Training recommendation benchmark by replacing the traditional feature-interaction stack with HSTU and introducing the Yambda-5B dataset, pushing embedding tables to about 560 GB. It reflects the shift of production recommender systems toward long user histories and sequential behavior modeling, while testing training systems with heavier attention computation and large-scale embedding sharding.
AI risk is already on the corporate books. To manage it, enterprises need independent, transparent measurement and should test the systems they actually deploy, not just base models.
The MLCommons AI Risk & Reliability (AIRR) Privacy Working Group has released v0.1 of a taxonomy defining five major privacy risk areas for AI agents. It outlines risks across data ingestion, aggregation and sharing, inconsistent practices, static consent, and accountability, and invites industry feedback.
SGLang and Miles on NVIDIA Vera RubinSGLang & Miles TeamOctober 9, 2026Summary We had early access to two NVIDIA Vera Rubin nodes (8 GPUs) and used them to bring SGLang and Miles up on the platfor
In today's Smoke evaluation, GPT-6.1 Sol's Material Constraints score fell 19 points to 70.30 while its Code Execution score rose 25 points to 97.00, and its main leaderboard score increased from 79.79 to 84.99. The swing may reflect random question draws rather than genuine model regression, so a same-dimension retest next period is needed.
