Claude Sonnet 4.6 showed significant anomalies in today's Smoke evaluation, with the material constraint dimension dropping directly from 74.50 to 59.50, a single-day decline of 15 points, and the main ranking dropping 6.8 points to 81.78. This magnitude exceeds the normal random fluctuation range of the daily 10-question quick test.
Claude Opus 4.7's material constraint dimension plummeted 15 points in today's Smoke evaluation using only 10 questions, from 74.50 to 59.50, while the overall leaderboard fell 6.8 points to 81.78.
Today's Smoke evaluation directly found that the material constraint dimension of 11 models collectively collapsed, with an average drop of over 15 points. Under the core formula, main ranking scores were dragged down, causing the top seven to fall out of the 82-point range.
In today's Smoke evaluation, Claude Sonnet 4.6 saw its Material Constraint score drop from 96.50 to 74.50, a 22-point single-day decline, while its Code Execution score surged from 85.70 to a perfect 100.
In today's Smoke review, Claude Opus 4.7's main score dropped to 88.53 points, down 8.2 points from yesterday, placing this decline in an abnormal range for the current daily ten-question quick test. The core loss came from the material constraint dimension, which fell from 92.80 to 74.50, a single-day drop of 18.3 points.
Overnight Smoke lightweight evaluation data shows Gemini 2.5 Pro collapsing with its main score dropping to 61.03, execution dimension falling from 100 to 50, and material compliance sliding 18 points. DeepSeek V4 Pro takes first place with 95.28 points, while material constraint scores across multiple models collectively decline.
MLCommons has announced the fourth cohort of its Rising Stars program, featuring 39 outstanding early-career researchers from 26 global institutions. Their diverse research covers large language models, ML system efficiency, hardware-software co-design, trustworthy AI, and more, reflecting the increasing system-centric direction of machine learning innovation.
In today's Smoke evaluation, ERNIE 4.5's main score fell from 88.48 to 61.25, a single-day drop of 27.2 points, driven by a collapse in code execution from 95.00 to 50.00. Material constraint also slightly declined from 80.50 to 75.00.
DeepSeek V4 Pro's integrity rating on today's Smoke evaluation jumped directly from Fail to Pass, and its main ranking score rose from 74.00 to 97.08, a single-day increase of 23.1 points. Material constraint jumped from 70.00 to 93.50, while two side metrics—engineering judgment and task expression—each rose 20 points.
DeepSeek V4 Pro achieves 97.08 points, becoming the only model to surpass 97. Meanwhile, ERNIE Bot 4.5 suffers a drastic 27.2-point drop in total score as its execution score halves. Integrity ratings for both models shift.
In today's Smoke evaluation, GPT-o3's code execution dimension crashed from 90.00 to 47.50, dragging the main leaderboard down 18 points to 58.08. This steep decline raises serious concerns about whether it reflects true capability degradation rather than sampling fluctuation.
This article analyzes the significant divergence in the Smoke Quick Test results for ERNIE Bot 4.5, where engineering judgment scores dropped sharply from 50 to 10 while the main rank score paradoxically rose by 14.5 points, attributing the fluctuation to sampling noise and dimension-specific optimizations.
This week’s Smoke quick test shows GPT-5.5 surging 29.7 points while GPT-o3 plummets 36.4 points. Other models present mixed trends, with high volatility revealing stability risks.
GPT-o3 saw a sharp drop on the main leaderboard from about 76 to 58.08 in today's Smoke evaluation, with the execution dimension nearly halved from the 90-point range to 47.5. Meanwhile, Doubao Pro surged 35.8 points to reach 89.85, securing a top-four spot.
Claude Sonnet 4.6 showed significant divergence in today's Smoke evaluation: the material constraint dimension dropped directly from 81.00 to 58.40, a decline of 22.6 points, while the code execution dimension jumped from 50 to 100 points, ultimately pulling the main leaderboard up 17.3 points to 81.28.
In today's Smoke evaluation, Grok 4 showed a stark divergence: its material constraint score dropped from 80.30 to 59.00, a one-day plunge of 21.3 points, while code execution jumped from 50 to 100, lifting the main ranking total from 63.64 to 81.55.
In today's Smoke lightweight evaluation, material constraint scores plummeted across models, with Grok 4 narrowly beating Claude to claim first place with 81.55 points.
In today's Smoke evaluation, Claude Opus 4.7 suffered a 17.6-point plunge in the Material Constraint dimension, while Code Execution rose by 11.9 points. This contrasting performance raises the question of whether it is due to sampling luck or a genuine model issue.
In today's Smoke evaluation, Gemini 3.1 Pro saw a sharp 8.5-point drop on the main leaderboard, with code execution falling from 66.70 to 57.20 and material constraints dropping from 86.30 to 79.00. The fluctuations are attributed to a combination of question sampling volatility and declining model consistency, placing the current status in an "observation period" rather than an "alert period."
Doubao Pro achieved 91.23 points with a perfect 100 in code execution and a pass in integrity, while most other models saw their execution scores drop significantly, with nine models falling over 30 points on the main leaderboard.
