The 2026-11-17 YZ Index Smoke quick test covered 14 models, with GPT-6 Luna ranking first for the day at 82.77 points. The Smoke test is a daily 10-question quick assessment suited to spotting short-term signals; it is not equivalent to the conclusions of the weekly Full leaderboard.
This Smoke evaluation covered only two main-leaderboard dimensions: code execution and material constraints. The main leaderboard formula is 0.55 × code execution + 0.45 × material constraints. Because the daily sample size is small, single-day scores are better treated as monitoring signals rather than as long-term conclusions about model capability.
Rankings for the Day
| Rank | Model | Main Leaderboard | Code Execution | Material Constraints | Integrity |
|---|---|---|---|---|---|
| #1 | GPT-6 Luna | 82.77 | 99.1 | 62.8 | pass |
| #2 | GPT-5.5 | 81.58 | 99.8 | 59.3 | pass |
| #3 | Claude Opus 4.7 | 78.03 | 92.7 | 60.1 | pass |
| #4 | GPT-6.1 Sol | 76.4 | 99.8 | 47.8 | pass |
| #5 | GPT-6 Sol | 75.84 | 99.1 | 47.4 | pass |
| #6 | Claude Sonnet 4.6 | 70.26 | 83.8 | 53.7 | pass |
| #7 | GPT-6 Astra | 65.62 | 74.8 | 54.4 | pass |
| #8 | GPT-o3 | 65.27 | 66.3 | 64 | pass |
| #9 | Doubao Pro | 59.83 | 59.6 | 60.1 | pass |
| #10 | Gemini 3.1 Pro | 56.29 | 48.5 | 65.8 | pass |
| #11 | Grok 4 | 49.09 | 50.8 | 47 | pass |
| #12 | GLM-4.6 | 43.36 | 25 | 65.8 | pass |
| #13 | Gemini 2.5 Pro | 42.33 | 28.6 | 59.1 | pass |
| #14 | DeepSeek V4 Pro | 39.27 | 25 | 56.7 | pass |
Interpreting the Data
Looking at the score structure, the leading models mostly show complementary pairings of code execution and material constraints. GPT-6 Luna posted 99.1 in code execution and 62.8 in material constraints for a main-leaderboard score of 82.77; GPT-5.5 took second with 99.8 in code execution and 59.3 in material constraints; and Claude Opus 4.7 placed third with 92.7 in code execution and 60.1 in material constraints. Such pairings keep overall scores in the lead. GPT-6.1 Sol scored 99.8 in code execution but 47.8 in material constraints, while GPT-6 Sol scored 99.1 in code execution and 47.4 in material constraints, showing a pattern of strong code execution paired with relatively weak material-constraint performance.
Among models with notable changes, Grok 4 fell 32.9 points on the main leaderboard, with code execution down 25.2 and material constraints down 42.3; GPT-6 Sol fell 16.6 points on the main leaderboard, with material constraints down 41.9; GPT-6 Astra fell 13.1 points on the main leaderboard, with material constraints down 34.9; Doubao Pro rose 19 points on the main leaderboard, with code execution up 38; and DeepSeek V4 Pro fell 11.9 points on the main leaderboard, with material constraints down 32.6. These single-day fluctuations may stem from question sampling variance, or they may reflect genuine differences in how models perform under specific constraints; follow-up runs using the same methodology are needed to confirm.
As a small-sample, single-day signal, Smoke currently provides only same-day observations, and no anomalous signals were observed; the interpretation remains restrained to reflect the actual characteristics of the score structure.
Key Changes
- Grok 4: main leaderboard down 32.9 points, code execution down 25.2, material constraints down 42.3
- Doubao Pro: main leaderboard up 19 points, code execution up 38
- GPT-6 Sol: main leaderboard down 16.6 points, material constraints down 41.9
- GPT-6 Astra: main leaderboard down 13.1 points, material constraints down 34.9
- DeepSeek V4 Pro: main leaderboard down 11.9 points, code execution up 5, material constraints down 32.6
Signals to Watch
- No publishable anomalous signals were retained for this run.
When reading this kind of Smoke brief, the focus should be on two questions: first, whether a model exposes the same type of weakness on consecutive days; and second, whether its integrity rating moves from pass to warn or fail. Large single-day changes in execution or constraint scores may come from question sampling, or they may be early signals of genuine degradation, and follow-up runs are needed to confirm.
Data source: YZ Index | Run #431 | View raw data
© 2026 Winzheng.com 赢政天下 | 转载请注明来源并附原文链接