Claude Opus 4.7 Leads with 79.56: 2026-11-11 Smoke Quick Test Data Brief

2026-11-11 YZ Index Smoke Quick Test covered 13 models, with Claude Opus 4.7 ranking first for the day at 79.56. Smoke is a daily 10-question quick test suited to observing short-term signals and is not equivalent to conclusions from the Full weekly ranking.

This Smoke evaluation covered only two main leaderboard dimensions: Code Execution and Material Constraints. The Main Leaderboard formula is 0.55 × Code Execution + 0.45 × Material Constraints. Because the daily sample size is small, single-day scores are better used as monitoring signals rather than long-term conclusions about model capabilities.

Daily Ranking

Data Interpretation

In today's YZ Index Smoke Quick Test, leading models showed clear divergence in how Code Execution and Material Constraints combined. Claude Opus 4.7 ranked first on the Main Leaderboard at 79.56, with Code Execution 72.4 and Material Constraints 88.3, indicating a pronounced advantage in Material Constraints; Doubao Pro followed at 79.18 on the Main Leaderboard, with Code Execution 78.5 and Material Constraints 80, scoring higher in Code Execution; GPT-6 Luna scored 74.75 on the Main Leaderboard, with Code Execution 71.1 and Material Constraints 79.2, a relatively balanced performance across the two. Models at the top generally maintained high levels on both indicators, while mid- and lower-ranked models such as DeepSeek V4 Pro, with Code Execution only 16.7 but Material Constraints 88.3, and Gemini 3.1 Pro, with Code Execution 35.8 and Material Constraints 81.7, displayed a structural pattern of strength in one dimension but overall limitation.

Compared with the previous comparable run, GPT-6 Astra fell 36.2 points on the Main Leaderboard, with Code Execution down 50.2 points and Material Constraints down 19.1 points; GPT-5.5 fell 28.9 points on the Main Leaderboard, with Code Execution down 32.6 points and Material Constraints down 24.3 points; Gemini 3.1 Pro fell 26 points on the Main Leaderboard, with Code Execution down 45.9 points; Gemini 2.5 Pro fell 18.2 points on the Main Leaderboard, with Code Execution down 24.1 points and Material Constraints down 11 points; GPT-6.1 Sol fell 18 points on the Main Leaderboard, with Code Execution down 25.2 points and Material Constraints down 9.1 points. These changes were mainly concentrated in the Code Execution indicator, while Material Constraints fluctuated relatively less.

This Smoke Quick Test is a small-sample, single-day signal. The score changes above may stem from question-sampling fluctuation or may reflect real differences in model performance in specific scenarios, and subsequent runs are needed to confirm stability. All interpretations are based on the day's data and do not constitute long-term judgments.

Key Changes

• GPT-6 Astra: Main Leaderboard down 36.2 points, Code Execution -50.2 points, Material Constraints -19.1 points
• GPT-5.5: Main Leaderboard down 28.9 points, Code Execution -32.6 points, Material Constraints -24.3 points
• Gemini 3.1 Pro: Main Leaderboard down 26 points, Code Execution -45.9 points
• Gemini 2.5 Pro: Main Leaderboard down 18.2 points, Code Execution -24.1 points, Material Constraints -11 points
• GPT-6.1 Sol: Main Leaderboard down 18 points, Code Execution -25.2 points, Material Constraints -9.1 points

Signals to Watch

• No publishable anomaly signals were retained in this run.

When reading this type of Smoke brief, focus on two questions: first, whether a model repeatedly exposes the same type of weakness over multiple consecutive days; second, whether its Integrity rating moves from pass to warn or fail. Large single-day changes in execution or constraint scores may come from question sampling or may be early signals of real degradation, requiring follow-up runs for confirmation.

Data source: YZ Index | Run #421 | View raw data