AI Coding Benchmarks

251 articles · Page 1 of 13
Which AI model writes the best code? HumanEval and MBPP are common benchmarks, but they only test function-level completion — far from real-world development. The YZ Index Execution dimension runs model-generated programs in isolated sandboxes, verifying compilation, runtime correctness, and edge-case handling. It is one of the few independent benchmarks using real code execution verification rather than model-as-judge scoring. This topic tracks coding capability rankings, programming tool updates, and AI-assisted development practices.

In-depth Guides

Review Doubao Pro Code Execution Plummets 26.2 Points, Main Leaderboard Rises Only 0.03 Points
In today’s Smoke evaluation, Doubao Pro’s code execution score fell 26.2 points to 48.80, while its material constraint score rose 32.1 points to 100.
Nov 19, 2026
Review GPT-5.5 Code Execution Plunges 24.8 Points; Main Leaderboard Drops Only 2.8 Points
In today's Smoke evaluation, GPT-5.5's code execution score fell from 99.80 to 75.00, a 24.8-point drop, while its overall main leaderboard score decl
Nov 18, 2026
Review GPT-6 Luna Code Execution Plunges 24.1 Points as Material Constraint Climbs 32
In today's Smoke evaluation, GPT-6 Luna's code execution score fell from 99.10 to 75.00 while its material constraint score rose from 62.80 to 94.80,
Nov 18, 2026
Review GPT-6.1 Sol Code Execution Plunges 27.3 Points as Overall Ranking Slips to 78.69
In today's Smoke evaluation, GPT-6.1 Sol's code execution score fell from 97.30 to 70.00, dragging its overall ranking down from 84.70 to 78.69. The d
Nov 16, 2026
Review GPT-6 Astra Code Execution Plunges 27.3 Points as Main Leaderboard Falls from 84.70 to 78.69
In today's Smoke evaluation, GPT-6 Astra's code execution score dropped from 97.30 to 70.00, pulling the main leaderboard down from 84.70 to 78.69, wh
Nov 16, 2026
Review Doubao Pro Main Leaderboard Plunges 8 Points: Code Execution 94.5→45.8, Material Constraints 47.6→89.3
Doubao Pro's main leaderboard score fell 8.02 points to 65.38 in today's Smoke evaluation, driven by a 48.70-point collapse in code execution that a 4
Nov 15, 2026
Review Claude Opus 4.7 Code Execution Drops 19.5 Points as Material Constraints Rise 19.3 Points
In today's Smoke evaluation, Claude Opus 4.7's code execution score fell 19.5 points while its material constraints score rose 19.3 points, leaving th
Nov 15, 2026
Google Releases Gemini 4 Hydrogen: Lower-Priced Than Argon but Higher-Scoring, Execution-Layer Strategy Fully Deployed
Google has released Gemini 4 Hydrogen, a lower-priced model in the Gemini 4 family that tops Argon on the Artificial Analysis Intelligence Index and i
Nov 14, 2026
Review Claude Sonnet 4.6 Smoke Evaluation Main Leaderboard Plunges 11.7 Points; Material Constraint Falls 19.9 in a Single Day
In today's Smoke evaluation, Claude Sonnet 4.6's main leaderboard score dropped from 82.31 to 70.61, a decline of 11.7 points. The material constraint
Nov 14, 2026
Review Claude Opus 4.7 Main Leaderboard Plunges 11.4 Points, Material Constraint Drops 19.3 in a Single Day
Claude Opus 4.7's main leaderboard score fell from 94.91 to 83.48 in today's Smoke evaluation, a drop of 11.4 points, while the material constraint di
Nov 14, 2026
Review Doubao Pro Main Leaderboard Plunges 10.6 Points as Engineering Judgment Falls from 100 to 63.6
In today's Smoke evaluation, Doubao Pro's main leaderboard score dropped 10.6 points, from 79.18 to 68.54, with Engineering Judgment collapsing 36.4 p
Nov 12, 2026
Review Claude Opus 4.7 Material Constraint Falls 16.9 Points While Main Leaderboard Rises 4.6 Points; Code Execution Saves the Day
In today's Smoke evaluation, Claude Opus 4.7's material constraint score fell 16.9 points to 71.40, yet its main leaderboard score rose 4.6 points to
Nov 12, 2026
Review GLM-4.6 Integrity Rating Fails, Probe Scores Only 25; Main Leaderboard 53.40, Code Execution 25.00
GLM-4.6 scored 53.40 on the main leaderboard in the YZ Index Smoke quick test, with code execution at 25.00 and material constraints at 88.10, while i
Nov 12, 2026
Big Walk used AI to fix a bug. Now the indie gaming world is having a reckoning.
Any amount of AI coding is too much for many Indie Game Festival judges.
Nov 12, 2026
Anthropic Releases Fable 5.2 and Mythos 5.2: 30% Faster, 20% Cheaper, a Technical Bet Ahead of IPO
Anthropic has launched Claude Fable 5.2 and Claude Mythos 5.2, claiming up to 30% faster output generation and a 20% price cut. The release arrives as
Nov 10, 2026
Automattic debuts a platform to deploy vibe coding apps amid a changing internet
Automattic aims to compete with likes of Lovable with Spacefast
Nov 9, 2026
Review GLM-4.6 Smoke Test Scores 25 on Code Execution; Main Leaderboard 36.25 as API Failure Leaves Communication Dimension Missing
GLM-4.6 scored 36.25 on the main leaderboard in today's Smoke evaluation, with 25.00 in code execution, 50.00 in material constraints, and 25.00 in en
Nov 9, 2026
Meta acquires AI coding startup Conductor
The startup allows software engineers to deploy teams of agents to work on various aspects of a project simultaneously.
Nov 5, 2026
Review Claude Sonnet 4.6 Main Leaderboard Plunges 11.1 Points as Code Execution and Material Constraint Both Slip
In today's Smoke evaluation, Claude Sonnet 4.6's main leaderboard score fell from 84.90 to 73.76, a drop of 11.1 points, driven by double-digit declin
Nov 4, 2026
Review GPT-6 Luna Main Leaderboard Plunges 11.5 Points as Code Execution Falls from 100 to 74.3
In today's Smoke evaluation, GPT-6 Luna's main leaderboard score dropped 11.5 points from 87.27 to 75.79, driven by a 25.7-point collapse in the code
Nov 4, 2026