Claude Sonnet 4.6 Code Execution Plunges 27.4 Points, While Material Constraints Soar 37.7 Points
Claude Sonnet 4.6's Code Execution score fell 27.4 points in today's Smoke evaluation, while Material Constraints rose 37.7 points, leaving the main leaderboard score up only 1.9 points. The sharp reversal is likely due to small-sample question variation rather than actual model degradation.