Decoding Intelligence, Defining Value.
Decoding Intelligence, Defining Value
This week, <strong>368</strong> translation tasks were completed by <strong>4</strong> models. A sample of <strong>3</strong> articles was used for multi-model blind evaluation comparison, with the overall best being <strong>claude-sonnet-4.6</strong> (average score 8.5/10).
WDCD Run #233 (2026-07-15) evaluated 11 frontier models on multi-turn commitment integrity, recording an average instruction decay of 27.3% between Round 1 and Round 3. GPT-o3 topped the leaderboard with 94 points and zero decay, while Gemini 3.1 Pro suffered a complete 100% collapse.
This week's 361 translation tasks were completed by 3 models. A sample of 3 tasks underwent multi-model blind evaluation, with the best overall being gpt-o3 (average score 9/10).
WDCD Run #227 (2026-07-12) evaluated 11 frontier models on multi-turn commitment integrity, with Grok 4 and DeepSeek V4 Pro tying at 91.4 points and average instruction decay measured at -2.8% between Round 1 and Round 3.
WDCD Run #221 (2026-07-08) measured instruction decay across 11 frontier models over three dialogue rounds, recording an average commitment decay of -36.4% from Round 1 to Round 3. Grok 4 topped the ranking with 95 points.
This week, 318 translation tasks were completed by 4 models. A blind evaluation of 3 sampled documents was conducted across multiple models, with gpt-o3 scoring the highest average rating of 9/10.
WDCD Run #211 (2026-07-03) benchmarked 11 models on multi-turn commitment integrity, with Grok 4 taking the top spot at 91.2 points and only -13% decay, while GPT-o3 posted the worst decay rate at -75%.
WDCD Run #207 (2026-07-01) measured multi-turn commitment across 11 frontier models, recording an average commitment decay of -66.3% from Round 1 to Round 3. Grok 4 took the top score at 100 points, while Doubao Pro showed the strongest decay resistance.
This week, 376 translation tasks were completed by 4 models. A blind review of 3 sampled articles shows claude-sonnet-4.6 as the best overall (average score 9/10).
WDCD Run #202 (2026-06-28) measured multi-turn commitment integrity across 11 frontier models, recording an average instruction decay of -73.2% between Round 1 and Round 3. Gemini 3.1 Pro topped the leaderboard at 93.6 points.
WDCD Run #196 (2026-06-24) tested 11 leading models across three dialogue rounds, recording an average commitment decay of -39.9% from Round 1 to Round 3. Qwen3 Max topped the leaderboard at 92.5 points despite a -90% decay curve.
This week, 393 translation tasks were completed by 4 models. A multi-model blind evaluation of 3 sampled tasks showed claude-sonnet-4.6 achieved the best average score (9/10).
