Four-Model Translation Showdown: Week 46 Quality Evaluation, claude-sonnet-4.6 Leads with 9 Points

This week 395 translation tasks were completed by 4 models, with 3 samples drawn for a blind multi-model comparison. Overall best: claude-sonnet-4.6 with an average score of 9/10.

This week, 395 translation tasks were completed by 4 models. 3 samples were drawn for a blind multi-model comparison. Overall best: claude-sonnet-4.6 (average score 9/10).

This Week's Translation Statistics

ModelLanguageVolumeAvg. TimeAvg. Quality Score
deepseek-v4-flashen7619.9sNot rated
claude-sonnet-4.6ja19751.9sNot rated
passthroughen1160sNot rated
native-englishen1-Not rated
deepseek-v4-flashzh114.2sNot rated
deepseek-v4-flash:backtranslateen414.2sNot rated

Sampled Comparative Evaluation

Evaluation 1: Google's Bundled Education AI Search: Skip AI and You Give Up Search

ModelAccuracyFluencyTerminologyReadabilityOverall
claude-sonnet-4.699999
deepseek-v4-pro76766
gpt-o388888

claude-sonnet-4.6

✓ Accurately conveys the original's educational design intent of "not giving direct answers" (直接答えを与えない); the phrasing is natural and idiomatic in Japanese.

✗ Some paragraphs contain long sentences; the logical flow is clear but somewhat dense, which affects the reading rhythm for some readers.

deepseek-v4-pro

✓ Handles terminology such as "ソクラテス式質問" (Socratic questioning) fairly consistently, with no serious deviation from the core meaning.

✗ Contains obvious Japanese errors, such as "向其" in "教育機関向其AIツール", a typo or omission that undermines fluency.

gpt-o3

✓ The translation of "市場ロックイン戦略" fits the original, and the logical connections are clear and natural.

✗ Some phrasing is somewhat flat; for example, "学生が自力で考えられるよう支援する" lacks the emphasis of the original.

Conclusion: Version A has the highest overall quality, outperforming the other versions in accuracy, fluency, and readability, and is suitable for direct use. Version C ranks second. Version B has obvious errors and truncation issues and is not recommended.

Evaluation 2: From $2 Trillion to $1.5 Trillion: Anthropic's IPO Roadshow Reveals the True Valuation of Foundation Model Companies

ModelAccuracyFluencyTerminologyReadabilityOverall
deepseek-v4-flash87877
deepseek-v4-pro88878
gpt-o399989

deepseek-v4-flash

✓ Accurately conveys the valuation logic of "A month ago, Anthropic's most enthusiastic supporters believed a $2 trillion valuation was within easy reach."

✗ The ending is clearly truncated: "rather than holding at a high level and" is an unfinished sentence, which hurts readability.

deepseek-v4-pro

✓ Rendering "reverse negotiation" as "reverse game" is fairly close to the original's business context.

✗ Also truncated: "after the Nasdaq" is not presented in full, leaving the structure incomplete.

gpt-o3

✓ "it is not prepared to pay the most optimistic price" is more natural and idiomatic, and "bullish supporters" is precisely worded.

✗ Also has a minor truncation issue: "after the Nasdaq 100" is not fully completed.

Conclusion: The three versions are close in overall quality. gpt-o3 is slightly better in fluency and natural word choice, but all show varying degrees of truncation and should be completed before use.

Evaluation 3: WDCD Run #411: GPT-6 Astra Leads with 90.5 Points as Average Instruction Decay Hits -80%

ModelAccuracyFluencyTerminologyReadabilityOverall
deepseek-v4-flash92875
deepseek-v4-pro88778
gpt-o399999

deepseek-v4-flash

✓ Fully preserves all key data and list structures from the original, with no omissions such as "Run #411 (2026-11-04)."

✗ Version A is actually a Chinese translation rather than Japanese, completely failing to meet the target-language requirement, with extremely low fluency.

deepseek-v4-pro

✓ The Japanese is fairly natural, terms such as "指示認識" are used appropriately, and paragraph transitions are smooth.

✗ The JSON structure is truncated and the latter half of the content is missing, which affects readability.

gpt-o3

✓ Has the highest Japanese fluency; expressions such as "フラットな値" and "注目すべき外れ値" are idiomatic and natural, with strong terminological consistency.

✗ Also suffers from JSON truncation, leaving the ending incomplete.

Conclusion: Version C has the best overall quality, followed by Version B; Version A ranks last because it does not meet the language requirement. Both B and C have content truncation issues and should be fixed before use.