Four-Model Translation Showdown: Week 47 Quality Review, claude-sonnet-4.6 Leads with 9 Points

This week 442 translation tasks were completed by 4 models, with 3 sampled for a multi-model blind evaluation. Best overall: claude-sonnet-4.6 (average score 9/10).

This week, 442 translation tasks were completed by 4 models. 3 were sampled for a multi-model blind comparison; the best overall was claude-sonnet-4.6 (average score 9/10).

This Week's Translation Statistics

ModelLanguageVolumeAvg. TimeAvg. Quality Score
deepseek-v4-flashen7618.5sNot rated
claude-sonnet-4.6ja22049.5sNot rated
passthroughen1410sNot rated
deepseek-v4-flash:backtranslateen144.1sNot rated
native-englishen2-Not rated
deepseek-v4-flashzh25.9sNot rated

Sampled Comparative Evaluation

Evaluation 1: US-China Summit Agrees on AI Incident Hotline; Shelved Military Crisis Agreement Emerges as the Biggest Risk

ModelAccuracyFluencyTerminologyReadabilityTotal
claude-sonnet-4.698999
deepseek-v4-pro88878
gpt-o399999

claude-sonnet-4.6

✓ Clear structure, with obvious layering via HTML headings; for example, the subheading「この「ホットライン」は何をつなぐのか」corresponds well to the logic of the source text.

✗ The ending is truncated, which hurts readability; for example, the final paragraph cuts off abruptly at「この枠」.

deepseek-v4-pro

✓ Terminology handling is fairly consistent; for example,「super intelligence」is retained directly and explained clearly.

✗ Some sentences are slightly stiff with a heavy translationese feel; for example,「このメカニズムは操作可能な技術協定というより政治的姿勢に近い」is not expressed naturally enough.

gpt-o3

✓ Highest fluency and natural phrasing; for example,「この仕組みは実行可能な技術協定というより、政治的姿勢を示すものに近い」is closer to Chinese conventions.

✗ Also suffers from truncation; the ending「実際の運用にお」is incomplete.

Conclusion: The three versions are close in overall quality. Claude and GPT are slightly better on accuracy and readability, but both have truncation defects; Deepseek is consistent in terminology but slightly weaker in fluency. It is recommended to use the Claude or GPT version first and complete the truncated portions.

Evaluation 2: Plurai Borrows the Autonomous Driving Approach to Make AI Agents More Reliable

ModelAccuracyFluencyTerminologyReadabilityTotal
passthrough65745
deepseek-v4-pro88978
gpt-o399999

passthrough

✓ The references to LiveBench 2.0 and EON test data are fairly direct;「LiveBench 2.0 shows Claude Fable 5.2 and ChatGPT-6 Astra succeeding on 82.9 and 75.6 out of 100 tasks」retains the specific figures.

✗ The text is severely truncated and mixed with HTML tags;「Since we saw the same pattern, the s」is clearly unfinished, hurting overall readability.

deepseek-v4-pro

✓ The analogy between AI agent reliability and autonomous driving is stated clearly;「borrows the approach that made autonomous vehicles truly road-ready」is translated naturally.

✗ The content is not presented in full; the ending「Early autonomous drivin」is likewise truncated, making the structure insufficiently coherent.

gpt-o3

✓ The editor's note flows smoothly into the main text;「making them work reliably in an unpredictable world has become a problem even trickier than model capability itself」accurately conveys the core pain point.

✗ Some long sentences are slightly Europeanized;「The same instruction may trigger different tool calls, different reasoning paths, or even different outcomes」could be simplified further.

Conclusion: Version C is the best overall, leading on accuracy, fluency and readability; Version A is the worst due to truncation and HTML problems; Version B is close to C but slightly weaker in structural completeness.

Evaluation 3: Will Jensen Huang's Bad News Be Bad News for the AI Industry?

ModelAccuracyFluencyTerminologyReadabilityTotal
passthrough39865
deepseek-v4-pro87988
gpt-o398999

passthrough

✓ The English source text is fluent and natural;「We didn’t see this coming.」is idiomatic.

✗ This is not a Chinese-to-English translation at all, but a direct copy of the English source, constituting a serious omission.

deepseek-v4-pro

✓ Terminology is consistent;「NVIDIA」and「AI investment narrative」are used accurately and uniformly.

✗ It adds an analytical framing not present in the source;「This article analyzes this core judgment」is over-interpretation.

gpt-o3

✓ Faithful to the source and clearly structured;「Could Jensen Huang’s bad news become bad news for the AI industry?」corresponds directly to the Chinese title.

✗ Some sentences are slightly verbose;「When one company simultaneously occupies three positions」could be trimmed further.

Conclusion: Version C is the best overall, with the highest accuracy and readability; Version B is next but contains a small amount of over-interpretation; Version A is not a valid translation.