This week, 368 translation tasks were completed by 4 models. A sample of 3 articles was used for multi-model blind evaluation comparison, with the overall best being claude-sonnet-4.6 (average score 8.5/10).
This Week's Translation Statistics
| Model | Language | Volume | Avg Time | Avg Quality Score |
|---|---|---|---|---|
| deepseek-v4-flash | en | 64 | 15s | Not Rated |
| claude-sonnet-4.6 | ja | 183 | 36.4s | Not Rated |
| passthrough | en | 117 | 0s | Not Rated |
| native-english | en | 1 | - | Not Rated |
| deepseek-v4-flash | zh | 1 | 18.4s | Not Rated |
| deepseek-v4-flash:backtranslate | en | 2 | 11.9s | Not Rated |
Sample Comparison Evaluation
Evaluation 1: Why Are Heat Pumps Still So Popular in the US?
| Model | Accuracy | Fluency | Terminology | Readability | Total Score |
|---|---|---|---|---|---|
| claude-sonnet-4.6 | 9 | 9 | 9 | 9 | 9 |
| deepseek-v4-pro | 8 | 7 | 8 | 7 | 7 |
| gpt-o3 | 9 | 8 | 9 | 8 | 8 |
claude-sonnet-4.6
✓ Logical transition is natural, such as "Heat pumps are essentially air conditioners running in reverse" – clear and consistent with technical context.
✗ Some paragraphs are slightly long; high information density may affect fast reading.
deepseek-v4-pro
✓ Terminology such as "air-source heat pump" is accurately translated.
✗ Insufficient fluency; "suddenly exploded in popularity" has an awkward translation tone.
gpt-o3
✓ The policy section is precise, with consistent terminology for "Inflation Reduction Act".
✗ Some sentences are slightly verbose; e.g., the description of heating/cooling efficiency could be more concise.
Conclusion: Version A is the best overall, balancing accuracy and fluency; Version C comes second; Version B has minor issues with fluency and paraphrasing.
Evaluation 2: San Francisco Asks Apple and Google to Remove AI 'Undressing' Apps
| Model | Accuracy | Fluency | Terminology | Readability | Total Score |
|---|---|---|---|---|---|
| claude-sonnet-4.6 | 9 | 8 | 9 | 8 | 8 |
| deepseek-v4-pro | 8 | 7 | 8 | 7 | 7 |
| gpt-o3 | 9 | 9 | 8 | 9 | 9 |
claude-sonnet-4.6
✓ Terminology is accurate and consistent, such as "face-swap" used throughout, faithfully corresponding to the original text.
✗ Some long sentences are slightly cumbersome; e.g., the end of the first paragraph "the majority of victims are unsuspecting women and girls" could be more concise.
deepseek-v4-pro
✓ The title translation is direct and clear, "San Francisco Demands Apple and Google Remove AI 'Undressing' Apps" effectively conveys the original message.
✗ Fluency is slightly lacking; some expressions like "false nude images" feel a bit stiff compared to other versions.
gpt-o3
✓ Best overall readability, with smooth paragraph transitions; e.g., the translation of "face-swapping" is natural and logically clear.
✗ Terminology consistency is slightly weaker; e.g., "face-swapping" and "face-swap apps" are used interchangeably, not fully unified.
Conclusion: Version C (gpt-o3) is the best overall, outstanding in fluency and readability; Version A has strong accuracy; Version B is slightly weaker than the other two.
Evaluation 3: Jensen Huang's Japan Trip: What's Behind the Full-Tech Ecosystem Deals?
| Model | Accuracy | Fluency | Terminology | Readability | Total Score |
|---|---|---|---|---|---|
| passthrough | 9 | 8 | 9 | 8 | 8 |
| deepseek-v4-pro | 3 | 7 | 6 | 7 | 4 |
| gpt-o3 | 4 | 8 | 7 | 8 | 5 |
passthrough
✓ Accurately reproduces the original time "July 15 and 16", and faithfully describes the cooperation details of Jensen Huang's trip with Japanese industry, without adding fabricated content.
✗ The text is abruptly cut off at the end, with "The country doesn't want to run i" resulting in incomplete information and affecting overall readability.
deepseek-v4-pro
✓ Paragraph transitions are relatively smooth; the subtitle "SoftBank's AI Network Ambition" is used clearly.
✗ Seriously deviates from the original text; "From June 17 to July 20" does not match the original July 15-16 time, and adds a large amount of specific transaction details about SoftBank, Sony, and Toyota not mentioned in the original, constituting excessive addition.
gpt-o3
✓ The language is natural; the title "Jensen Huang's Japan Trip" is concise, and "unprecedented opportunities" is quite idiomatic.
✗ Similar to the deepseek version, it fabricates the time "June 17 to July 20" and numerous collaboration details with SoftBank not present in the original, compromising accuracy.
Conclusion: Version A has the highest accuracy; Versions B and C both have serious factual errors and content additions, not recommended for use.
© 2026 Winzheng.com 赢政天下 | 转载请注明来源并附原文链接