On 2026-09-30, the YZ Index Smoke Quick Test covered 10 models, with Qwen3 Max ranking first for the day at 84.51 points. Smoke is a daily 10-question quick test suitable for observing short-term signals, not equivalent to Full weekly leaderboard conclusions.
The MLCommons Financial Services Working Group's Agent Reliability Profile has been selected as a finalist in C:>DIR's global “Agentic Regulator” Hackathon. The framework aims to help close the authorization and oversight gap for AI agents in financial services.
MLCommons has released the latest MLPerf Inference v6.1 results, featuring a record number of submitting organizations, two new tests aligned with recent AI inference deployment trends, and first-time peer-reviewed performance results for several new AI platforms. Top performance improved by up to 5.7x compared with a year ago.
MLPerf Inference v6.1 draws a record 30 submitters and 120 submitted systems, while signaling a clear shift toward agentic and end-to-end benchmarks. The round also features new hardware, major gains for VLM and DeepSeek R1, and record multi-node and large-scale submissions.
MLCommons has become a member of the EU-funded AIRIS project consortium, where it will develop comprehensive evaluation frameworks and benchmark suites to assess multimodal generative AI platforms for biomedical research.
MLPerf Training will add an LLM post-training benchmark starting with its October 2026 v6.1 submission round, supplementing the existing pre-training suite. The workload uses reinforcement learning with verifiable rewards (RLVR) on agentic software engineering tasks, built on Qwen 3.5 397B and the R2E-Gym dataset.
Running DeepSeek-V4-Flash and Kimi-K3 on Consumer Hardware with SSD Expert PackWiCi AI Team, SGLang TeamAugust 29, 2026 SGLang brings the core idea of SSD-LLaMA to MoE inference: keep routed experts t
Accelerating Long-Context and Agentic Inference with NVFP4 KV CacheSGLang, Qwen, and NVIDIA teamsSeptember 16, 2026The KV cache is a fundamental building block of the modern LLM inference system. The
Scaling JEV-like Decision Models with SGLangSundara Raman Ramachandran, Chuanrui Zhu, Qing Lan, Shri Rajamanikandan Vasudevan, Jian Sheng, I-Ting Chen, Fedor BorisyukSeptember 25, 2026A customer asks
The 2026-09-29 YZ Index Smoke quick test covered 10 models, with Claude Opus 4.7 and GPT-5.5 tied for first place that day at 80.2. Smoke is a daily 10-question quick test suited to spotting short-term signals, and its results are not equivalent to Full weekly leaderboard conclusions.
In today's Smoke evaluation, GPT-o3's main leaderboard score fell from 96.01 to 80.78, with code execution plunging 24.5 points. The article argues this is more likely due to small-sample question draw variance than genuine model degradation, because other dimensions remained stable or improved.
Claude Opus 4.7 dropped from 96.01 to 82.16 on the Smoke benchmark main leaderboard today, with the code execution dimension falling 22 points in a single day.
The 2026-09-28 YZ Index Smoke quick test covered 11 models, with GPT-5.5 ranking first for the day at 93.16 points. Smoke is a daily 10-question quick test suited to observing short-term signals and is not equivalent to weekly Full leaderboard conclusions.
In today's Smoke evaluation, GPT-5.5's main leaderboard score fell 12.5 points to 78.80, driven by a 28-point single-day drop in the code execution dimension, though the swing appears to reflect question-draw variance rather than a genuine capability regression.
Doubao Pro scored 83.00 on today's Smoke benchmark main leaderboard, down 9.8 points from yesterday's 92.85, with the material constraint dimension dropping from 85.70 to 72.00. The decline is most likely driven by small-sample question variance rather than genuine model degradation.
Based on Smoke evaluation data from 2026-09-21 to 2026-09-27, Claude Opus 4.7 rose from 70.77 to 96.01 over seven days, with the highest average of 87.8, while Gemini 3.1 Pro fell 26.9 points. The report analyzes steadily rising models, clearly declining models, high-volatility models, and integrity rating changes.
On 2026-09-27, the YZ Index Smoke quick test covered 10 models, with Grok 4 ranking first for the day at 97.66 points. The Smoke test is a daily 10-question quick assessment, useful for short-term signals but not equivalent to Full weekly ranking conclusions.
The September 26, 2026 YZ Index Smoke quick test covered 10 models, with Doubao Pro ranking first at 92.85. Smoke is a daily 10-question quick test intended for short-term signals and does not represent the conclusions of the Full weekly ranking.
The 2026-09-25 YZ Index Smoke quick test covered 10 models, with GPT-5.5 leading the day at 86.25 on the main leaderboard. The brief reviews the daily rankings and score shifts across the code execution and material constraints dimensions.
On 2026-09-24, the YZ Index Smoke quick test covered 10 models, with Claude Opus 4.7 and Gemini 3.1 Pro tied for first place at 84.61. Smoke is a daily 10-question quick test suitable for short-term signals and is not equivalent to Full weekly ranking conclusions.
