Deployed AI systems can behave very differently from their foundation models, so safety scores from system cards cannot be assumed to transfer. Teams should test complete deployment systems and account for measurement uncertainty.
Developers and deployers can now use two MLCommons benchmarks, AILuminate Safety 1.2.1 and AILuminate Jailbreak 1.1, to test AI systems' propensity to produce harmful content and how easily attackers can induce violations. Both benchmarks can be run on demand through MLCommons' new Candela service, and new public results for 27 systems have been released.
MLCommons has launched Candela, a benchmarking-as-a-service offering built on the AILuminate benchmarks to measure AI risk and reliability. It enables organizations to test complete AI systems across configurations and cite results for governance and procurement.
On this page1. CP × HiCache: Page-based KV sharding1.1 Logical radix tree and page ownership1.2 Reading sharded KV: Gather one layer at a time1.3 HiCache integration: Restore each shard before gatheri
On this pageTL;DRHow Scale-Up Builds on RecoveryOne Logical Deployment, Three Cooperating LayersHow a Live EP Group GrowsMeasuring the TransitionRoadmapEPLB after scale-upCUDA graph recaptureMulti-ran
On this pageBuilt on TorchNeuron from the startWhat's in the betaEarly preview: heterogeneous RLJoin the betaOver the past year, we have continued to expand the hardware SGLang supports, alongside lau
On this pageTL;DRBackgroundWhy agentic RL is differentArchitectureThe stackExperimental setupWhere the time goesStep time breakdownThe long-tail problemContext growth and the KV cacheThe CPU side: san
On this pageWhat is integratedResultsWhere the speed comes fromWhat SGLang addsAcknowledgmentsAppendix: benchmark setupPrefillDecodeTL;DR On par or ahead on DeepInfer’s own benchmarks. Up to 1.04x pre
On this pageTL;DRAbstract1. Introduction2. Why Native NVFP4 RL Becomes Unstable2.1 Failure Develops During Training2.2 Quantization Error, Conversion Error, and Execution Mismatch2.3 Activation Precis
On this pageImpact and affected deploymentsWhat happenedImmediate remediation and upstream fixRelated KV cache lifetime issuesBackgroundThe Problem: When Is a KVCache Slot Actually Free?Impact and Exp
Politicians on the left, like NYC mayor Zohran Mamdani and former FTC chair Lina Khan, accused Google of acting as an unregulated monopoly.
Tuesday, November 17, 2026 In an effort to reach an elusive continuity of the self, some far-thinking technologists are working on ways to keep your brain going—even beyond death. Join science editor Mary Beth Griggs and senior editor for biomedicine Antonio Regalado for a conversation exploring possible paths to keep your mind going, including gradual…
Open source models are becoming more mainstream as enterprises, governments and startups alike rely on the promise of lower costs, more control, and more flexibility. But as increasingly capable models become more freely available, how do companies capture value? And with Chinese open models gaining ground, can American players keep up?  On this episode of […]
Texas is the fastest-growing data center market in the US and ground zero for Big Tech’s largest AI buildouts. But the blue wave that swept the Lone Star State may jeopardize that position. Democrat James Talarico won the US Senate seat against Ken Paxton. Gina Hinojosa won the race for governor against the Republican incumbent,…
“Most of the risk is actually created by a couple of players building behind closed doors,” Clément Delangue said of the need for open source AI.
DuckDuckGo is courting schools frustrated by Google's AI restrictions, pointing educators to its search engine and options to disable AI features.
Open source models are becoming more mainstream as enterprises, governments and startups alike rely on the promise of lower costs, more control, and more flexibility. But as increasingly capable models become more freely available, how do companies capture value? And with Chinese open models gaining ground, can American players keep up?  On this episode of […]
Google is tying up AI Overviews with traditional search, angering parents and educators who worry that easy, machine-generated answers are leaving kids less capable.
The 2026-11-05 YZ Index Smoke quick test covered 13 models, with GPT-6 Astra and GPT-6.1 Sol tied for first at 81.66 points. The Smoke test is a daily 10-question quick test suited to short-term signals and is not equivalent to Full weekly leaderboard conclusions.
Apple's AI-powered Siri Recaps won me over in just one day, despite my privacy reservations. But there's still room for improvement.
