Curated AI coverage from TechCrunch, MIT Technology Review, WIRED and other top global tech media. Please cite this site when republishing.
On Monday, Databricks announced it reached a $5.4 billion revenue run rate, growing 65% year-over-year, of which more than $1.4 billion was from its AI products. Co-founder and CEO Ali Ghodsi wanted to share these growth numbers because there’s so much talk about how AI is going to kill the SaaS bu
MLCommons and LMSYS Org have jointly launched the CKAN Croissant benchmark, representing a major leap forward in AI model evaluation. It fully leverages the Croissant v1.0 format to enable seamless standardization and sharing of model metadata.
MLCommons has launched the Ailuminate French Datasets, a key expansion of its multilingual LLM benchmark framework. Led by LMSYS Org, the project aims to provide standardized evaluation tools for non-English languages like French, promoting global inclusivity in AI technology.
MLCommons recently released the benchmark results for MLPerf Client v0.6, the first standardized benchmark suite focused on client-side inference performance, targeting smartphones, laptops, and edge devices. Multiple vendors submitted results covering a range of AI models and scenarios.
NASSCOM has officially joined MLCommons as its 50th member, bringing India's perspective to global AI benchmarking and accelerating the adoption of standards like MLPerf in the region.
LMSYS Org released the latest Chatbot Arena benchmark results at AAAI 2025, refreshing the global AI chatbot leaderboard and providing valuable insights for model optimization.
The MLCommons organization officially released the MLPerf Training v5.0 benchmark results, marking a new milestone in AI model training performance evaluation. This benchmark focuses on the performance, efficiency, and scalability of large-scale AI training tasks, helping researchers and enterprises assess the true capabilities of hardware platforms.
The MLCommons organized the ATX (Agent Testing eXploration) Benchmark Expert Panel in June 2025, with LMSYS Org as a key participant, bringing together industry leaders to discuss frontier issues in AI agent evaluation. This panel aims to standardize agent benchmarks and address the shift from generative models to intelligent agents in the post-ChatGPT era.
MLCommons recently announced the 2025 MLC Rising Stars list, recognizing first-time submissions in the MLPerf Inference v5.0 benchmark. These systems, powered by the MLC (ML Compiler) framework, excelled across various AI inference tasks, showcasing the potential of emerging hardware and software optimizations.
LMSYS Org and MLCommons announce the official launch of the Ares benchmark, the first open-source standardized framework focused on long-context multi-agent reasoning in the AI industry, designed to address shortcomings in existing evaluations for complex agent tasks.
MLCommons has announced the latest benchmark results for MLPerf Mobile v4.0 for Android, a milestone update in mobile AI performance evaluation that focuses on the Android platform with real-world user scenarios to help vendors optimize hardware and accelerate AI deployment.
The MLCommons organization has released the first results of the MLPerf Client v1.0 benchmark, the first benchmark specifically designed for AI inference performance on client and edge devices, evaluating generative AI and traditional AI tasks on mobile devices.
This article provides a detailed explanation of the Storage 2 checkpoint mechanism, covering its benchmark overview, test configurations, key results, and analysis, demonstrating how it ensures training stability and fault tolerance in large-scale AI training.
MLCommons has released the MLPerf Storage v2.0 benchmark results, featuring new AI workloads and larger datasets. The results highlight top-tier storage performance for training and inference, with NVIDIA DDN and Pure Storage leading in key metrics.
MLCommons has released the latest results of MLPerf Auto v0.5, an authoritative benchmark in AutoML focused on automated hyperparameter tuning and model selection. LMSYS Org tops the leaderboard with an automated pipeline leveraging Chatbot Arena data.
MLCommons has released the Whisper Inference v5.1 benchmark, introducing the large-v3 model and providing standardized performance data for speech-to-text model inference, aiming to help developers optimize deployment.
MLCommons released the Small LLM Inference 5.1 benchmark, evaluating SLM performance in real-world scenarios such as chatbots and text generation. Key updates include the addition of Llama 3.2 1B, optimized test scenarios, and expanded hardware support.
The latest report from LMSYS Org shows that DeepSeek Inference 5.1 stands out in the MLCommons September 2025 inference benchmark. Designed for large language models, it focuses on low-latency and high-throughput inference optimization.
MLCommons announces the release of MLPerf Inference v5.1 benchmark results, featuring new generative AI workloads and expanded model coverage, with NVIDIA, AMD, and others competing on latency and throughput.
The MLCommons organization has released the MLPerf Tiny v1.3 benchmark results, a key milestone for edge AI. It evaluates model performance on resource-constrained microcontrollers and embedded devices.
