Apple Publishes Minions Paper: Aggregating Idle Mac GPUs into a Distributed Inference Cluster, Cutting Queuing from 10 Hours to Minutes
Apple's research team has published a paper on Minions, an internally deployed distributed GPU inference system that aggregates idle Mac GPUs. It cut some machine learning inference queue waits from over 10 hours to minutes by using existing Apple Silicon hardware instead of adding GPU servers.