Xiaomi's MiMo-V2.5-Pro-UltraSpeed achieves 1,200 tokens per second, setting a new AI inference speed record with innovative techniques.
Xiaomi Breaks AI Inference Speed Barrier
Xiaomi has achieved a significant milestone in artificial intelligence, surpassing 1,000 tokens per second with its MiMo-V2.5-Pro-UltraSpeed model. This breakthrough, made possible through collaboration with TileRT, utilizes a standard 8-GPU commodity node, which represents a shift towards more accessible AI capabilities.
The new model can reach speeds of nearly 1,200 tokens per second by leveraging innovative techniques such as FP4 quantization and DFlash speculative decoding. This allows for the simultaneous processing of multiple tokens, greatly enhancing efficiency compared to existing models.
For context, traditional models like GPT-5.5 and Claude Opus 4.6 operate at much lower speeds, handling approximately 68 and 71 tokens per second, respectively. In contrast, Xiaomi's MiMo model showcases its potential for applications requiring rapid processing, such as fraud detection and trading signal generation.
Technical Innovations Driving Performance
The speed of MiMo-V2.5-Pro-UltraSpeed is achieved through two main innovations. First, FP4 quantization reduces the precision of the model's expert layers to 4 bits, significantly lowering memory usage and increasing speed with minimal quality loss. Second, the DFlash speculative decoding method allows for the simultaneous verification of multiple tokens, enhancing processing speed.
Xiaomi's approach combines these techniques within a single GPU framework, eliminating delays and ensuring continuous execution. This extreme model-system co-design is what enables the model to reach the remarkable speed of 1,000 tokens per second.
To make this technology more accessible, Xiaomi plans to launch a limited API trial from June 9 to June 23, priced at three times the standard rates but promising nearly ten times the generation speed. This initiative prioritizes enterprise and professional developers, reflecting Xiaomi's commitment to advancing AI capabilities.
