vLLM keeps pushing MiniMax-M3.1-Flash performance on NVIDIA Vera Rubin NVL72! 🚀
On @SemiAnalysis_ AgentX, vLLM on Rubin vs. on GB300 NVL72:
🔥 10.2x total tok/s/chip (incl. cached) at 546 P90 tok/s/user
📈 6.5x at 376 P90 tok/s/user
⚡ Up to 1,205 P90 tok/s/user at low concurrency
