Microsoft Commits Maia to Multi-Gigawatt Inference, and Its Efficiency Metric Draws Questions

October 16, 2026 · 6:02 am 1 sources

Image: InfoQ

Coverage

More coverage

• Microsoft Commits Maia to Multi-Gigawatt Inference, and Its Efficiency Metric Draws Questions
  InfoQ · October 16, 2026 06:02
  Microsoft will scale its Maia accelerator family to multi-gigawatt deployments from 2027, making it the primary inference system for its own products. Maia 300 collapses scale-up and scale-out onto one Ethernet fabric and moves KV state between prefill and decode workers without leaving it.…