Microsoft will use AMD’s AI-optimized Helios racks in Azure
AI-summarised brief · reviewed before publication
Microsoft announced it will integrate Advanced Micro Devices’ Helios rack design into its Azure cloud services. This partnership introduces three new virtual machine instance families powered by AMD silicon. The Helios reference design features 72 Instinct MI455 GPUs per system, utilizing CDNA 5 architecture and 432 gigabytes of HBM4 memory. These graphics processing units are supported by Pensando data processing units and Epyc CPUs from the Venice series. The Venice processors leverage TSMC’s two-nanometer process and SoIC chiplet stacking technology. Helios racks employ liquid cooling and UALoE networking protocols to manage heat and data exchange efficiently. AMD CEO Lisa Su highlighted the extended collaboration across AMD’s full AI solution stack. Shipping begins later this year. Microsoft will deploy these systems for the ND MI455X v7 series, optimized for AI inference tasks like agents and search. Additionally, the HDv2 series supports CPU-intensive data preparation, while the HXv2 series targets electronic design automation workloads.
💡 Why It Matters
- · The shift to liquid-cooled, two-nanometer racks marks a critical infrastructure evolution for handling dense AI inference loads.
- · By offloading network tasks to specialized data processing units, Microsoft preserves valuable CPU capacity for customer applications.