Azure has announced a new artificial intelligence optimized virtual machine (VM) series that features AMD's flagship MI300X GPU, providing customers with more choices for AI optimized VMs. The new VMs have an unprecedented 1.5 TB of high bandwidth memory (HBM) that leverages the power of the MI300X GPU, allowing customers to process larger models faster using fewer GPUs.
The new VM, ND MI300X v5, is the result of a long-term partnership between Microsoft and AMD and is part of Azure's ongoing commitment to pushing the boundaries of artificial intelligence. It is the latest addition to Azure's ND-series VMs, offering the highest HBM capacity available in the cloud, thus saving power, cost, and time for customers.