India, Oct. 12 -- Microsoft (MSFT) has unveiled Maia 300, its third-generation artificial intelligence accelerator designed to improve the performance and efficiency of large-scale AI inference workloads across its Azure infrastructure.
The company said Maia 300 delivers up to seven times greater rack-scale token throughput and more than 2.5 times the performance per watt compared with Maia 200.
Each accelerator includes 288 GB of HBM4 memory with 18 TB per second of bandwidth, providing 2.5 times greater memory bandwidth and 33 percent more memory capacity than its predecessor.
Maia 300 racks contain 96 accelerators, double the density of Maia 200, while a two-tier Ethernet-based network can connect as many as 12,288 accelerators in a s...