https://techmonitor.ai/technology/silicon/amd-mi300x-release

AMD has announced its release of a new AI chip. Named the Instinct MI300X, the semiconductor combines three distinct layers of silicon to deliver what its manufacturer claims is a 3.4-fold increase in speed for machine-learning calculations. Meta, OpenAI and Microsoft confirmed that they would all utilise the new chip as they seek alternatives to Nvidia’s range of graphic processing units (GPUs) which currently dominate the AI chip market. 

The Instinct MI300X incorporates several types of smaller chips to deliver performance improvements on its predecessors, AMD claims. The new semiconductor layers three CPU chips and six accelerator chips on top of four input-output dies, which in turn are connected via another piece of silicon to eight Dynamic Random Access Memory (DRAM) stacks. The Instinct M300X is also capable of delivering 192GB of high-performance “HBM3” memory, allowing it to support larger AI models than its predecessors. As such, claimed AMD vice-president Sam Naffziger, the Instinct MI300 delivers “the highest density performance that industry knows how to produce at this time.”