AMD Unveils 5th Gen EPYC Processors for AI and Cloud

AMD (NASDAQ: AMD) has officially launched its highly anticipated 5th Gen AMD EPYC™ processors, previously codenamed “Turin,” marking a significant advancement in server CPU technology for enterprise, artificial intelligence (AI), and cloud computing applications.

Powered by the innovative “Zen 5” core architecture, these processors are compatible with the widely adopted SP5 platform, offering an impressive range of core counts from 8 to 192. The AMD EPYC 9005 Series processors deliver record-breaking performance and energy efficiency, with the top-tier 192-core CPU providing up to 2.7 times the performance compared to its competitors.

A notable addition to this series is the 64-core AMD EPYC 9575F, specifically designed for GPU-powered AI solutions requiring top-tier host CPU capabilities. This processor boasts a boost clock of up to 5GHz, outpacing the competition’s 3.8GHz offerings and delivering up to 28% faster processing, ensuring that GPUs are adequately supplied with data for demanding AI workloads.

Dan McNamara, Senior Vice President and General Manager of AMD’s Server Business, stated, “From powering the world’s fastest supercomputers to leading enterprises and the largest Hyperscalers, AMD has earned the trust of customers who value demonstrated performance, innovation, and energy efficiency. With five generations of on-time roadmap execution, AMD has proven it can meet the needs of the data center market and set the standard for performance and efficiency in cloud, enterprise, and AI workloads.”

 Transforming Data Centers for Modern Workloads

Modern data centers manage a diverse range of workloads, from corporate AI initiatives to large-scale cloud infrastructures and critical business applications. The 5th Gen AMD EPYC processors are engineered to provide exceptional performance across various server workloads that are vital for contemporary business IT.

The new “Zen 5” architecture enhances performance, achieving up to 17% better instructions per clock (IPC) for enterprise and cloud workloads and up to 37% higher IPC for AI and high-performance computing (HPC) compared to the previous generation, “Zen 4.”

With AMD EPYC 9965 processor-based servers, customers can expect significant enhancements in their real-world applications compared to Intel Xeon® 8592+ CPU-based servers, achieving:

– Up to 4X faster time to results in business applications such as video transcoding.

– Up to 3.9X faster time to insights for scientific and HPC applications tackling the world’s most challenging issues.

– Up to 1.6X the performance per core in virtualized infrastructures.

Beyond exceptional performance and efficiency for general-purpose workloads, the 5th Gen AMD EPYC processors facilitate rapid insights and deployments for AI solutions, whether operating on a CPU or a combined CPU + GPU system.

 Unmatched AI Performance

When compared to competitor solutions, the 192-core EPYC 9965 CPU delivers up to 3.7X the performance on end-to-end AI workloads, such as TPCx-AI, essential for optimizing generative AI strategies. In the realm of small and medium-sized enterprise-class generative AI models, like Meta’s Llama 3.1-8B, the EPYC 9965 provides 1.9X the throughput performance compared to rival CPUs. Furthermore, the EPYC 9575F, engineered as a dedicated AI host node CPU, can harness its 5GHz max frequency boost to enable a 1,000-node AI cluster to achieve up to 700,000 more inference tokens per second, significantly enhancing processing speed.

Transitioning to a data center powered by these processors can yield 391,000 units of SPECrate®2017_int_base general-purpose computing performance, allowing customers to enjoy impressive performance across workloads while utilizing an estimated 71% less power and approximately 87% fewer servers. This optimization provides Chief Information Officers (CIOs) the flexibility to leverage space and power savings or enhance performance for everyday IT operations while delivering outstanding AI capabilities.

 AMD EPYC CPUs: Pioneering the Future of Computing

The robust performance and extensive ecosystem support for EPYC CPUs have catalyzed widespread adoption for demanding computing tasks. With superior performance, features, and density, AMD EPYC CPUs empower customers to achieve value in their data centers and IT environments efficiently.

 Key Features of the 5th Gen AMD EPYC Processors

The entire lineup of 5th Gen AMD EPYC processors is now available, supported by major companies such as Cisco, Dell, Hewlett Packard Enterprise, Lenovo, and Supermicro, providing a seamless upgrade path for organizations aiming for leadership in computing and AI.

High-level features of the AMD EPYC 9005 series CPUs include:

– Leadership core count options ranging from 8 to 192 per CPU

– Advanced “Zen 5” and “Zen 5c” core architectures

– 12 channels of DDR5 memory per CPU

– Support for up to DDR5-6400 MT/s

– Boost frequencies reaching up to 5GHz

– AVX-512 with a full 512b data path

– Trusted I/O for confidential computing, with FIPS certification in progress for all components in the series

The launch of the 5th Gen AMD EPYC processors reinforces AMD’s commitment to innovation and excellence in server technology, meeting the evolving needs of enterprises and cloud providers worldwide.