Performance Index

ID Date Classification
615781 11/27/2024 Public
Document Table of Contents

5th Generation Intel® Xeon® Scalable Processors

Performance varies by use, configuration and other factors.

Performance results are based on testing as of dates shown in configurations and may not reflect all publicly available updates. See configuration disclosure for details. No product or component can be absolutely secure.

Availability of accelerators varies depending on SKU. Visit the Intel Product Specifications page for additional product details.

Intel optimizations, for Intel compilers or other products, may not optimize to the same degree for non-Intel products.

Estimates of SPECrate®2017_​int_​base and SPECrate®2017_​fp_​base based on Intel internal measurements. SPEC®, SPECrate® and SPEC CPU® are registered trademarks of the Standard Performance Evaluation Corporation. See www.spec.org for more information.

Claim Processor Family System Configuration Measurement Measurement Period
[H15] Up to 3.5x More genomes/node/day vs. 5 years ago 5th Gen Xeon 3.5x = 4 genomes/node/day in 2018 on 1st Gen Xeon vs 13.9 genomes/node/day in 2023 on 5th Gen Xeon 5th Generation Intel® Xeon® Scalable Processor Configuration Test by Intel as of 11/07/23 Single-node (compute and front-end node combined) 1-node, 2x INTEL(R) XEON(R) PLATINUM 8568Y+, 48 cores, HT On, Turbo On, NUMA 4, Total Memory 512GB (16x32GB DDR5 5600 MT/s [5600 MT/s]), BIOS 3B05.TEL4P1, microcode 0x21000161, 2x Ethernet Controller X710 for 10GBASE-T, 1x 894.3G INTEL SSDSC2KG96, 1x 1.8T SAMSUNG MZQL21T9HCJR-00A07, 3x 3.5T SAMSUNG MZQL23T8HCLS-00A07, Red Hat Enterprise Linux 8.8, 4.18.0-477.27.1.el8_​8.x86_​64, gatk-4.4.0.0,samtools-1.18,VerifyBamID-2.0.1,bwa-0.7.17,picard 3.1.0, java-17-openjdk , Cromwell 84,slurm 20.11.9 4th Generation Intel® Xeon® Scalable Processor Configuration Test by Intel as of 11/07/23 Single-node (compute and front-end node combined) 1-node, 2x Intel(R) Xeon(R) Platinum 8460Y+, 40 cores, HT On, Turbo On, NUMA 2, Total Memory 512GB (16x32GB DDR5 4800 MT/s [4800 MT/s]), BIOS 3A16.TEL0P1, microcode 0x2b0004b1, 2x Ethernet Controller X710 for 10GBASE-T, 1x Ethernet interface, 1x 1.5T INTEL SSDPE2KE016T8, 2x 7T SAMSUNG MZQL27T6HBLA-00A07, 1x 894.3G INTEL SSDSC2KG96, Red Hat Enterprise Linux 8.8, 4.18.0-477.27.1.el8_​8.x86_​64, gatk-4.4.0.0,samtools-1.18,VerifyBamID-2.0.1,bwa-0.7.17,picard 3.1.0, java-17-openjdk , Cromwell 84,slurm 20.11.9 3rd Generation Intel® Xeon® Scalable Processor Configuration: Test by Intel as of August 8, 2021. One front-end node and four compute nodes, all using Intel® Server Board M50CYP2SB-003. 1x front-end configuration: 2x Intel® Xeon® Gold 6348 processor (28 cores, 2.60 GHz); Intel® Hyper-Threading Technology = ON, Intel® Turbo Boost Technology = ON, total memory 256 GB (16 slots/16 GB/3200 MHz); BIOS version: 22D08; BMC 2.66, SDR 0.31, CPLD 3p0; Microcode: 0x0b000280; CentOS Linux installation ISO (minimal or full) 8 build 2011; storage - boot drive 1x Intel® SSD P4610 1.6 TB (3D NAND PCIe 3.1 x4, 3D1, TLC); high-performance network: 1x Intel® Ethernet Converged Network Adapter X550-T2 (10 GbE), model X550T2. 4x compute nodes configuration: 2x Intel® Xeon® Gold 6348 processor (28 cores, 2.60 GHz); Intel Hyper-Threading Technology = ON, Intel Turbo Boost Technology = ON, total memory 512 GB (16 slots/32 GB/3200 MHz); BIOS version: 22D08; BMC 2.66, SDR 0.31, CPLD 3p0; Microcode: 0x0b000280; CentOS Linux installation ISO (minimal or full) 8 build 2011; storage - scratch drive: 1x Intel SSD P4610 1.6 TB (3D NAND PCIe 3.1 x4, 3D1, TLC); high-performance network: 1x Intel Ethernet Converged Network Adapter X550-T2 (10 GbE), model X550T2. 2nd Generation Intel® Xeon® Scalable Processor Configuration: Test by Intel as of November 14, 2019. One front-end node and four compute nodes, all using Intel® Server Board S2600WFT. Front-end node configuration: 2x Intel® Xeon® Gold 6252 processor (24 cores, 2.10 GHz); total memory 64 GB (4 slots/16 GB/2933 MHz); 1x 960 GB Intel® SSD D3-S4510 Series (2.5 in SATA 6 Gb/s, 3D2,TLC); 1x 1.6 TB Intel® SSD DC P4610 Series (2.5 in PCIe 3.1 x4, 3D2, TLC); Microcode: 0x500002c, BIOS: SE5C620.86B.02.01.0009.092820190230; CentOS Linux Installation ISO (minimal or full) 7.7 build 1910; Intel® oneAPI Runtimes 2019.4; Intel® Cluster Checker 2019.3.5; Intel® Select HPC Solution for RPM packages for EL7 2018.0; OpenHPC 1.3.8. 4x compute nodes configuration: 2x Intel® Xeon® Gold 6252 processor (24 cores, 2.10 GHz); total memory 384 GB (12 slots/32 GB/2933 MHz); 1x 960 GB Intel SSD D3-S4510 Series (2.5 in SATA 6 Gb/s, 3D2, TLC); 1x 1.6 TB Intel SSD DC P4610 Series (2.5 in PCIe 3.1 x4, 3D2, TLC); Network devices: 1x Intel® C620 Series Chipset Ethernet Connection; Intel® Ethernet Adapter X722 onboard 10 GbE; Microcode: 0x500002c, BIOS: SE5C620.86B.02.01.0009.092820190230; CentOS Linux Installation ISO (minimal or full) 7.7 build 1910; 1x distributed 10 GB Lustre 2.10 ZFS system, 6 OST, 3 OSS, Lnet Router with single 10 GB link for all I/O traffic clients to Lustre servers. 1st Generation Intel® Xeon® Scalable Processor Configuration: Test by Intel as of October 15, 2018. Single-node (compute and front-end node combined) configuration: 2x Intel® Xeon® Gold 6152 processor (22 cores, 2.10 GHz); Intel® Server Board S2600WFT; total memory 192 GB (12 slots/16 GB/2666 MHz); boot storage: 2x 480 GB Intel® SSD DC S3520 Series; cache storage: 4x 4 TB Intel® SSD DC P4600 Series PCIe HHHL; capacity storage: 16 TB of 4x 4 TB Intel® SSD DC P4510 Series; Intel Hyper-Threading Technology = ON, Intel Turbo Boost Technology = ON; Microcode: 0x043; CentOS Linux installation 7.6. GATK - Genomes per node per day 2023
[H16] 13.9 Genomes /Node/Day & 30% Higher genomes per day - 5 th Gen vs 4 th Gen 5th Gen Xeon 5th Generation Intel® Xeon® Scalable Processor Configuration Test by Intel as of 11/07/23 Single-node (compute and front-end node combined) 1-node, 2x INTEL(R) XEON(R) PLATINUM 8568Y+, 48 cores, HT On, Turbo On, NUMA 4, Total Memory 512GB (16x32GB DDR5 5600 MT/s [5600 MT/s]), BIOS 3B05.TEL4P1, microcode 0x21000161, 2x Ethernet Controller X710 for 10GBASE-T, 1x 894.3G INTEL SSDSC2KG96, 1x 1.8T SAMSUNG MZQL21T9HCJR-00A07, 3x 3.5T SAMSUNG MZQL23T8HCLS-00A07, Red Hat Enterprise Linux 8.8, 4.18.0-477.27.1.el8_​8.x86_​64, gatk-4.4.0.0,samtools-1.18,VerifyBamID-2.0.1,bwa-0.7.17,picard 3.1.0, java-17-openjdk , Cromwell 84,slurm 20.11.9 4th Generation Intel® Xeon® Scalable Processor Configuration Test by Intel as of 11/07/23 Single-node (compute and front-end node combined) 1-node, 2x Intel(R) Xeon(R) Platinum 8460Y+, 40 cores, HT On, Turbo On, NUMA 2, Total Memory 512GB (16x32GB DDR5 4800 MT/s [4800 MT/s]), BIOS 3A16.TEL0P1, microcode 0x2b0004b1, 2x Ethernet Controller X710 for 10GBASE-T, 1x Ethernet interface, 1x 1.5T INTEL SSDPE2KE016T8, 2x 7T SAMSUNG MZQL27T6HBLA-00A07, 1x 894.3G INTEL SSDSC2KG96, Red Hat Enterprise Linux 8.8, 4.18.0-477.27.1.el8_​8.x86_​64, gatk-4.4.0.0,samtools-1.18,VerifyBamID-2.0.1,bwa-0.7.17,picard 3.1.0, java-17-openjdk , Cromwell 84,slurm 20.11.9 3rd Generation Intel® Xeon® Scalable Processor Configuration: Test by Intel as of August 8, 2021. One front-end node and four compute nodes, all using Intel® Server Board M50CYP2SB-003. 1x front-end configuration: 2x Intel® Xeon® Gold 6348 processor (28 cores, 2.60 GHz); Intel® Hyper-Threading Technology = ON, Intel® Turbo Boost Technology = ON, total memory 256 GB (16 slots/16 GB/3200 MHz); BIOS version: 22D08; BMC 2.66, SDR 0.31, CPLD 3p0; Microcode: 0x0b000280; CentOS Linux installation ISO (minimal or full) 8 build 2011; storage - boot drive 1x Intel® SSD P4610 1.6 TB (3D NAND PCIe 3.1 x4, 3D1, TLC); high-performance network: 1x Intel® Ethernet Converged Network Adapter X550-T2 (10 GbE), model X550T2. 4x compute nodes configuration: 2x Intel® Xeon® Gold 6348 processor (28 cores, 2.60 GHz); Intel Hyper-Threading Technology = ON, Intel Turbo Boost Technology = ON, total memory 512 GB (16 slots/32 GB/3200 MHz); BIOS version: 22D08; BMC 2.66, SDR 0.31, CPLD 3p0; Microcode: 0x0b000280; CentOS Linux installation ISO (minimal or full) 8 build 2011; storage - scratch drive: 1x Intel SSD P4610 1.6 TB (3D NAND PCIe 3.1 x4, 3D1, TLC); high-performance network: 1x Intel Ethernet Converged Network Adapter X550-T2 (10 GbE), model X550T2. 2nd Generation Intel® Xeon® Scalable Processor Configuration: Test by Intel as of November 14, 2019. One front-end node and four compute nodes, all using Intel® Server Board S2600WFT. Front-end node configuration: 2x Intel® Xeon® Gold 6252 processor (24 cores, 2.10 GHz); total memory 64 GB (4 slots/16 GB/2933 MHz); 1x 960 GB Intel® SSD D3-S4510 Series (2.5 in SATA 6 Gb/s, 3D2,TLC); 1x 1.6 TB Intel® SSD DC P4610 Series (2.5 in PCIe 3.1 x4, 3D2, TLC); Microcode: 0x500002c, BIOS: SE5C620.86B.02.01.0009.092820190230; CentOS Linux Installation ISO (minimal or full) 7.7 build 1910; Intel® oneAPI Runtimes 2019.4; Intel® Cluster Checker 2019.3.5; Intel® Select HPC Solution for RPM packages for EL7 2018.0; OpenHPC 1.3.8. 4x compute nodes configuration: 2x Intel® Xeon® Gold 6252 processor (24 cores, 2.10 GHz); total memory 384 GB (12 slots/32 GB/2933 MHz); 1x 960 GB Intel SSD D3-S4510 Series (2.5 in SATA 6 Gb/s, 3D2, TLC); 1x 1.6 TB Intel SSD DC P4610 Series (2.5 in PCIe 3.1 x4, 3D2, TLC); Network devices: 1x Intel® C620 Series Chipset Ethernet Connection; Intel® Ethernet Adapter X722 onboard 10 GbE; Microcode: 0x500002c, BIOS: SE5C620.86B.02.01.0009.092820190230; CentOS Linux Installation ISO (minimal or full) 7.7 build 1910; 1x distributed 10 GB Lustre 2.10 ZFS system, 6 OST, 3 OSS, Lnet Router with single 10 GB link for all I/O traffic clients to Lustre servers. 1st Generation Intel® Xeon® Scalable Processor Configuration: Test by Intel as of October 15, 2018. Single-node (compute and front-end node combined) configuration: 2x Intel® Xeon® Gold 6152 processor (22 cores, 2.10 GHz); Intel® Server Board S2600WFT; total memory 192 GB (12 slots/16 GB/2666 MHz); boot storage: 2x 480 GB Intel® SSD DC S3520 Series; cache storage: 4x 4 TB Intel® SSD DC P4600 Series PCIe HHHL; capacity storage: 16 TB of 4x 4 TB Intel® SSD DC P4510 Series; Intel Hyper-Threading Technology = ON, Intel Turbo Boost Technology = ON; Microcode: 0x043; CentOS Linux installation 7.6. GATK - Genomes per node per day 2023
[H17] 17% Lower Cost per Genome - 5 th Gen vs 4 th Gen 5th Gen Xeon Internal Calculations - Server costs are 1) using 8480+ @ $36,000 per node | 2) using 8592+ @ $38,000 per node Cost per Genome 2023
[ P14] Riskfuel - Exceeding the throughput with 5th Gen Xeon vs Nvidia A100 at batch sizes < 1000 (Chart) 4th and 5th Gen Xeon Processors Nvidia A100: Test by Riskfuel. 1 x HGX A100 1x AMD EPYC 7742 4th Gen Xeon Scalable Processor: Test by Intel as of Nov, 2023. 2x Intel(R) Xeon(R) Platinum 8480+ CPU @ 2.00GHz, 56 cores/socket, 2 sockets, HT On, Turbo On, Total Memory 512 GB (16 slots/ 32 GB/ DDR5 4800 M Hz [run @ 4800 MHz] ), Inspur, NF5280-M7-A0-R0-00, 05.08.01, 0x2b000461, Red Hat Enterprise Linux release 8.8 (Ootpa)​, Kernel 4.18.0-477.21.1.el8_​8.x86_​64​ ​, Python: 3.10.13, OpenVINO: 2023.1.0 Workload:Riskfuel Model Inference, BF16, Batch Size: 1, 10, 50, 100, 1000, 2000, 3000, 4000, 5000, 6000, 7000, 8000, 9000, 10000, 11000, 12000, 13000, 14000, 15000, 16000, 17000, 18000, 19000, 20000, 80000 5th Gen Xeon Scalable Processor: Test by Intel as of Nov, 2023. 2x Intel(R) Xeon(R) Platinum 8592Y+ CPU @ 2.00GHz, 64 cores/socket, 2 sockets, HT On, Turbo On, Total Memory 512 GB (16 slots/ 32 GB/ DDR5 5600 M Hz [run @ 5600 MHz] ), Quanta Cloud Technology Inc., QuantaGrid D54Q-2U, 3B05.TEL4P1, 0x21000161, Red Hat Enterprise Linux release 8.8 (Ootpa)​, Kernel 4.18.0-477.21.1.el8_​8.x86_​64​, Python: 3.10.13, OpenVINO: 2023.1.0 Workload:Riskfuel Model Inference, BF16, Batch Size: 1, 10, 50, 100, 1000, 2000, 3000, 4000, 5000, 6000, 7000, 8000, 9000, 10000, 11000, 12000, 13000, 14000, 15000, 16000, 17000, 18000, 19000, 20000, 80000 Riskfuel Model Inference Throughput November 2023
[ P15] 13X throughput increase in valuations/sec with Riskfuel vs no Riskfuel 4th and 5th Gen Xeon Processors Source: Riskfuel Analysis Riskfuel Model - Valuations per Second November 2023
[ P16] Up to 28% more valuations/sec by moving from 4th Gen to 5th Gen Xeon 4th and 5th Gen Xeon Processors

Source: Riskfuel & Intel Analysis

4th Gen Xeon Scalable Processor: Test by Intel as of Nov, 2023. 2x Intel(R) Xeon(R) Platinum 8480+ CPU @ 2.00GHz, 56 cores/socket, 2 sockets, HT On, Turbo On, Total Memory 512 GB (16 slots/ 32 GB/ DDR5 4800 M Hz [run @ 4800 MHz] ), Inspur, NF5280-M7-A0-R0-00, 05.08.01, 0x2b000461, Red Hat Enterprise Linux release 8.8 (Ootpa)​, Kernel 4.18.0-477.21.1.el8_​8.x86_​64​ ​, Python: 3.10.13, OpenVINO: 2023.1.0 Workload:Riskfuel Model Inference, BF16, Batch Size: 1, 10, 50, 100, 1000, 2000, 3000, 4000, 5000, 6000, 7000, 8000, 9000, 10000, 11000, 12000, 13000, 14000, 15000, 16000, 17000, 18000, 19000, 20000, 80000

5th Gen Xeon Scalable Processor: Test by Intel as of Nov, 2023. 2x Intel(R) Xeon(R) Platinum 8592Y+ CPU @ 1.9GHz, 64 cores/socket, 2 sockets, HT On, Turbo On, Total Memory 512 GB (16 slots/ 32 GB/ DDR5 5600 M Hz [run @ 5600 MHz] ), Quanta Cloud Technology Inc., QuantaGrid D54Q-2U, 3B05.TEL4P1, 0x21000161, Red Hat Enterprise Linux release 8.8 (Ootpa)​, Kernel 4.18.0-477.21.1.el8_​8.x86_​64​, Python: 3.10.13, OpenVINO: 2023.1.0 Workload:Riskfuel Model Inference, BF16, Batch Size: 1, 10, 50, 100, 1000, 2000, 3000, 4000, 5000, 6000, 7000, 8000, 9000, 10000, 11000, 12000, 13000, 14000, 15000, 16000, 17000, 18000, 19000, 20000, 80000

Riskfuel Model - Valuations per Second November 2023
[A1] Sub 50ms second token latency with 5th Gen Intel Xeon Platinum 8592+ on GPT-j use cases (INT8)

Sub 100ms second token latency with 5th Gen Intel Xeon Platinum 8592+ on GPT-j use cases (BF16)

Up to 1.11x performance speedup and 1.18x higher performance/watt with 5th Gen Intel Xeon Scalable processor vs 4th Gen Intel Xeon on GPT-J first token latency (bfloat16)

Up to 1.17x performance speedup and 1.24x higher performance/watt with 5th Gen Intel Xeon Scalable processor vs 4th Gen Intel Xeon on GPT-J second token latency (bfloat16)

Up to 1.13x performance speedup and 1.20x higher performance/watt with 5th Gen Intel Xeon Scalable processor vs 4th Gen Intel Xeon on GPT-J first token latency (int8)

Up to 1.22x performance speedup and 1.30x higher performance/watt with 5th Gen Intel Xeon Scalable processor vs 4th Gen Intel Xeon on GPT-J second token latency (int8)

Up to 2.3x performance speedup and 1.81x higher performance/watt with 5th Gen Intel Xeon Scalable processor vs 3rd Gen Intel Xeon on GPT-J first token latency (int8)

Up to 1.64x performance speedup and 1.30x higher performance/watt with 5th Gen Intel Xeon Scalable processor vs 3rd Gen Intel Xeon on GPT-J second token latency (int8)

5th Generation Intel® Xeon® Platinum processor Geomean of Chat bot (256/1024), Context Creation Marketing (128/2048), Misc (Emails, reports, SQL) / Coding generation (32/512), Search (32/256), Text classification (256/32), Text Generation (128/128)

8592+: 1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores, HT On, Turbo On, NUMA 2, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 2.0, microcode 0x21000161, 2x Ethernet Controller 10-Gigabit X540-AT2, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 5.15.0-83-generic, GPT-J 6B, gcc=12.3, python 3.9intel-extension-for-pytorch 2.2.0+git305fc52torch 2.2.0.dev20230914+cputransformers 4.31.0protobuf 3.20.3neural-compressor 2.2, Test on 1 socket, BS1 CPI 64. Test by Intel as of 09/21/23.

8480+: 1-node, 2x Intel(R) Xeon(R) Platinum 8480+, 56 cores, HT On, Turbo On, NUMA 2, Total Memory 1024GB (16x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 2.0, microcode 0x2b0004d0, 2x Ethernet Controller X710 for 10GBASE-T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 5.15.0-83-generic, GPT-J 6B, gcc=12.3, python 3.9intel-extension-for-pytorch 2.2.0+git305fc52torch 2.2.0.dev20230914+cputransformers 4.31.0protobuf 3.20.3neural-compressor 2.2, Test on 1 socket, BS1 CPI 56. Test by Intel as of 09/27/23.

8380: 1-node, 2x Intel(R) Xeon(R) Platinum 8380 CPU @ 2.30GHz, 40 cores, HT On, Turbo On, NUMA 2, Total Memory 1024GB (16x64GB DDR4 3200 MT/s [3200 MT/s]), BIOS 1.5, microcode 0xd0003a5, 2x Ethernet Controller 10-Gigabit X540-AT2, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 5.15.0-83-generic, GPT-J 6B, gcc=12.3, python 3.9intel-extension-for-pytorch 2.2.0+git305fc52torch 2.2.0.dev20230914+cputransformers 4.31.0protobuf 3.20.3neural-compressor 2.2, Test on 1 socket, BS1 CPI 40. Test by Intel as of 09/26/23.

GPT-J Test by Intel September 21, 2023, September 27, 2023, September 26, 2023
[A2] Sub 100ms second token latency with 5th Gen Intel Xeon Platinum 8592+ on Llama2 13B use cases (INT8)

Up to 1.12x performance speedup and 1.17x higher performance/watt with 5th Gen Intel Xeon Scalable processor vs 4th Gen Intel Xeon on Llama 2 13B first token latency (bfloat16)

Up to 1.10x performance speedup and 1.16x higher performance/watt with 5th Gen Intel Xeon Scalable processor vs 4th Gen Intel Xeon on Llama 2 13B second token latency (bfloat16)

Up to 1.05x performance speedup and 1.10x higher performance/watt with 5th Gen Intel Xeon Scalable processor vs 4th Gen Intel Xeon on Llama 2 13B first token latency (int8)

Up to 1.08x performance speedup and 1.14x higher performance/watt with 5th Gen Intel Xeon Scalable processor vs 4th Gen Intel Xeon on Llama 2 13B second token latency (int8)

Up to 2.1x performance speedup and 1.58x higher performance/watt with 5th Gen Intel Xeon Scalable processor vs 3rd Gen Intel Xeon on Llama 2 13B first token latency (int8)

Up to 1.48x performance speedup and 1.11x higher performance/watt with 5th Gen Intel Xeon Scalable processor vs 3rd Gen Intel Xeon on Llama 2 13B second token latency (int8)

5th Generation Intel® Xeon® Platinum processor Geomean of Chat bot (256/1024), Context Creation Marketing (128/2048), Misc (Emails, reports, SQL) / Coding generation (32/512), Search (32/256), Text classification (256/32), Text Generation (128/128)

8592+: 1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores, HT On, Turbo On, NUMA 2, Integrated Accelerators Available [used]: DLB 2 [0], DSA 2 [0], IAX 2 [0], QAT 2 [0], Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 2.0, microcode 0x21000161, 2x Ethernet Controller X710 for 10GBASE-T, 1x Ethernet interface, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.2 LTS, 5.15.0-78-generic, Test by Intel as of 10/10/23.

8480+ 1-node, 2x Intel(R) Xeon(R) Platinum 8480+, 56 cores, HT On, Turbo On, NUMA 2, Integrated Accelerators Available [used]: DLB 5 [0], DSA 5 [0], IAX 5 [0], QAT 5 [0], Total Memory 1024GB (16x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 1.3, microcode 0x2b0004b1, 2x Ethernet Controller X710 for 10GBASE-T, 1x Ethernet interface, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.2 LTS, 5.15.0-78-generic, Test by Intel as of 09/12/23.

8380: 1-node, 2x Intel(R) Xeon(R) Platinum 8380 CPU @ 2.30GHz, 40 cores, HT On, Turbo On, NUMA 2, Integrated Accelerators Available [used]: DLB 0 [0], DSA 0 [0], IAX 0 [0], QAT 0 [0], Total Memory 1024GB (16x64GB DDR4 3200 MT/s [3200 MT/s]), BIOS 1.5, microcode 0xd0003a5, 2x Ethernet Controller 10-Gigabit X540-AT2, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.2 LTS, 5.15.0-78-generic, Test by Intel as of 10/10/23. Llama2, gcc=12.3 gxx=12.3, python 3.9, intel-extension-for-pytorch 2.2.0+,git305fc52, torch 2.2.0.dev20230914+cpu, transformers 4.31.0, protobuf 3.20.3, neural-compressor 2.2, test on 1 socket, Batch Size(BS)=1, Corest per instance (CPI)=#cores/socket, search algorithm: BEAM4.

LLAMA Test by Intel October 10, 2023, September 12, 2023

[A5] Up to 1.18x faster batch DLSA Bert-Large Finetuning for IMDB dataset with 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. prior generation with AMX BF16

Up to 3x faster batch DLSA Bert-Large Finetuning for IMDB dataset with 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 compared to FP32

Up to 1.25x faster batch DLSA Bert-Large Finetuning for SST2 dataset with 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. prior generation with AMX BF16

Up to 3.4x faster batch DLSA Bert-Large Finetuning for SST2 dataset with 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 compared to FP32

5th Generation Intel® Xeon® Platinum processor IMDB Dataset -

8592+: 1-node, 2x Intel(R) Xeon(R) Platinum 8592+, 64 cores, HT On, Turbo On, NUMA 2, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 3B05.TEL4P1, microcode 0x21000161, 2x Ethernet Controller X710 for 10GBASE-T, 1x 1.8T SAMSUNG MZQL21T9HCJR-00A07, CentOS Stream 8, 5.18.14, Framework /Toolkit incl version -Torch 2.0.1+cpu, Transformers 4.35.0,IPEX 2.0.100,Oneccl 2.0.100,Test by Intel as of 10/05/23.

8480+: 1-node, 2x Intel(R) Xeon(R) Platinum 8480+, 56 cores, HT On, Turbo On, Total Memory 1024GB (16x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS EGSDCRB1.SYS.0102.D37.2305081420, microcode 0x2b0004b1, 1x Ethernet Controller I225-LM, 1x 894.3G INTEL SSDSC2KG96, 1x 7.2G Cruzer Blade, 2x 3.7T INTEL SSDPE2KX040T8, CentOS Stream 8, 5.15.0-spr.bkc.pc.16.4.24.x86_​64, Framework /Toolkit incl version -Torch 2.0.1+cpu, Transformers 4.35.0,IPEX 2.0.100,Oneccl 2.0.100,Test by Intel as of 10/09/23

SST2 Dataset -

8592+: 1-node, 2x Intel(R) Xeon(R) Platinum 8592+, 64 cores, HT On, Turbo On, NUMA 2, Integrated Accelerators Available [used]: DLB 2 [0], DSA 2 [0], IAA 2 [0], QAT 2 [0], Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 3B05.TEL4P1, microcode 0x21000161, 2x Ethernet Controller X710 for 10GBASE-T, 1x 1.8T SAMSUNG MZQL21T9HCJR-00A07, CentOS Stream 8, 5.18.14, Framework /Toolkit incl version -Torch 2.0.1+cpu, Transformers 4.35.0,IPEX 2.0.100,Oneccl 2.0.100,Test by Intel as of 10/05/23.

8480+: 1-node, 2x Intel(R) Xeon(R) Platinum 8480+, 56 cores, HT On, Turbo On, Total Memory 1024GB (16x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS EGSDCRB1.SYS.0102.D37.2305081420, microcode 0x2b0004b1, 1x Ethernet Controller I225-LM, 1x 894.3G INTEL SSDSC2KG96, 1x 7.2G Cruzer Blade, 2x 3.7T INTEL SSDPE2KX040T8, CentOS Stream 8, 5.15.0-spr.bkc.pc.16.4.24.x86_​64, Framework /Toolkit incl version -Torch 2.0.1+cpu, Transformers 4.35.0,IPEX 2.0.100,Oneccl 2.0.100,,Test by Intel as of 10/09/23

E2E DLSA Bert-Large Fine Tuning Test by Intel October 5, 2023, October 9, 2023
[A6] Up to 1.14x faster batch Vision Transfer Learning for Colorectal Dataset with 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. prior generation with AMX BF16

Up to 1.71x faster batch Vision Transfer Learning for Colorectal Dataset with 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 compared to FP32

5th Generation Intel® Xeon® Platinum processor 8592+: 1-node, 2x (1x used) Intel(R) Xeon(R) Platinum 8592+, 64 cores, HT On, Turbo On, NUMA 2, Integrated Accelerators Available [used]: Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 3B05.TEL4P1, microcode 0x21000161, 2x Ethernet Controller X710 for 10GBASE-T, 1x 1.8T SAMSUNG MZQL21T9HCJR-00A07, CentOS Stream 8, 5.18.14, Resnet 50 v1.5 , Intel Tensorflow AV512 2.14, Test by Intel as of 10/05/2023.

8480+: 1-node, 2x (1x used) Intel(R) Xeon(R) Platinum 8480+, 56 cores, HT On, Turbo On, Total Memory 1024GB (16x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS EGSDCRB1.SYS.0102.D37.2305081420, microcode 0x2b0004b1, 1x Ethernet Controller I225-LM, 1x 894.3G INTEL SSDSC2KG96, 1x 7.2G Cruzer Blade, 2x 3.7T INTEL SSDPE2KX040T8, CentOS Stream 8, 5.15.0-spr.bkc.pc.16.4.24.x86_​64, Resnet 50 v1.5 , Intel Tensorflow AV512 2.14, Test by Intel as of 10/09/2023

E2E Vision Transfer Learning for Colorectal Dataset Test by Intel October 5, 2023, October 9, 2023
[A7] Up to 1.12x higher end-to-end recommendation Speedup with 5th Gen Intel® Xeon® Scalable processor compared with prior generation on Deep Interest Evolution Network (DIEN) Recommendation System 5th Generation Intel® Xeon® Platinum processor 8592+: 1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores, HT On, Turbo On, NUMA 2, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 3B05.TEL4P1, microcode 0x21000161, 2x Ethernet Controller X710 for 10GBASE-T, 1x 1.8T SAMSUNG MZQL21T9HCJR-00A07, CentOS Stream 8, 5.18.14, Spark 3.5.0, Intel Tensor-flow nightly 2.14 ww34,Python 3.10.12,Pyspark 3.5.0, export KMP_​BLOCKTIME=1,export KMP_​SETTINGS=1,granularity=fine,verbose,compact,1,0.Test by intel as of 10/10/23.

8480+: 1-node, 2x Intel(R) Xeon(R) Platinum 8480+, 56 cores, HT On, Turbo On, NUMA 2, Total Memory 1024GB (16x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS EGSDCRB1.SYS.0102.D37.2305081420, microcode 0x2b0004b1, 1x Ethernet Controller I225-LM, 1x 894.3G INTEL SSDSC2KG96, 1x 7.2G Cruzer Blade, 2x 3.7T INTEL SSDPE2KX040T8, CentOS Stream 8, 5.15.0-spr.bkc.pc.16.4.24.x86_​64, Spark 3.5.0, Intel Tensor-flow nightly 2.14 ww34,Python 3.10.12,Pyspark 3.5.0, export KMP_​BLOCKTIME=1,export KMP_​SETTINGS=1,granularity=fine,verbose,compact,1,0. Test by Intel as of 10/10/23.

E2E DIEN Recommendation System Test by Intel October 10, 2023
[A8] Up to 1.39x faster end-to-end Census workload performance using 5th Gen Intel Xeon Scalable processor compared to prior generation(FP32) 5th Generation Intel® Xeon® Platinum processor 8592+: 1 node, 2x Intel(R) Xeon(R) Platinum 8592+, 64 cores, HT Off, Turbo On, NUMA 2, 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 3B05.TEL4P1, microcode 0x21000161, CentOS Stream 8,kernel 5.18.14, 2x Ethernet Controller X710 for 10GBASE-T, 1x 1.8T SAMSUNG MZQL21T9HCJR-00A07, E2E Census, XGBoost 1.7.6, Ridge Regression, Pandas 2.1.1, Modin 0.24.1, Scikit-Learn 1.3.1/2023.2.1 Numpy 1.26.0, FP32. Test by Intel on 10/12/2023,

8480+ : 1-node, 2x Intel® Xeon® Platinum 8480+, 56 cores, HT On, Turbo Off, Total Memory 1024 GB (16 slots/ 64 GB/ 4800 MHz [run @ 4800 MHz] ), EGSDCRB1.SYS.0102.D37.2305081420, 0x2b0004b1, CentOS 8 Stream, 5.15.0-spr.bkc.pc.16.4.24.x86_​64, 1x Ethernet Controller I225-LM, 1x 894.3G INTEL SSDSC2KG96, 1x 7.2G Cruzer Blade, 2x 3.7T INTEL SSDPE2KX040T8, E2E Census, XGBoost 1.7.6, Ridge Regression, Pandas 2.1.1, Modin 0.24.1, Scikit-Learn 1.3.1/2023.2.1 Numpy 1.26.0, FP32. Test by Intel on 10/12/2023.

E2E Census Test by Intel October 12, 2023
[A9] Up to 1.25x faster GPT-J (6B parameters) fine-tuning using GLUE MNLI dataset on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. prior generation with AMX BF16 5th Generation Intel® Xeon® Platinum processor 8592+: 1 node, 2x Intel(R) Xeon(R) Platinum 8592+, 64 cores, HT On, Turbo On, NUMA 2, 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s])800 MT/s]), BIOS 3B05.TEL4P1, 0x21000161, CentOS Stream 8,kernel 5.18.14, 2x Ethernet Controller X710 for 10GBASE-T, 1x 1.8T SAMSUNG MZQL21T9HCJR-00A07, PyTorch 2.0.1, IPEX 2.0.1, Transformers 4.31.0, Datasets 2.14.0, Peft 0.4.0, Evaluate 0.4.0 ​​Test by Intel on 10/26/2023.

8480+: -1 node, 2x Intel® Xeon® Platinum 8480+, 56 cores, HT On, Turbo On, Total Memory 1024GB (16x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 3A16.TEL0P1​, 0x2b0004b1, CentOS 8 Stream5.18.14, 2x Ethernet Controller X550, 1x 1.8T SAMSUNG MZWLR1T9HBJR-00007, PyTorch 2.0.1, IPEX 2.0.1, Transformers 4.31.0, Datasets 2.14.0, Peft 0.4.0, Evaluate 0.4.0​, Test by Intel as of 10/26/2023

GPT-J(6B) Fine Tuning Test by Intel October 26,2023
[A10] Up to 1.22x faster BioGPT fine-tuning using GLUE MNLI dataset on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. prior generation with AMX BF16 5th Generation Intel® Xeon® Platinum processor 8592+: 1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores, HT On, Turbo On, NUMA 4, Integrated Accelerators Available [used]: DLB 2 [0], DSA 2 [0], IAA 2 [0], QAT 2 [0], Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS EGSDCRB1.SYS.0105.D74.2308261933, microcode 0x21000161, 1x Ethernet Controller I225-LM, 1x 3.6T INTEL SSDPE2KX040T8, 1x 931.5G INTEL, CentOS Stream 9, 6.2.0-emr.bkc.6.2.3.6.31.x86_​64. TensorFlow TF: 2.14.0202334, OneDNN: v3.2 PyTorch: torch:2.1.0.dev20230825+cpu, IPEX 2.1.0, PEFT 0.5.0, BF16, Test by INTEL as of Mon Oct 30 03:12:16 AM UTC 2023.

8480+: 1-node, 2x Intel(R) Xeon(R) Platinum 8480+, 56 cores, HT On, Turbo On, NUMA 2, Integrated Accelerators Available [used]: DLB 2 [0], DSA 2 [0], IAA 2 [0], QAT 2 [0], Total Memory 1024GB (16x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS EGSDCRB1.SYS.0102.D37.2305081420, microcode 0x2b0004b1, 1x Ethernet Controller I225-LM, 1x 7.2G Cruzer Blade, 2x 3.7T INTEL SSDPE2KX040T8, 1x 894.3G INTEL SSDSC2KG96, CentOS Stream 8, 5.15.0-spr.bkc.pc.16.4.24.x86_​64. TensorFlow TF: 2.14.0202334, OneDNN: v3.2 PyTorch: torch:2.1.0.dev20230825+cpu, IPEX 2.0.100, PEFT 0.3.0, BF16, Test by INTEL as of Tue Sep 5 08:04:39 UTC 2023

BioGPT Fine Tuning Test by Intel October 30 ,2023, September 5, 2023
[A15] 1.1x to 1.29x higher PyTorch Training performance on 5th Gen Intel Xeon Scalable processor with built in Intel AMX BF16 vs. prior generation (AMX BF16) 1.2x higher average* PyTorch Training performance on 5th Gen Intel Xeon Scalable processor with built in Intel AMX BF16 vs. prior generation (AMX BF16)

4.4x to 14.2x higher PyTorch Training performance on 5th Gen Intel Xeon Scalable processor with built in Intel AMX BF16 vs. 3rd Gen Intel Xeon (FP32) 6.2x higher average* PyTorch Training performance on 5th Gen Intel Xeon Scalable processor with built in Intel AMX BF16 vs. 3rd Gen Intel Xeon (FP32)

Up to 1.24x higher BERT-large training performance on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. prior generation with AMX BF16

Up to 5.17x higher BERT-large training performance on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. 3rd Gen Intel Xeon Platinum 8380 [fp32]

Up to 1.1x higher DLRM training performance on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. prior generation with AMX BF16

Up to 4.4x higher DLRM training performance on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. 3rd Gen Intel Xeon Platinum 8380 [fp32] Up to 1.29x higher MaskRCNN training performance on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. prior generation with AMX BF16

Up to 6.3x higher MaskRCNN training performance on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. 3rd Gen Intel Xeon Platinum 8380 [fp32]

Up to 1.2x higher ResNet50 v1.5 training performance on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. prior generation with AMX BF16

Up to 4.5x higher ResNet50 v1.5 training performance on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. 3rd Gen Intel Xeon Platinum 8380 [fp32] Up to 1.28x higher RNN-T training performance on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. prior generation with AMX BF16

Up to 14.2x higher RNN-T training performance on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. 3rd Gen Intel Xeon Platinum 8380 [fp32] Up to 1.17x higher SSD-ResNet34 training performance on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. prior generation with AMX BF16

Up to 6.5x higher SSD-ResNet34 training performance on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. 3rd Gen Intel Xeon Platinum 8380 [fp32]

5th Generation Intel® Xeon® Platinum processor 8592+: 1-node, 2x (1x used) Intel(R) Xeon(R) Platinum 8592+, 64 cores, HT On, Turbo On, NUMA 4, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS EGSDCRB1.SYS.0105.D74.2308261933, microcode 0x21000161, 1x Ethernet Controller I225-LM, 1x 3.6T INTEL SSDPE2KX040T8, 1x 931.5G INTEL, CentOS Stream 9, 6.2.0-emr.bkc.6.2.3.6.31.x86_​64. PyTorch: torch:2.1.0.dev20230825+cpu, oneDNN:v3.2.1 IPEX:2.1.0+git31b5ee1, Test by INTEL as of 09/07/2023.

8480+: 1-node, 2x (1x used) Intel(R) Xeon(R) Platinum 8480+, 56 cores, HT On, Turbo On, NUMA 2, Total Memory 1024GB (16x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS EGSDCRB1.SYS.0102.D37.2305081420, microcode 0x2b0004b1, 1x Ethernet Controller I225-LM, 1x 7.2G Cruzer Blade, 2x 3.7T INTEL SSDPE2KX040T8, 1x 894.3G INTEL SSDSC2KG96, CentOS Stream 8, 5.15.0-spr.bkc.pc.16.4.24.x86_​64. PyTorch: torch:2.1.0.dev20230825+cpu oneDNN:v3.2.1 IPEX:2.1.0+git31b5ee1. Test by INTEL as of 09/05/2023.

8380: 1-node, 2x (1x used) Intel(R) Xeon(R) Platinum 8380 CPU @ 2.30GHz, 40 cores, HT On, Turbo On, Total Memory 1024GB (16x64GB DDR4 3200 MT/s [3200 MT/s]), BIOS SE5C620.86B.01.01.0008.2305172341, microcode 0xd0003a5, 2x Ethernet Controller 10G X550T, 3x 894.3G INTEL SSDSC2KG96, 1x 0B vmDisk, 1x 60G Flash Disk, 1x 1024M vmDisk-CD, 1x 3.6T INTEL SSDPE2KX040T8, 1x 931.5G INTEL SSDPE2KX010T8, Ubuntu 22.04 LTS, 5.15.0-78-generic, PyTorch: torch:2.1.0.dev20230825+cpu oneDNN:v3.2.1 IPEX:2.1.0+git31b5ee1. Test by INTEL as of 09/14/23.

BS=x, 1 instance/ numa node [One socket used]. Resnet50 v1.5: ImageNet (224 x224), SSD Resnet34: COCO 2017, BERT-large: Wikipedia 2020/01/01 ( seq len =512), DLRM: Criteo Terabyte Dataset, RNNT: LibriSpeech, Mask RCNN: COCO 2017 *Geomean of ResNet50 v1.5, Bert Large, SSD RN34, RNNT, MaskRCNN ,DLRM (PT:Training)

PT: Training Summary Test by Intel September 7, 2023 September 5, 2023 September 14, 2023
[A16] 1.23x to 1.35x higher performance and 1.2x to 1.42x higher performance/watt on PyTorch Real Time Inference [AMX INT8] with 5th Gen Intel Xeon Scalable processor vs prior generation 1.31x higher average* performance and

1.32x higher average* performance/watt with 5th Gen Intel Xeon Scalable processor vs. 4th Gen Intel Xeon Scalable processor with AMX BF16 on PyTorch Real-Time Inference

8.7x higher average* performance and 9.2x higher average* performance/watt with 5th Gen Intel Xeon Scalable processor with AMX INT8 vs FP32 on PyTorch Real-Time Inference

1.19x to 1.42x higher performance and 1.17x to 1.48x higher performance/watt on PyTorch Real Time Inference [AMX BF16] with 5th Gen Intel Xeon Scalable processor vs prior generation

1.3x higher average* performance and 1.32x higher average* performance/watt with 5th Gen Intel Xeon Scalable processor vs. 4th Gen Intel Xeon Scalable processor with AMX INT8 on PyTorch Real-Time Inference

5.1x higher average* Performance and 5.2x higher average* performance/watt with 5th Gen Intel Xeon Scalable processor with AMX BF16 vs. FP32 on PyTorch Real-Time Inference

2.9x to 6.7 higher performance and 2.3x to 4.8x higher performance/watt on PyTorch Real Time Inference [AMX INT8] with 5th Gen Intel Xeon Scalable processor vs 3rd Gen Intel Xeon Scalable processor

4.1x higher average* performance and 3.1x higher average* performance/watt with 5th Gen Intel Xeon Scalable processor with AMX INT8 vs. 3rd Gen Intel Xeon Scalable processor (VNNI) on PyTorch Real-Time Inference

7x to 14x higher performance and 5.3x to 9.5x higher performance/watt on PyTorch Real Time Inference [AMX BF16] with 5th Gen Intel Xeon Scalable processor vs 3rd Gen Intel Xeon Scalable processor

9x higher average* performance and 6.7x higher average* performance/watt with 5th Gen Intel Xeon Scalable processor with AMX BF16 vs. 3rd Gen Intel Xeon Scalable processor (FP32) on PyTorch Real-Time Inference

5th Generation Intel® Xeon® Platinum processor * Geomean of ResNet50 v1.5, Bert Large, SSD ResNet34, RNNT (BF16 only), Resnext101 32x16d, MaskRCNN (BF16 only), DistilBert. See Configs [A19 - A25]. PT: Real-Time Inference Summary Test by Intel September 7, 2023, September 5, 2023, September 14, 2023
[A17] 1.20x to 1.43x higher performance and 1.18x to 1.42x higher performance/watt on PyTorch Batch Inference [AMX INT8] with 5th Gen Intel Xeon Scalable processor vs prior generation

1.32x higher average* performance and 1.33x higher average* performance/watt with 5th Gen Intel Xeon Scalable processor vs. 4th Gen Intel Xeon Scalable processor with AMX INT8 on AI Batch Inference

11x higher average* performance and 11x higher average* performance/watt with 5th Gen Intel Xeon Scalable processor with AMX INT8 vs. FP32 on AI Batch Inference

1.24x to 1.44x higher performance and 1.31x to 1.48x higher performance/watt on PyTorch Batch Inference [AMX BF16] with 5th Gen Intel Xeon Scalable processor vs prior generation

1.35x higher average* performance and 1.3x higher average* performance/watt with 5th Gen Intel Xeon Scalable processor vs. 4th Gen Intel Xeon Scalable processor with AMX BF16 on AI Batch Inference

5.3x higher average* performance and 5.5x higher average* performance/watt with 5th Gen Intel Xeon Scalable processor with AMX BF16 vs. FP32 on AI Batch Inference

4x to 6.5x higher performance and 3x to 5x higher performance/watt on PyTorch Batch Inference [AMX INT8] with 5th Gen Intel Xeon Scalable processor vs 3rd Gen Intel Xeon Scalable processor

5.3x higher average* performance and 3.9x higher average* performance/watt with 5th Gen Intel Xeon Scalable processor with AMX INT8 vs. 3rd Gen Intel Xeon Scalable processor (VNNI) on PyTorch Batch Inference

7.7x to 13.8x higher performance and 5.8x to 10.3x higher performance/watt on PyTorch Batch Inference [AMX BF16] with 5th Gen Intel Xeon Scalable processor vs 3rd Gen Intel Xeon Scalable processor

9.9x higher average* performance and 7.3x higher average* performance/watt with 5th Gen Intel Xeon Scalable processor with AMX BF16 vs. 3rd Gen Intel Xeon Scalable processor (FP32) on PyTorch Batch Inference

5th Generation Intel® Xeon® Platinum processor Geomean of ResNet50 v1.5, Bert Large, SSD ResNet34, RNNT (BF16 only), Resnext101 32x16d, MaskRCNN (BF16 only), DistilBert, DLRM. See Configs [A18-A25]. PT: Batch Inference Summary Test by Intel September 7, 2023, September 5, 2023, September 14, 2023
[A19] Real Time Inference Performance Up to 1.19x higher real-time Natural Language Processing inference (BERT-large) performance and 1.17x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. prior generation with AMX BF16

Up to 1.23x higher real-time Natural Language Processing inference (BERT-large) performance and 1.20x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX INT8 vs. prior generation with AMX INT8

Up to 5.4x higher real-time Natural Language Processing inference performance (BERT-large) and 5.9x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 compared to FP32 Up to 9.2x higher real-time Natural Language Processing inference performance (BERT-large) and 10.2x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX INT8 compared to FP32

Up to 9.9x higher real-time Natural Language Processing inference (BERT-large) performance and 7.7x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. 3rd gen Intel Xeon processor with FP32

Up to 3.4x higher real-time Natural Language Processing inference (BERT-large) performance and 2.5x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX INT8 vs. 3rd gen Intel Xeon processor with INT8 Batch Inference Performance

Up to 1.38x higher batch Natural Language Processing inference (BERT-large) performance and 1.22x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. prior generation with AMX BF16

Up to 1.2x higher batch Natural Language Processing inference (BERT-large) performance and 1.26x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX INT8 vs. prior generation with AMX INT8

Up to 5.5x higher batch Natural Language Processing inference performance (BERT-large) and 5.3x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 compared to FP32

Up to 9x higher batch Natural Language Processing inference performance (BERT-large) and 9.3x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX INT8 compared to FP32

Up to 10x higher batch Natural Language Processing inference (BERT-large) performance and 7.1x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. 3rd gen Intel Xeon processor with FP32

Up to 4x higher batch Natural Language Processing inference (BERT-large) performance and 3x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX INT8 vs. 3rd gen Intel Xeon processor with INT8

5th Generation Intel® Xeon® Platinum processor 8592+: 1-node, 2x Intel(R) Xeon(R) Platinum 8592+, 64 cores, HT On, Turbo On, NUMA 4, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS EGSDCRB1.SYS.0105.D74.2308261933, microcode 0x21000161, 1x Ethernet Controller I225-LM, 1x 3.6T INTEL SSDPE2KX040T8, 1x 931.5G INTEL, CentOS Stream 9, 6.2.0-emr.bkc.6.2.3.6.31.x86_​64. PyTorch: torch:2.1.0.dev20230825+cpu, oneDNN:v3.2.1 IPEX:2.1.0+git31b5ee1, Test by INTEL as of 09/07/2023. 8480+: 1-node, 2x Intel(R) Xeon(R) Platinum 8480+, 56 cores, HT On, Turbo On, NUMA 2, Total Memory 1024GB (16x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS EGSDCRB1.SYS.0102.D37.2305081420, microcode 0x2b0004b1, 1x Ethernet Controller I225-LM, 1x 7.2G Cruzer Blade, 2x 3.7T INTEL SSDPE2KX040T8, 1x 894.3G INTEL SSDSC2KG96, CentOS Stream 8, 5.15.0-spr.bkc.pc.16.4.24.x86_​64. PyTorch: torch:2.1.0.dev20230825+cpu oneDNN:v3.2.1 IPEX:2.1.0+git31b5ee1. Test by INTEL as of 09/05/2023. 8380: 1-node, 2x Intel(R) Xeon(R) Platinum 8380 CPU @ 2.30GHz, 40 cores, HT On, Turbo On, Total Memory 1024GB (16x64GB DDR4 3200 MT/s [3200 MT/s]), BIOS SE5C620.86B.01.01.0008.2305172341, microcode 0xd0003a5, 2x Ethernet Controller 10G X550T, 3x 894.3G INTEL SSDSC2KG96, 1x 0B vmDisk, 1x 60G Flash Disk, 1x 1024M vmDisk-CD, 1x 3.6T INTEL SSDPE2KX040T8, 1x 931.5G INTEL SSDPE2KX010T8, Ubuntu 22.04 LTS, 5.15.0-78-generic, PyTorch: torch:2.1.0.dev20230825+cpu oneDNN:v3.2.1 IPEX:2.1.0+git31b5ee1. Test by INTEL as of 09/14/23. Bert-Large​, BS=1 (real-time): 4cores/instance​, BS=x (batch): 1 instance/ numa node PT: BERT-Large Test by Intel September 7, 2023, September 5, 2023, September 14, 2023
[A20] Batch Inference Performance

Up to 1.24x higher batch Recommendation System inference performance (DLRM) and 1.24x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. prior generation with prior generation with AMX BF16

Up to 1.24x higher batch Recommendation System inference performance (DLRM) and 1.18x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX INT8 vs. prior generation with prior generation with AMX INT8

Up to 4.8x higher batch Recommendation System inference performance (DLRM) and 4.8x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 compared to FP32

Up to 10.6x higher batch Recommendation System inference performance (DLRM) and 10.6x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX INT8 compared to FP32

Up to 8.7x higher batch Recommendation System inference performance (DLRM) and 6.2x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. 3rd Gen Intel Xeon processor with FP32

Up to 5.5x higher batch Recommendation System inference performance (DLRM) and 3.8x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX INT8 vs. 3rd Gen Intel Xeon processor with INT8

5th Generation Intel® Xeon® Platinum processor 8592+: 1-node, 2x Intel(R) Xeon(R) Platinum 8592+, 64 cores, HT On, Turbo On, NUMA 4, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS EGSDCRB1.SYS.0105.D74.2308261933, microcode 0x21000161, 1x Ethernet Controller I225-LM, 1x 3.6T INTEL SSDPE2KX040T8, 1x 931.5G INTEL, CentOS Stream 9, 6.2.0-emr.bkc.6.2.3.6.31.x86_​64. PyTorch: torch:2.1.0.dev20230825+cpu, oneDNN:v3.2.1 IPEX:2.1.0+git31b5ee1, Test by INTEL as of 09/07/2023. 8480+: 1-node, 2x Intel(R) Xeon(R) Platinum 8480+, 56 cores, HT On, Turbo On, NUMA 2, Total Memory 1024GB (16x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS EGSDCRB1.SYS.0102.D37.2305081420, microcode 0x2b0004b1, 1x Ethernet Controller I225-LM, 1x 7.2G Cruzer Blade, 2x 3.7T INTEL SSDPE2KX040T8, 1x 894.3G INTEL SSDSC2KG96, CentOS Stream 8, 5.15.0-spr.bkc.pc.16.4.24.x86_​64. PyTorch: torch:2.1.0.dev20230825+cpu oneDNN:v3.2.1 IPEX:2.1.0+git31b5ee1. Test by INTEL as of 09/05/2023. 8380: 1-node, 2x Intel(R) Xeon(R) Platinum 8380 CPU @ 2.30GHz, 40 cores, HT On, Turbo On, Total Memory 1024GB (16x64GB DDR4 3200 MT/s [3200 MT/s]), BIOS SE5C620.86B.01.01.0008.2305172341, microcode 0xd0003a5, 2x Ethernet Controller 10G X550T, 3x 894.3G INTEL SSDSC2KG96, 1x 0B vmDisk, 1x 60G Flash Disk, 1x 1024M vmDisk-CD, 1x 3.6T INTEL SSDPE2KX040T8, 1x 931.5G INTEL SSDPE2KX010T8, Ubuntu 22.04 LTS, 5.15.0-78-generic, PyTorch: torch:2.1.0.dev20230825+cpu oneDNN:v3.2.1 IPEX:2.1.0+git31b5ee1. Test by INTEL as of 09/14/23. DLRM​, BS=1: 4cores/instance​, BS=x: 1 instance/ numa node PT: DLRM Test by Intel September 7, 2023, September 5, 2023, September 14, 2023
[A21] Real Time Inference Performance

Up to 1.4x higher real time object detection inference performance (SSD-ResNet34) and 1.4x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. prior generation with AMX BF16

Up to 1.34x higher real time object detection inference performance (SSD-ResNet34) and 1.42x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX INT8 vs. prior generation with AMX INT8 Up to 8x higher real time object detection inference performance (SSD-ResNet34) and 7.5x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 compared to FP32

Up to 15x higher real time object detection inference performance (SSD-ResNet34) and 15x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX INT8 compared to FP32

Up to 14x higher real time object detection inference performance (SSD-ResNet34) and 9.6x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. 3rd Gen Intel Xeon processor with FP32

Up to 6.7x higher real time object detection inference performance (SSD-ResNet34) and 4.8x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX INT8 vs. 3rd Gen Intel Xeon processor with INT8 Batch Inference Performance

Up to 1.4x higher batch object detection inference performance (SSD-ResNet34) and 1.32x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. prior generation with AMX BF16

Up to 1.43x higher batch object detection inference performance (SSD-ResNet34) and 1.42x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX INT8 vs. prior generation with AMX INT8 Up to 7.7x higher batch object detection inference performance (SSD-ResNet34) and 8.1x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 compared to FP32

Up to 14x higher batch object detection inference performance (SSD-ResNet34) and 17.5x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX INT8 compared to FP32

Up to 13.8x higher batch object detection inference performance (SSD-ResNet34) and 10x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. 3rd Gen Intel Xeon processor with FP32

Up to 6.5x higher batch object detection inference performance (SSD-ResNet34) and 5x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX INT8 vs. 3rd Gen Intel Xeon processor with INT8

5th Generation Intel® Xeon® Platinum processor 8592+: 1-node, 2x Intel(R) Xeon(R) Platinum 8592+, 64 cores, HT On, Turbo On, NUMA 4, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS EGSDCRB1.SYS.0105.D74.2308261933, microcode 0x21000161, 1x Ethernet Controller I225-LM, 1x 3.6T INTEL SSDPE2KX040T8, 1x 931.5G INTEL, CentOS Stream 9, 6.2.0-emr.bkc.6.2.3.6.31.x86_​64. PyTorch: torch:2.1.0.dev20230825+cpu, oneDNN:v3.2.1 IPEX:2.1.0+git31b5ee1, Test by INTEL as of 09/07/2023. 8480+: 1-node, 2x Intel(R) Xeon(R) Platinum 8480+, 56 cores, HT On, Turbo On, NUMA 2, Total Memory 1024GB (16x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS EGSDCRB1.SYS.0102.D37.2305081420, microcode 0x2b0004b1, 1x Ethernet Controller I225-LM, 1x 7.2G Cruzer Blade, 2x 3.7T INTEL SSDPE2KX040T8, 1x 894.3G INTEL SSDSC2KG96, CentOS Stream 8, 5.15.0-spr.bkc.pc.16.4.24.x86_​64. PyTorch: torch:2.1.0.dev20230825+cpu oneDNN:v3.2.1 IPEX:2.1.0+git31b5ee1. Test by INTEL as of 09/05/2023. 8380: 1-node, 2x Intel(R) Xeon(R) Platinum 8380 CPU @ 2.30GHz, 40 cores, HT On, Turbo On, Total Memory 1024GB (16x64GB DDR4 3200 MT/s [3200 MT/s]), BIOS SE5C620.86B.01.01.0008.2305172341, microcode 0xd0003a5, 2x Ethernet Controller 10G X550T, 3x 894.3G INTEL SSDSC2KG96, 1x 0B vmDisk, 1x 60G Flash Disk, 1x 1024M vmDisk-CD, 1x 3.6T INTEL SSDPE2KX040T8, 1x 931.5G INTEL SSDPE2KX010T8, Ubuntu 22.04 LTS, 5.15.0-78-generic, PyTorch: torch:2.1.0.dev20230825+cpu oneDNN:v3.2.1 IPEX:2.1.0+git31b5ee1. Test by INTEL as of 09/14/23. SSD-ResNet34​, BS=1: 4cores/instance​, BS=x: 1 instance/ numa node PT: SSD-ResNet34 Test by Intel September 7, 2023, September 5, 2023, September 14, 2023
[A22] Real Time Inference Performance

Up to 1.24x higher real time object classification inference performance (ResNeXT101_​32x16d) and 1.23x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. prior generation with AMX BF16

Up to 1.3x higher real time object classification inference performance (ResNeXT101_​32x16d) and 1.28x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX INT8 vs. prior generation with AMX INT8

Up to 4.3x higher real time object classification inference performance (ResNeXT101_​32x16d) and 4.3x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 compared to FP32

Up to 9x higher real time object classification inference performance (ResNeXT101_​32x16d) and 9x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX INT8 compared to FP32

Up to 7.2x higher real time object classification inference performance (ResNeXT101_​32x16d) and 5.3x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. 3rd Gen Intel Xeon processor with FP32

Up to 4.3x higher real time object classification inference performance (ResNeXT101_​32x16d) and 3.2x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX INT8 vs. 3rd Gen Intel Xeon processor with INT8 Batch Inference Performance

Up to 1.36x higher batch object classification inference performance (ResNeXT101_​32x16d) and 1.28x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. prior generation with AMX BF16

Up to 1.29x higher batch object classification inference performance (ResNeXT101_​32x16d) and 1.4x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX INT8 vs. prior generation with AMX INT8

Up to 5.8x higher batch object classification inference performance (ResNeXT101_​32x16d) and 5.6x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 compared to FP32

Up to 12x higher batch object classification inference performance (ResNeXT101_​32x16d) and 13x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX INT8 compared to FP32

Up to 10x higher batch object classification inference performance (ResNeXT101_​32x16d) and 7x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. 3rd Gen Intel Xeon processor with FP32

Up to 6x higher batch object classification inference performance (ResNeXT101_​32x16d) and 4.6x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX INT8 vs. 3rd Gen Intel Xeon processor with INT8

5th Generation Intel® Xeon® Platinum processor 8592+: 1-node, 2x Intel(R) Xeon(R) Platinum 8592+, 64 cores, HT On, Turbo On, NUMA 4, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS EGSDCRB1.SYS.0105.D74.2308261933, microcode 0x21000161, 1x Ethernet Controller I225-LM, 1x 3.6T INTEL SSDPE2KX040T8, 1x 931.5G INTEL, CentOS Stream 9, 6.2.0-emr.bkc.6.2.3.6.31.x86_​64. PyTorch: torch:2.1.0.dev20230825+cpu, oneDNN:v3.2.1 IPEX:2.1.0+git31b5ee1, Test by INTEL as of 09/07/2023. 8480+: 1-node, 2x Intel(R) Xeon(R) Platinum 8480+, 56 cores, HT On, Turbo On, NUMA 2, Total Memory 1024GB (16x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS EGSDCRB1.SYS.0102.D37.2305081420, microcode 0x2b0004b1, 1x Ethernet Controller I225-LM, 1x 7.2G Cruzer Blade, 2x 3.7T INTEL SSDPE2KX040T8, 1x 894.3G INTEL SSDSC2KG96, CentOS Stream 8, 5.15.0-spr.bkc.pc.16.4.24.x86_​64. PyTorch: torch:2.1.0.dev20230825+cpu oneDNN:v3.2.1 IPEX:2.1.0+git31b5ee1. Test by INTEL as of 09/05/2023. 8380: 1-node, 2x Intel(R) Xeon(R) Platinum 8380 CPU @ 2.30GHz, 40 cores, HT On, Turbo On, Total Memory 1024GB (16x64GB DDR4 3200 MT/s [3200 MT/s]), BIOS SE5C620.86B.01.01.0008.2305172341, microcode 0xd0003a5, 2x Ethernet Controller 10G X550T, 3x 894.3G INTEL SSDSC2KG96, 1x 0B vmDisk, 1x 60G Flash Disk, 1x 1024M vmDisk-CD, 1x 3.6T INTEL SSDPE2KX040T8, 1x 931.5G INTEL SSDPE2KX010T8, Ubuntu 22.04 LTS, 5.15.0-78-generic, PyTorch: torch:2.1.0.dev20230825+cpu oneDNN:v3.2.1 IPEX:2.1.0+git31b5ee1. Test by INTEL as of 09/14/23. ResNeXT101_​32x16d, BS=1: 4cores/instance​, BS=x: 1 instance/ numa node PT: ResNeXT101_​32x16d Test by Intel September 7, 2023, September 5, 2023, September 14, 2023
[A23] Real Time Inference Performance

Up to 1.24x higher real time speech recognition inference performance (RNN-T) and 1.23x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. prior generation with AMX BF16

Up to 4.2x higher real time speech recognition inference performance (RNN-T) and 4.2x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 compared to FP32

Up to 10.7x higher real time speech recognition inference performance (RNN-T) and 7.9x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. 3rd Gen Intel Xeon processor with FP32 Batch Inference Performance

Up to 1.44x higher batch speech recognition inference performance (RNN-T) and 1.4x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. prior generation with AMX BF16

Up to 3.7x higher batch speech recognition inference performance (RNN-T) and 3.9x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 compared to FP32

Up to 7.7x higher batch speech recognition inference performance (RNN-T) and 6x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. 3rd Gen Intel Xeon processor with FP32

5th Generation Intel® Xeon® Platinum processor 8592+: 1-node, 2x Intel(R) Xeon(R) Platinum 8592+, 64 cores, HT On, Turbo On, NUMA 4, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS EGSDCRB1.SYS.0105.D74.2308261933, microcode 0x21000161, 1x Ethernet Controller I225-LM, 1x 3.6T INTEL SSDPE2KX040T8, 1x 931.5G INTEL, CentOS Stream 9, 6.2.0-emr.bkc.6.2.3.6.31.x86_​64. PyTorch: torch:2.1.0.dev20230825+cpu, oneDNN:v3.2.1 IPEX:2.1.0+git31b5ee1, Test by INTEL as of 09/07/2023. 8480+: 1-node, 2x Intel(R) Xeon(R) Platinum 8480+, 56 cores, HT On, Turbo On, NUMA 2, Total Memory 1024GB (16x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS EGSDCRB1.SYS.0102.D37.2305081420, microcode 0x2b0004b1, 1x Ethernet Controller I225-LM, 1x 7.2G Cruzer Blade, 2x 3.7T INTEL SSDPE2KX040T8, 1x 894.3G INTEL SSDSC2KG96, CentOS Stream 8, 5.15.0-spr.bkc.pc.16.4.24.x86_​64. PyTorch: torch:2.1.0.dev20230825+cpu oneDNN:v3.2.1 IPEX:2.1.0+git31b5ee1. Test by INTEL as of 09/05/2023. 8380: 1-node, 2x Intel(R) Xeon(R) Platinum 8380 CPU @ 2.30GHz, 40 cores, HT On, Turbo On, Total Memory 1024GB (16x64GB DDR4 3200 MT/s [3200 MT/s]), BIOS SE5C620.86B.01.01.0008.2305172341, microcode 0xd0003a5, 2x Ethernet Controller 10G X550T, 3x 894.3G INTEL SSDSC2KG96, 1x 0B vmDisk, 1x 60G Flash Disk, 1x 1024M vmDisk-CD, 1x 3.6T INTEL SSDPE2KX040T8, 1x 931.5G INTEL SSDPE2KX010T8, Ubuntu 22.04 LTS, 5.15.0-78-generic, PyTorch: torch:2.1.0.dev20230825+cpu oneDNN:v3.2.1 IPEX:2.1.0+git31b5ee1. Test by INTEL as of 09/14/23. RNN-T, BS=1: 4cores/instance​, BS=x: 1 instance/ numa node PT: RNN-T Test by Intel September 7, 2023, September 5, 2023, September 14, 2023
[A24] Real Time Inference Performance

Up to 1.41x higher real-time Natural Language Processing inference (DistilBERT) performance and 1.48x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. prior generation with AMX BF16

Up to 1.35x higher real-time Natural Language Processing inference (DistilBERT) performance and 1.38x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX INT8 vs. prior generation with AMX INT8

Up to 4.1x higher real-time Natural Language Processing inference performance (DistilBERT) and 4.4x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 compared to FP32

Up to 5.7x higher real-time Natural Language Processing inference performance (DistilBERT) and 6x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX INT8 compared to FP32

Up to 7x higher real-time Natural Language Processing inference (DistilBERT) performance and 5.6x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. 3rd gen Intel Xeon processor with FP32

Up to 2.9x higher real-time Natural Language Processing inference (DistilBERT) performance and 2.3x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX INT8 vs. 3rd gen Intel Xeon processor with INT8 Batch Inference Performance

Up to 1.36x higher batch Natural Language Processing inference (DistilBERT) performance and 1.32x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. prior generation with AMX BF16

Up to 1.38x higher batch Natural Language Processing inference (DistilBERT) performance and 1.35x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX INT8 vs. prior generation with AMX INT8

Up to 5.7x higher batch Natural Language Processing inference performance (DistilBERT) and 5.7x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 compared to FP32

Up to 8.8x higher batch Natural Language Processing inference performance (DistilBERT) and 9x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX INT8 compared to FP32

Up to 10x higher batch Natural Language Processing inference (DistilBERT) performance and 8x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. 3rd gen Intel Xeon processor with FP32

Up to 4x higher batch Natural Language Processing inference (DistilBERT) performance and 3x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX INT8 vs. 3rd gen Intel Xeon processor with INT8

5th Generation Intel® Xeon® Platinum processor 8592+: 1-node, 2x Intel(R) Xeon(R) Platinum 8592+, 64 cores, HT On, Turbo On, NUMA 4, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS EGSDCRB1.SYS.0105.D74.2308261933, microcode 0x21000161, 1x Ethernet Controller I225-LM, 1x 3.6T INTEL SSDPE2KX040T8, 1x 931.5G INTEL, CentOS Stream 9, 6.2.0-emr.bkc.6.2.3.6.31.x86_​64. PyTorch: torch:2.1.0.dev20230825+cpu, oneDNN:v3.2.1 IPEX:2.1.0+git31b5ee1, Test by INTEL as of 09/07/2023. 8480+: 1-node, 2x Intel(R) Xeon(R) Platinum 8480+, 56 cores, HT On, Turbo On, NUMA 2, Total Memory 1024GB (16x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS EGSDCRB1.SYS.0102.D37.2305081420, microcode 0x2b0004b1, 1x Ethernet Controller I225-LM, 1x 7.2G Cruzer Blade, 2x 3.7T INTEL SSDPE2KX040T8, 1x 894.3G INTEL SSDSC2KG96, CentOS Stream 8, 5.15.0-spr.bkc.pc.16.4.24.x86_​64. PyTorch: torch:2.1.0.dev20230825+cpu oneDNN:v3.2.1 IPEX:2.1.0+git31b5ee1. Test by INTEL as of 09/05/2023. 8380: 1-node, 2x Intel(R) Xeon(R) Platinum 8380 CPU @ 2.30GHz, 40 cores, HT On, Turbo On, Total Memory 1024GB (16x64GB DDR4 3200 MT/s [3200 MT/s]), BIOS SE5C620.86B.01.01.0008.2305172341, microcode 0xd0003a5, 2x Ethernet Controller 10G X550T, 3x 894.3G INTEL SSDSC2KG96, 1x 0B vmDisk, 1x 60G Flash Disk, 1x 1024M vmDisk-CD, 1x 3.6T INTEL SSDPE2KX040T8, 1x 931.5G INTEL SSDPE2KX010T8, Ubuntu 22.04 LTS, 5.15.0-78-generic, PyTorch: torch:2.1.0.dev20230825+cpu oneDNN:v3.2.1 IPEX:2.1.0+git31b5ee1. Test by INTEL as of 09/14/23. DistilBERT, BS=1: 4cores/instance​, BS=x: 1 instance/ numa node PT: DistilBERT Test by Intel September 7, 2023, September 5, 2023, September 14, 2023
[A25] Real Time Inference Performance

Up to 1.42x higher real time image segmentation inference performance (MaskRCNN) and 1.47x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. prior generation with AMX BF16

Up to 5.3x higher real time image segmentation inference performance (MaskRCNN) and 5.4x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 compared to FP32

Up to 9x higher real time image segmentation inference performance (MaskRCNN) and 6.5x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. 3rd Gen Intel Xeon processor with FP32 Batch Inference Performance

Up to 1.26x higher batch image segmentation inference performance (MaskRCNN) and 1.18x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. prior generation with AMX BF16

Up to 4.6x higher batch image segmentation inference performance (MaskRCNN) and 4.9x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 compared to FP32

Up to 8.5x higher batch image segmentation inference performance (MaskRCNN) and 6x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. 3rd Gen Intel Xeon processor with FP32

5th Generation Intel® Xeon® Platinum processor 8592+: 1-node, 2x Intel(R) Xeon(R) Platinum 8592+, 64 cores, HT On, Turbo On, NUMA 4, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS EGSDCRB1.SYS.0105.D74.2308261933, microcode 0x21000161, 1x Ethernet Controller I225-LM, 1x 3.6T INTEL SSDPE2KX040T8, 1x 931.5G INTEL, CentOS Stream 9, 6.2.0-emr.bkc.6.2.3.6.31.x86_​64. PyTorch: torch:2.1.0.dev20230825+cpu, oneDNN:v3.2.1 IPEX:2.1.0+git31b5ee1, Test by INTEL as of 09/07/2023. 8480+: 1-node, 2x Intel(R) Xeon(R) Platinum 8480+, 56 cores, HT On, Turbo On, NUMA 2, Total Memory 1024GB (16x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS EGSDCRB1.SYS.0102.D37.2305081420, microcode 0x2b0004b1, 1x Ethernet Controller I225-LM, 1x 7.2G Cruzer Blade, 2x 3.7T INTEL SSDPE2KX040T8, 1x 894.3G INTEL SSDSC2KG96, CentOS Stream 8, 5.15.0-spr.bkc.pc.16.4.24.x86_​64. PyTorch: torch:2.1.0.dev20230825+cpu oneDNN:v3.2.1 IPEX:2.1.0+git31b5ee1. Test by INTEL as of 09/05/2023. 8380: 1-node, 2x Intel(R) Xeon(R) Platinum 8380 CPU @ 2.30GHz, 40 cores, HT On, Turbo On, Total Memory 1024GB (16x64GB DDR4 3200 MT/s [3200 MT/s]), BIOS SE5C620.86B.01.01.0008.2305172341, microcode 0xd0003a5, 2x Ethernet Controller 10G X550T, 3x 894.3G INTEL SSDSC2KG96, 1x 0B vmDisk, 1x 60G Flash Disk, 1x 1024M vmDisk-CD, 1x 3.6T INTEL SSDPE2KX040T8, 1x 931.5G INTEL SSDPE2KX010T8, Ubuntu 22.04 LTS, 5.15.0-78-generic, PyTorch: torch:2.1.0.dev20230825+cpu oneDNN:v3.2.1 IPEX:2.1.0+git31b5ee1. Test by INTEL as of 09/14/23. MaskRCNN, BS=1: 4cores/instance​, BS=x: 1 instance/ numa node PT: MaskRCNN Test by Intel September 7, 2023, September 5, 2023, September 14, 2023
[A26] Real Time Inference Performance:

Up to 1.24x higher performance and 1.28x higher performance/watt on real-time image classification(ResNet50) inference (BF16) with 5th Gen Intel Xeon 8592+ (64c) vs. 4th Gen Intel Xeon 8480+

Up to 8x higher performance and 6.4x higher performance/watt on real-time image classification(ResNet50) inference (BF16) with 5th Gen Intel Xeon 8592+ (64c) vs. 3rd Gen Intel Xeon 8380 (fp32)

Up to 1.23x higher performance and 1.26x higher performance/watt on real-time image classification(ResNet50) inference (INT8) with 5th Gen Intel Xeon 8592+ (64c) vs. 4th Gen Intel Xeon 8480+

Up to 3.8x higher performance and 3x higher performance/watt on real-time image classification(ResNet50) inference (INT8) with 5th Gen Intel Xeon 8592+ (64c) vs. 3rd Gen Intel Xeon 8380

Batch Inference Performance:

Up to 1.21x higher performance and 1.29x higher performance/watt on batch image classification(ResNet50) inference (BF16) with 5th Gen Intel Xeon 8592+ (64c) 4th Gen Intel Xeon 8480+

Up to 8.8x higher performance and 7.4x higher performance/watt on batch image classification(ResNet50) inference (BF16) with 5th Gen Intel Xeon 8592+ (64c) vs. 3rd Gen Intel Xeon 8380 (fp32)

Up to 1.23x higher performance and 1.26x higher performance/watt on batch image classification(ResNet50) inference (INT8) with 5th Gen Intel Xeon 8592+ (64c) vs. 4th Gen Intel Xeon 8480+

Up to 3.8x higher performance and 3x higher performance/watt on batch image classification(ResNet50) inference (INT8) with 5th Gen Intel Xeon 8592+ (64c) vs. 3rd Gen Intel Xeon 8380

5th Generation Intel® Xeon® Platinum processor 8592+: 1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores, HT On, Turbo On, NUMA 2, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 2.0, microcode 0x21000161, 2x Ethernet Controller X710 for 10GBASE-T, 1x Ethernet interface, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.2 LTS, 5.15.0-78-generic, Test by Intel as of 10/10/23. 8480+: 1-node, 2x Intel(R) Xeon(R) Platinum 8480+, 56 cores, HT On, Turbo On, NUMA 2, Total Memory 1024GB (16x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 2.0, microcode 0x2b0004d0, 1x Ethernet interface, 2x Ethernet Controller X710 for 10GBASE-T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.2 LTS, 5.15.0-78-generic, Test by Intel as of 10/25/23. 8380: 1-node, 2x Intel(R) Xeon(R) Platinum 8380 CPU @ 2.30GHz, 40 cores, HT On, Turbo On, NUMA 2, Total Memory 1024GB (16x64GB DDR4 3200 MT/s [3200 MT/s]), BIOS 1.5, microcode 0xd0003a5, 2x Ethernet Controller 10-Gigabit X540-AT2, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.2 LTS, 5.15.0-78-generic, Test by Intel as of 10/26/23. Software configuration: ResNet50_​v1.5, Intel Model Zoo:https://github.com/IntelAI/models, gcc=11.4, OneDNN3.2, Python 3.9, Conda 4.12.0, Intel TF 2.13. TF: ResNet50 v1.5 Test by Intel October 10, 2023, October 25, 2023, October 26, 2023
[A37] Up to 42x higher inference performance and up to 20x higher performance/watt (BertLarge) on 5th Gen Intel Xeon vs.1st Gen Intel® Xeon® processors 5th Gen Intel® Xeon® processor Test by Intel as of 09/22/23 1-node, 2x Intel(R) Xeon(R) Gold 5120 CPU @ 2.20GHz, 14 cores, HT On, Turbo On, Total Memory 768GB (12x64GB DDR4 2666 MT/s [2400 MT/s]), BIOS 3.8b, microcode 0x2007006, 2x Ethernet Connection X722 for 10GBASE-T, 1x 894.3G Micron_​​7450_​​MTFDKBA960TFR, Ubuntu 22.04.2 LTS, 5.15.0-78-generic 1-node, 2x INTEL(R) XEON(R) GOLD 5520+, 28 cores, HT On, Turbo On, NUMA 2, Integrated Accelerators Available [used]: DLB 2 [0], DSA 2 [0], IAA 2 [0], QAT 2 [0], Total Memory 1024GB (16x64GB DDR5 5600 MT/s [4800 MT/s]), BIOS EGSDCRB1.SYS.1752.P05.2401050248, microcode 0x21000200, 1x Ethernet Controller I225-LM, 1x 7T INTEL SSDPF2KX076TZ, Ubuntu 22.04.1 LTS, 5.15.0-92-generic, WORKLOAD+VERSION, COMPILER, LIBRARIES, OTHER_​SW, score=?UNITS. Test by Intel as of 02/02/24. BERT-Large performance and perf/watt refresh comparison October 5th, 2023
[A38] Up to 10x higher inference performance and up to 6x higher performance/watt (DLRM) on 5th Gen Intel Xeon Platinum vs. 2nd Gen Intel® Xeon® processors 5th Gen Intel® Xeon® processor Test by Intel as of 10/05/23 1-node, 2x Intel(R) Xeon(R) Gold 5218 CPU @ 2.30GHz, 16 cores, HT On, Turbo On, Total Memory 768GB (12x64GB DDR4 2666 MT/s [2666 MT/s]), BIOS 3.8b, microcode 0x4003604, 2x Ethernet Connection X722 for 10GBASE-T, 1x 894.3G Micron_​​7450_​​MTFDKBA960TFR, Ubuntu 22.04.2 LTS, 5.15.0-78-generic 1-node, 2x INTEL(R) XEON(R) GOLD 5520+, 28 cores, HT On, Turbo On, NUMA 2, Integrated Accelerators Available [used]: DLB 2 [0], DSA 2 [0], IAA 2 [0], QAT 2 [0], Total Memory 1024GB (16x64GB DDR5 5600 MT/s [4800 MT/s]), BIOS EGSDCRB1.SYS.1752.P05.2401050248, microcode 0x21000200, 1x Ethernet Controller I225-LM, 1x 7T INTEL SSDPF2KX076TZ, Ubuntu 22.04.1 LTS, 5.15.0-92-generic, WORKLOAD+VERSION, COMPILER, LIBRARIES, OTHER_​SW, score=?UNITS. Test by Intel as of 02/02/24. DLRM performance and perf/watt refresh comparison September 22, 2023
[A39] Up to 1.8x better performance on OpenVINO™ 2024.1 compared to OpenVINO™ 2024.0 for ChatGLM2-6b on Xeon® Platinum 8580 5th generation Intel® Xeon® Platinum 8580 1-node, 2x INTEL(R) XEON(R) PLATINUM 8580, 60 cores, HT On, Turbo On, NUMA 4, Integrated Accelerators Available [used]: DLB 0 [0], DSA 2 [0], IAA 0 [0], QAT 0 [0], Total Memory 256GB (16x16GB DDR5 5600 MT/s [5600 MT/s]), BIOS EGSDREL1.SYS.1752.P05.2401050250, microcode 0xa1000200, 1x Ethernet Controller I225-LM, 1x 931.5G Samsung SSD 870 EVO 1TB, Ubuntu 22.04.4 LTS, 6.5.0-27-generic Results from OpenVINO™ 2024.1 compared to OpenVINO™ 2024.0 using OV-2024.0 as baseline (1.0). Data pulled from OpenVINO public benchmark web page(s): https://docs.openvino.ai/2024/home.html Precision used: INT4 quantization of Huggingface https://huggingface.co/THUDM/chatglm2-6b/tree/main OV-2024.0: March 2024, OV-2024.1: April 2024
[A208]

Up to 2.85x higher batched Recommendation System inference performance (DLRM) and 2.58x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX INT8 vs. AMD EPYC 9554 (Genoa)

Up to 2.34x higher batched Recommendation System inference performance (DLRM) and 2.26x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX INT8 vs. AMD EPYC 9654 (Genoa)

Up to 1.90x higher batched Recommendation System inference performance (DLRM) and 1.72x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX INT8 vs. AMD EPYC 9754 (Bergamo)

5th Generation Intel® Xeon® Platinum processor

Intel Xeon 8592+: 1-node, 2x Intel(R) Xeon(R) Platinum 8592+, 64 cores, HT On, Turbo On, NUMA 2, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 2.0, microcode 0x21000161, 2x Ethernet Controller X710 for 10GBASE-T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.2 LTS, 5.15.0-78-generic. Framework=Pytorch 2.1, IPEX=2.1, oneDNN:v3.2.1, Python 3.8, AI Model= DLRM(https://github.com/IntelAI/models/) , Batched Results: best scores achieved using BS>1, Precision=INT8-AMX, Test by INTEL as of 10/10/2023.

AMD EPYC 9554: 1-node, 2x AMD EPYC 9554 64-Core Processor, 64 cores, SMT On, Turbo On, NUMA 2, Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 1.5, microcode 0xa10113e, 2x Ethernet Controller 10G X550T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 5.15.125-0515125-generic, Framework=Pytorch 2.1, IPEX=2.1, oneDNN: v3.2.1, Python 3.8, AI Model= DLRM(https://github.com/IntelAI/models/) , Batched Results: best scores achieved using BS>1, Precision=INT8. Test by INTEL as of 09/11/23.

AMD EPYC 9654: 1-node, 2x AMD EPYC 9654 96-Core Processor, 96 cores, SMT On, Turbo On, NUMA 2, Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 1.5, microcode 0xa10113e, 2x Ethernet Controller 10G X550T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 5.15.125-0515125-generic, Framework=Pytorch 2.1, IPEX=2.1, oneDNN: v3.2.1, Python 3.8, AI Model= DLRM(https://github.com/IntelAI/models/) , Batched Results: best scores achieved using BS>1, Precision=INT8. Test by INTEL as of 09/11/23.

AMD EPYC 9754: 1-node, 2x AMD EPYC 9754 128-Core Processor, 128 cores, SMT On, Turbo On, NUMA 2, Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 1.5, microcode 0xa10113e, 2x Ethernet Controller 10G X550T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 5.15.125-0515125-generic, Framework=Pytorch 2.1, IPEX=2.1, oneDNN: v3.2.1, Python 3.8, AI Model= DLRM(https://github.com/IntelAI/models/) , Batched Results: best scores achieved using BS>1, Precision=INT8. Test by INTEL as of 09/11/23.

PT: DLRM Test by Intel October 10, 2023, September 11, 2023
[A209]

Up to 1.57x higher real-time Natural Language Processing inference (DistilBERT) performance and 1.69x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. AMD EPYC 9654 (Genoa)

Up to 2.57x higher real-time Natural Language Processing inference (DistilBERT) performance and 2.27x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. AMD EPYC 9754 (Bergamo)

Up to 2.6x higher real-time Natural Language Processing inference (DistilBERT) performance and 2.34x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with INT8 vs. AMD EPYC 9654 (Genoa)

Up to 3.96x higher real-time Natural Language Processing inference (DistilBERT) performance and 3.39x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with INT8 vs. AMD EPYC 9754 (Bergamo)

Up to 2.25x higher batched Natural Language Processing inference (DistilBERT) performance and 2.58x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. AMD EPYC 9654 (Genoa)

Up to 1.83x higher batched Natural Language Processing inference (DistilBERT) performance and 1.83x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. AMD EPYC 9754 (Bergamo)

Up to 2.13x higher batched Natural Language Processing inference (DistilBERT) performance and 2.44x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with INT8 vs. AMD EPYC 9554 (Genoa)

Up to 1.74x higher batched Natural Language Processing inference (DistilBERT) performance and 1.89x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with INT8 vs. AMD EPYC 9654 (Genoa)

Up to 1.48x higher batched Natural Language Processing inference (DistilBERT) performance and 1.54x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with INT8 vs. AMD EPYC 9754 (Bergamo)

5th Generation Intel® Xeon® Platinum processor

Claims with INT8:

Intel Xeon 8592+: 1-node, 2x Intel(R) Xeon(R) Platinum 8592+, 64 cores, HT On, Turbo On, NUMA 2, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 2.0, microcode 0x21000161, 2x Ethernet Controller X710 for 10GBASE-T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.2 LTS, 5.15.0-78-generic. Framework=Pytorch 2.0, IPEX=2.0, Python 3.8, AI Model=DistilBERT (https://github.com/IntelAI/models/), INT8-AMX, Real Time (BS=1) results while maintaining 5ms latency SLA, Test by INTEL  as of 10/10/2023.

AMD EPYC 9554: 1-node, 2x AMD EPYC 9554 64-Core Processor, 64 cores, SMT On, Turbo On, NUMA 2, Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 1.5,  microcode 0xa10113e, 2x Ethernet Controller 10G X550T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 5.15.125-0515125-generic, Framework=Pytorch 2.0, IPEX=2.0, Python 3.8, AI Model=DistilBERT (https://github.com/IntelAI/models/) , INT8 Real Time (BS=1) results while maintaining 5ms latency SLA.  Test by INTEL as of 09/11/23.

AMD EPYC 9654: 1-node, 2x AMD EPYC 9654 96-Core Processor, 96 cores, SMT On, Turbo On, NUMA 2, Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 1.5,  microcode 0xa10113e, 2x Ethernet Controller 10G X550T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 5.15.125-0515125-generic, Framework=Pytorch 2.0, IPEX=2.0, Python 3.8, AI Model=DistilBERT (https://github.com/IntelAI/models/) , INT8 Real Time (BS=1) results while maintaining 5ms latency SLA.  Test by INTEL as of 09/11/23.

AMD EPYC 9754: 1-node, 2x AMD EPYC 9754 128-Core Processor, 128 cores, SMT On, Turbo On, NUMA 2, Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 1.5,  microcode 0xaa00212, 2x Ethernet Controller 10G X550T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 5.15.125-0515125-generic, Framework=Pytorch 2.0, IPEX=2.0, Python 3.8, AI Model=DistilBERT (https://github.com/IntelAI/models/) , INT8 Real Time (BS=1) results while maintaining 5ms latency SLA.  Test by INTEL as of 10/26/23.

Batched Results: best scores achieved using (BS>1).

Claims with BF16:

Intel Xeon 8592+: 1-node, 2x Intel(R) Xeon(R) Platinum 8592+, 64 cores, HT On, Turbo On, NUMA 2, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 2.0, microcode 0x21000161, 2x Ethernet Controller X710 for 10GBASE-T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.2 LTS, 5.15.0-78-generic. Framework=Pytorch 2.0, IPEX=2.0, Python 3.8, AI Model=DistilBERT (https://github.com/IntelAI/models/), BF16-AMX, Real Time (BS=1) results while maintaining 5ms latency SLA, Test by INTEL  as of 10/10/2023.

AMD EPYC 9654: 1-node, 2x AMD EPYC 9654 96-Core Processor, 96 cores, SMT On, Turbo On, NUMA 2, Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 1.5,  microcode 0xa10113e, 2x Ethernet Controller 10G X550T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 5.15.125-0515125-generic, Framework=Pytorch 2.0, IPEX=2.0, Python 3.8, AI Model=DistilBERT (https://github.com/IntelAI/models/) , BF16 Real Time (BS=1) results while maintaining 5ms latency SLA.  Test by INTEL as of 09/11/23.

AMD EPYC 9754: 1-node, 2x AMD EPYC 9754 128-Core Processor, 128 cores, SMT On, Turbo On, NUMA 2, Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 1.5,  microcode 0xaa00212, 2x Ethernet Controller 10G X550T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 5.15.125-0515125-generic, Framework=Pytorch 2.0, IPEX=2.0, Python 3.8, AI Model=DistilBERT (https://github.com/IntelAI/models/) , BF16 Real Time (BS=1) results while maintaining 5ms latency SLA.  Test by INTEL as of 10/26/23.

Batched Results: best scores achieved using (BS>1).

PT: DistilBERT Test by Intel October 10, 2023, September 11, 2023, October 26, 2023
[A210]

Up to 2.13x higher real-time Natural Language Processing inference (BERT-Large) performance and 2.08x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. AMD EPYC 9654 (Genoa)

Up to 1.83x higher real-time Natural Language Processing inference (BERT-Large) performance and 1.71x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. AMD EPYC 9754 (Bergamo)

Up to 1.80x higher real-time Natural Language Processing inference (BERT-Large) performance and 1.65x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with INT8 vs. AMD EPYC 9654 (Genoa)

Up to 1.49x higher real-time Natural Language Processing inference (BERT-Large) performance and 1.30x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with INT8 vs. AMD EPYC 9754 (Bergamo)

Up to 2.69x higher batched Natural Language Processing inference (BERT-Large) performance and 2.96x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. AMD EPYC 9654 (Genoa)

Up to 2.19x higher batched Natural Language Processing inference (BERT-Large) performance and 2.19x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. AMD EPYC 9754 (Bergamo)

Up to 2.56x higher batched Natural Language Processing inference (BERT-Large) performance and 2.47x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with INT8 vs. AMD EPYC 9554 (Genoa)

Up to 2.10x higher batched Natural Language Processing inference (BERT-Large) performance and 2.13x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with INT8 vs. AMD EPYC 9654 (Genoa)

Up to 1.78x higher batched Natural Language Processing inference (BERT-Large) performance and 1.72x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with INT8 vs. AMD EPYC 9754 (Bergamo)

5th Generation Intel® Xeon® Platinum processor

Claims with INT8

Intel Xeon 8592+: 1-node, 2x Intel(R) Xeon(R) Platinum 8592+, 64 cores, HT On, Turbo On, NUMA 2, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 2.0, microcode 0x21000161, 2x Ethernet Controller X710 for 10GBASE-T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.2 LTS, 5.15.0-78-generic. Framework=Pytorch 2.0, IPEX=2.0, Python 3.8, AI Model=BERT Large(https://github.com/IntelAI/models/) , INT8-AMX , Real Time (BS=1) results while maintaining 130ms latency SLA, Test by INTEL as of 10/10/2023.

AMD EPYC 9554: 1-node, 2x AMD EPYC 9554 64-Core Processor, 64 cores, SMT On, Turbo On, NUMA 2, Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 1.5, microcode 0xa10113e, 2x Ethernet Controller 10G X550T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 5.15.125-0515125-generic, Framework=Pytorch 2.0, IPEX=2.0, Python 3.8, AI Model=BERT Large(https://github.com/IntelAI/models/) , INT8, Real Time (BS=1) results while maintaining 130ms latency SLA. Test by INTEL as of 09/11/23.

AMD EPYC 9654: 1-node, 2x AMD EPYC 9654 96-Core Processor, 96 cores, SMT On, Turbo On, NUMA 2, Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 1.5, microcode 0xa10113e, 2x Ethernet Controller 10G X550T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 5.15.125-0515125-generic, Framework=Pytorch 2.0, IPEX=2.0, Python 3.8, AI Model=BERT Large(https://github.com/IntelAI/models/) , INT8, Real Time (BS=1) results while maintaining 130ms latency SLA. Test by INTEL as of 09/11/23.

AMD EPYC 9754: 1-node, 2x AMD EPYC 9754 128-Core Processor, 128 cores, SMT On, Turbo On, NUMA 2, Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 1.5, microcode 0xaa00212, 2x Ethernet Controller 10G X550T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 5.15.125-0515125-generic, Framework=Pytorch 2.0, IPEX=2.0, Python 3.8, AI Model=BERT Large(https://github.com/IntelAI/models/) , INT8, Real Time (BS=1) results while maintaining 130ms latency SLA. Test by INTEL as of 10/26/23.

Batched Results: best scores achieved using (BS >1).

Claims with BF16

Intel Xeon 8592+: 1-node, 2x Intel(R) Xeon(R) Platinum 8592+, 64 cores, HT On, Turbo On, NUMA 2, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 2.0, microcode 0x21000161, 2x Ethernet Controller X710 for 10GBASE-T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.2 LTS, 5.15.0-78-generic. Framework=Pytorch 2.0, IPEX=2.0, Python 3.8, AI Model=BERT Large(https://github.com/IntelAI/models/) , BF16-AMX , Real Time (BS=1) results while maintaining 130ms latency SLA, Test by INTEL as of 10/10/2023.

AMD EPYC 9654: 1-node, 2x AMD EPYC 9654 96-Core Processor, 96 cores, SMT On, Turbo On, NUMA 2, Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 1.5, microcode 0xa10113e, 2x Ethernet Controller 10G X550T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 5.15.125-0515125-generic, Framework=Pytorch 2.0, IPEX=2.0, Python 3.8, AI Model=BERT Large(https://github.com/IntelAI/models/) , BF16, Real Time (BS=1) results while maintaining 130ms latency SLA. Test by INTEL as of 09/11/23.

AMD EPYC 9754: 1-node, 2x AMD EPYC 9754 128-Core Processor, 128 cores, SMT On, Turbo On, NUMA 2, Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 1.5, microcode 0xaa00212, 2x Ethernet Controller 10G X550T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 5.15.125-0515125-generic, Framework=Pytorch 2.0, IPEX=2.0, Python 3.8, AI Model=BERT Large(https://github.com/IntelAI/models/) , BF16, Real Time (BS=1) results while maintaining 130ms latency SLA. Test by INTEL as of 10/26/23.

Batched Results: best scores achieved using (BS >1).

PT: BERT-Large Test by Intel October 10, 2023, September 11, 2023, October 26, 2023
[A211]

Up to 2.66x higher real-time Image Classification inference (ResNet50v1.5) performance and 2.57x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. AMD EPYC 9654 (Genoa)

Up to 2.66x higher real-time Image Classification inference (ResNet50v1.5) performance and 2.36x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. AMD EPYC 9754 (Bergamo)

Up to 2.44x higher real-time Classification inference (ResNet50v1.5) performance and 2.24x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with INT8 vs. AMD EPYC 9654 (Genoa)

Up to 2.15x higher real-time Image Classification inference (ResNet50v1.5) performance and 1.88x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with INT8 vs. AMD EPYC 9754 (Bergamo)

Up to 2.42x higher batched Image Classification inference (ResNet50v1.5) performance and 2.76x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. AMD EPYC 9654 (Genoa)

Up to 2.01x higher real-time Image Classification inference (ResNet50v1.5) performance and 2.23x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with AMX BF16 vs. AMD EPYC 9754 (Bergamo)

Up to 2.71x higher batched Image Classification inference (ResNet50v1.5) performance and 2.9x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with INT8 vs. AMD EPYC 9554 (Genoa)

Up to 2.26x higher batched Image Classification inference (ResNet50v1.5) performance and 2.38x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with INT8 vs. AMD EPYC 9654 (Genoa)

Up to 1.86x higher batched Image Classification inference (ResNet50v1.5) performance and 1.95x higher performance/watt on 5th Gen Intel Xeon Platinum 8592+ with INT8 vs. AMD EPYC 9754 (Bergamo)

5th Generation Intel® Xeon® Platinum processor

Claims with INT 8:

Intel Xeon 8592+: 1-node, 2x Intel(R) Xeon(R) Platinum 8592+, 64 cores, HT On, Turbo On, NUMA 2, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 2.0, microcode 0x21000161, 2x Ethernet Controller X710 for 10GBASE-T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.2 LTS, 5.15.0-78-generic. TensorFlow= Intel TF 2.13, OneDNN=3.2, Python 3.8, AI Model=ResNet50v1.5 (https://github.com/IntelAI/models/), INT8-AMX, Real Time (BS=1) results while maintaining 15ms latency SLA, Test by INTEL as of 10/10/2023.

AMD EPYC 9554: 1-node, 2x AMD EPYC 9554 64-Core Processor, 64 cores, SMT On, Turbo On, NUMA 2, Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 1.5, microcode 0xa10113e, 2x Ethernet Controller 10G X550T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 5.15.125-0515125-generic, ZenDNN 4.1, TensorFlow= 2.12.1, Python 3.8, AI Model=ResNet50v1.5 (https://github.com/IntelAI/models/) ,, INT8, Real Time (BS=1) results while maintaining 15ms latency SLA. Test by INTEL as of 09/11/23.

AMD EPYC 9654: 1-node, 2x AMD EPYC 9654 96-Core Processor, 96 cores, SMT On, Turbo On, NUMA 2, Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 1.5, microcode 0xa10113e, 2x Ethernet Controller 10G X550T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 5.15.125-0515125-generic, ZenDNN 4.1, TensorFlow= 2.12.1, Python 3.8, AI Model=ResNet50v1.5 (https://github.com/IntelAI/models/) ,, INT8, Real Time (BS=1) results while maintaining 15ms latency SLA. Test by INTEL as of 09/11/23.

AMD EPYC 9754: 1-node, 2x AMD EPYC 9754 128-Core Processor, 128 cores, SMT On, Turbo On, NUMA 2, Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800 MT/s]),BIOS 1.5., microcode 0xaa00212, 2x Ethernet Controller 10G X550T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 5.15.125-0515125-generic, ZenDNN 4.1, TensorFlow= 2.12.1, Python 3.8, AI Model=ResNet50v1.5 (https://github.com/IntelAI/models/) , INT8, Real Ti'me (BS=1) results while maintaining 15ms latency SLA. Test by INTEL as of 10/26/23.

Batched Results: best scores achieved using (BS>1).

Claims with BF16

Intel Xeon 8592+: 1-node, 2x Intel(R) Xeon(R) Platinum 8592+, 64 cores, HT On, Turbo On, NUMA 2, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 2.0, microcode 0x21000161, 2x Ethernet Controller X710 for 10GBASE-T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.2 LTS, 5.15.0-78-generic. TensorFlow= Intel TF 2.13, OneDNN=3.2, Python 3.8, AI Model=ResNet50v1.5 (https://github.com/IntelAI/models/), BF16-AMX, Real Time (BS=1) results while maintaining 15ms latency SLA, Test by INTEL as of 10/10/2023.

AMD EPYC 9654: 1-node, 2x AMD EPYC 9654 96-Core Processor, 96 cores, SMT On, Turbo On, NUMA 2, Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 1.5, microcode 0xa10113e, 2x Ethernet Controller 10G X550T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 5.15.125-0515125-generic, ZenDNN 4.1, TensorFlow= 2.12.1, Python 3.8, AI Model=ResNet50v1.5 (https://github.com/IntelAI/models/) , BF16, Real Time (BS=1) results while maintaining 15ms latency SLA. Test by INTEL as of 09/11/23.

AMD EPYC 9754: 1-node, 2x AMD EPYC 9754 128-Core Processor, 128 cores, SMT On, Turbo On, NUMA 2, Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800 MT/s]),BIOS 1.5., microcode 0xaa00212, 2x Ethernet Controller 10G X550T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 5.15.125-0515125-generic, ZenDNN 4.1, TensorFlow= 2.12.1, Python 3.8, AI Model=ResNet50v1.5 (https://github.com/IntelAI/models/) , BF16, Real Time (BS=1) results while maintaining 15ms latency SLA. Test by INTEL as of 10/26/23.

Batched Results: best scores achieved using (BS>1).

TF: ResNet50v1.5 Test by Intel October 10, 2023, September 11, 2023, October 26, 2023
[A212] 2.1x higher average batched AI performance and performance/watt on 5th Gen Intel Xeon Platinum 8592+ with Intel AMX supporting INT8 vs. AMD EPYC 9654 (Genoa) for AI workloads including Classification, Natural Language Processing, and Recommender.

1.7x higher average batched AI performance and performance/watt on 5th Gen Intel Xeon Platinum 8592+ with Intel AMX supporting INT8 vs. AMD EPYC 9754 (Bergamo) for Industry Standard Frameworks including Classification, Natural Language Processing, and Recommender.

5th Generation Intel® Xeon® Platinum processor Geomean of performance of batched DLRM, BertLARGE, DistilBERT, Resnet50. See A208, A209, A210, A211. Geomean of performance of batched DLRM, BertLARGE, DistilBERT, Resnet50. Test by Intel October 10, 2023, September 11, 2023, October 26, 2023
[D1] Up to 2.06x higher RocksDB performance and 2.05x higher RocksDB performance/watt with 5th Gen Intel Xeon Platinum 8592+ using integrated Intel IAA vs. Zstd

Up to 1.10x higher RocksDB performance and 1.12x higher performance/watt with 5th Gen Intel Xeon Platinum 8592+ using integrated Intel IAA vs. 4th Gen Intel Xeon Platinum 8480+ using integrated Intel IAA

Up to 3.7x higher RocksDB performance and 3.08x higher performance/watt with 5th Gen Intel Xeon Platinum 8592+ using integrated Intel IAA vs. 3rd Gen Intel Xeon Platinum 8380 using Zstd

Up to 5.6x higher RocksDB performance with 5th Gen Intel Xeon Platinum 8592+ using integrated Intel IAA vs. 1st Gen Intel Xeon Platinum 8180 using Zstd

Up to 52% latency reduction on RocksDB with 5th Gen Intel Xeon Platinum 8592+ using integrated Intel IAA vs. 1st Gen Intel Xeon Platinum 8180 using Zstd

Up to 3.4x higher RocksDB Perf/W with 5th Gen Intel Xeon Platinum 8592+ using integrated Intel IAA vs. 1st Gen Intel Xeon Platinum 8180 using Zstd

5th Generation Intel® Xeon® Platinum processor 8592+: 1-node, 2x 5th Gen Intel Xeon Scalable processor 8592+ (64 cores) with integrated Intel In-Memory Analytics Accelerator (Intel IAA), Number of IAA device utilized=8(2 sockets active), HT On, Turbo On, SNC off, Total Memory 1024GB (16x64GB DDR5 5600), microcode 0x21000161, 2x Ethernet Controller 10-Gigabit X540-AT2, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 6.5.0-060500-generic, QPL v1.2.0, accel-config-v4.0, iaa_​compressor plugin v0.3.0, ZSTD v1.5.5, gcc 10.4.0, RocksDB v8.3.0 trunk (commit 62fc15f) (db_​bench), 4 threads per instance, 64 RocksDB instances, tested by Intel October 2023. 8480+: 1-node, Production Intel platform with 2x 4th Gen Intel Xeon Scalable processor (56 cores) with integrated Intel In-Memory Analytics Accelerator (Intel IAA), Number of IAA device utilized=8(2 sockets active), HT On, Turbo On, SNC off, Total Memory 1024GB (16x64GB DDR5 4800), microcode 0x2b0004b1, 2x Ethernet Controller 10-Gigabit X540-AT2, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 6.5.0-060500-generic, QPL v1.2.0, accel-config-v4.0, iaa_​compressor plugin v0.3.0, ZSTD v1.5.5, gcc 10.4.0, RocksDB v8.3.0 trunk (commit 62fc15f) (db_​bench), 4 threads per instance, 56 RocksDB instances, tested by Intel October 2023. 8380: 1-node, Production Intel platform with 2x 3rd Gen Intel Xeon Scalable processor (40 cores) withHT On, Turbo On, SNC off, Total Memory 1024GB (16x64GB DDR5 3200), microcode 0xd0003a5, 2x Ethernet Controller 10-Gigabit X540-AT2, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 6.5.0-060500-generic, ZSTD v1.5.5, gcc 10.4.0, RocksDB v8.3.0 trunk (commit 62fc15f) (db_​bench), 4 threads per instance, 40 RocksDB instances, tested by Intel October 2023. 8180: 1-node, Production Intel platform with 2x 1st Gen Intel Xeon Scalable processor (28 cores) with integrated, HT On, Turbo On, SNC off, Total Memory 768GB (12x64GB DDR4 2666), microcode 0x2007006, 2x Ethernet Connection X722 for 10GBASE-T, 1x 894.3G Micron_​7450_​MTFDKBA960TFR, Ubuntu 22.04.3 LTS, 6.5.0-060500-generic, ZSTD v1.5.5, gcc 10.4.0, RocksDB v8.3.0 trunk (commit 62fc15f) (db_​bench), 4 threads per instance, 28 RocksDB instances, tested by Intel October 2023. RocksDB Test by Intel October 2023
[D2] Up to 1.21x higher ClickHouse performance with 5th Gen Intel Xeon Platinum 8592+ using integrated Intel IAA vs. 4th Gen Intel Xeon Platinum 8480+ using integrated Intel IAA

Up to 1.36x higher ClickHouse Perf/W with 5th Gen Intel Xeon Platinum 8592+ using integrated Intel IAA vs. 4th Gen Intel Xeon Platinum 8480+ using integrated Intel IAA

Up to 1.57x higher ClickHouse performance with 5th Gen Intel Xeon Platinum 8592+ using integrated Intel IAA vs. Zstd

Up to 1.46x higher ClickHouse Perf/W with 5th Gen Intel Xeon Platinum 8592+ using integrated Intel IAA vs. Zstd

Up to 2.49x higher ClickHouse performance with 5th Gen Intel Xeon Platinum 8592+ using integrated Intel IAA vs. 3rd Gen Intel Xeon Platinum 8380 using Zstd

Up to 2.08x higher ClickHouse Perf/W with 5th Gen Intel Xeon Platinum 8592+ using integrated Intel IAA vs. 3rd Gen Intel Xeon Platinum 8380 using Zstd

5th Generation Intel® Xeon® Platinum processor 8592+: 1-node, 2x 5th Gen Intel Xeon Scalable processor 8592+ (64 cores) with integrated Intel In-Memory Analytics Accelerator (Intel IAA), Number of IAA device utilized=4(1 sockets active), HT On, Turbo On, SNC off, Total Memory 1024GB (16x64GB DDR5 5600), microcode 0x21000161, 2x Ethernet Controller 10-Gigabit X540-AT2, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 6.5.0-060500-generic, ZSTD v1.5.0, QPL v1.3dev, accel-config-v4.1.1, clang13, Clickhouse 21dev, Star Schema Benchmark, Query 4.1, tested by Intel October 2023. 8480+: 1-node, Intel platform with 2x 4th Gen Intel Xeon Scalable processor (56 cores) with integrated Intel In-Memory Analytics Accelerator (Intel IAA), Number of IAA device utilized=4(1 sockets active), HT On, Turbo On, SNC off, Total Memory 1024GB (16x64GB DDR5 4800), microcode 0x2b0004b1, 2x Ethernet Controller 10-Gigabit X540-AT2, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 6.5.0-060500-generic, ZSTD v1.5.0, QPL v1.3dev, accel-config-v4.1.1, clang13, Clickhouse 21dev, Star Schema Benchmark, Query 4.1, tested by Intel October 2023. 8380: 1-node, Intel platform with 2x 3rd Gen Intel Xeon Scalable processor (40 cores) withHT On, Turbo On, SNC off, Total Memory 1024GB (16x64GB DDR5 3200), microcode 0xd0003a5, 2x Ethernet Controller 10-Gigabit X540-AT2, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 6.5.0-060500-generic, ZSTD v1.5.0, clang13, Clickhouse 21dev, Star Schema Benchmark, Query 4.1, tested by Intel October 2023. ClickHouse DB Test by Intel October 2023
[D3] Up to 1.18x higher OLTP database transactions on Microsoft SQL Server 2022 on 5th Gen Intel Xeon Scalable platform compared to prior generation 5th Generation Intel® Xeon® Platinum processor 8592+: 1-node, 2x Intel(R) Xeon(R) Platinum 8592 HT On Turbo ON Total Memory 2 TB (32 slots/ 64GB/ 4400 MHz), BIOS: EGSDCRB1.86B.0105.D74.2308261927 (ucode: 0xA1000190), Windows server 21H2 Build 20348.707, OLTP workload, SQL server 2022 CU5 RTM, Test by Intel as of 09/15/2023. 8490H: 1-node, 2xIntel(R) Xeon(R) Platinum 8490H, HT On Turbo On Total Memory 2 TB (32 slots/ 64GB/ 4400 MHz), BIOS: EGSDCRB1.86B.0089.D20.2209251350 (ucode: 0xAB000300), Windows server 2022 Build 20348, OLTP workload type, SQL server 2022 RTM 2022.160.1000.6, Test by Intel as of 11/10/2022. OLTP Brokerage SQL Server Test by Intel September 15, 2023, November 10, 2023
[D4] Up to 1.18x higher Online Analytical Processing workload running Microsoft SQL Server 2022 on 5th Gen Intel® Xeon® Scalable Platform compared to prior generation 5th Generation Intel® Xeon® Platinum processor 8592+: 1-node, 2x Intel(R) Xeon(R) Platinum 8592+ on ArcherCity with 4096 GB (16 slots/ 256GB/ DDR5 4800) total memory, ucode 0xA1000190, HT on, Turbo on, Windows 2022 FE, Build 20348.1129, x 1x 960GB Intel D3-S4510, 8x 7.68TB Intel SSD D7-P5510, Decision support workload, 10TB scale factor, SQL server 2022 CU5 RTM (16.0.4045.3), test by Intel on 10/13/2023. 8490H: 1-node, 2x Intel(R) Xeon(R) Platinum 8490H on ArcherCity with 4096 GB (16 slots/ 256GB/ DDR5 4800) total memory, ucode 0xAB000310, HT on, Turbo on, Windows 2022 FE, Build 20348.1129, x 1x 960GB Intel D3-S4510, 8x 7.68TB Intel SSD D7-P5510, Decision support workload, 10TB scale factor, SQL Server 2022 RTM (16.0.1000.6), test by Intel on 10/27/2022 Decision Support SQL Server Test by Intel October 13, 2023, October 27, 2023
[D5] Up to 1.12x higher MS SQL+Backup Perf/W with 5th Gen Intel Xeon Platinum 8592+ using integrated Intel QATvs. 4th Gen Intel Xeon Platinum 8480+ using integrated Intel QAT

Up to 2.48x higher MS SQL+Backup performance with 5th Gen Intel Xeon Platinum 8592+ using integrated Intel QAT vs. default compression Up to 2.52x higher MS SQL+Backup Perf/W with 5th Gen Intel Xeon Platinum 8592+ using integrated Intel QAT vs. default compression

Up to 2.56x higher MS SQL+Backup performance with 5th Gen Intel Xeon Platinum 8592+ using integrated Intel QAT vs. 3rd Gen Intel Xeon Platinum 8380 using default compression

Up to 2.33x higher MS SQL+Backup Perf/W with 5th Gen Intel Xeon Platinum 8592+ using integrated Intel QAT vs. 3rd Gen Intel Xeon Platinum 8380 using default compression

Up to 2.72x speedup and 1.75x higher perf/W with 5th Gen Intel Xeon Platinum 8592+ using integrated Intel QAT vs. 1st Gen Intel Xeon Platinum 8180 with default compression

5th Generation Intel® Xeon® Platinum processor 8592+: 1-node, 2x 5th Gen Intel Xeon Scalable processor 8592+ (64 cores) with integrated Intel Quick Assist Technology (Intel QAT), Number of IAA device utilized=8(2 sockets active), HT On, Turbo On, SNC off, Total Memory 1024GB (16x64GB DDR5 5600), microcode 0x21000161, 2x Ethernet Controller 10-Gigabit X540-AT2, 7x 3.5T INTEL SSDPE2KE032T807, QATZip 2.0.W.1.9.0-0008, Microsoft Windows Server Datacenter 2022, Microsoft SQL Server 2022, SQL Server Management Studio 19.0.1, HammerDB 4.5, tested by Intel October 2023. 8480+: 1-node, Intel platform with 2x 4th Gen Intel Xeon Scalable processor (56 cores) with integrated Intel In-Memory Analytics Accelerator (Intel IAA), Number of IAA device utilized=4(1 sockets active), HT On, Turbo On, SNC off, Total Memory 1024GB (16x64GB DDR5 4800), microcode 0x2b0004b1, 2x Ethernet Controller 10-Gigabit X540-AT2, 7x 3.5T INTEL SSDPE2KE032T807, QATZip 2.0.W.1.9.0-0008, Microsoft Windows Server Datacenter 2022, Microsoft SQL Server 2022, SQL Server Management Studio 19.0.1, HammerDB 4.5, tested by Intel October 2023. 8380: 1-node, Intel platform with 2x 3rd Gen Intel Xeon Scalable processor (40 cores) withHT On, Turbo On, SNC off, Total Memory 1024GB (16x64GB DDR5 3200), microcode 0xd0003a5, 2x Ethernet Controller 10-Gigabit X540-AT2, 7x 3.5T INTEL SSDPE2KE032T807, Microsoft Windows Server Datacenter 2022, Microsoft SQL Server 2022, SQL Server Management Studio 19.0.1, HammerDB 4.5, tested by Intel October 2023. 8180: 1-node, Intel platform with 2x 1st Gen Intel Xeon Scalable processor (28 cores), HT On, Turbo On, SNC off, Total Memory 768GB (12x64GB DDR4 2666), microcode 0x2007006, 2x Ethernet Connection X722 for 10GBASE-T, 7x 3.5T INTEL SSDPE2KE032T807, Microsoft Windows Server Datacenter 2022, Microsoft SQL Server 2022, SQL Server Management Studio 19.0.1, HammerDB 4.5, tested by Intel October 2023. HammerDB w/SQL Server + Backup Test by Intel October 2023
[D6] Up to 1.24x higher HammerDB MySQL OLTP performance and 1.3x higher HammerDB MySQL OLTP performance/watt with the 5th Gen Intel® Xeon® Platinum 8592+ processor vs. prior generation

Up to 1.84x higher HammerDB MySQL OLTP performance and 1.53x higher HammerDB MySQL OLTP performance/watt with the 5th Gen Intel® Xeon® Platinum 8592+ processor vs. 3-year Refresh Platform

Up to 3.2x higher HammerDB MySQL OLTP performance and 1.9x higher HammerDB MySQL OLTP performance/watt with the 5th Gen Intel® Xeon® Platinum 8592+ processor vs. 5-year Refresh Platform.

5th Generation Intel® Xeon® Platinum processor 8592+: 1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores, HT On, Turbo On, NUMA 2, Integrated Accelerators Available [used]: DLB 8 [0], DSA 8 [0], IAX 8 [0], QAT 8 [0], Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 2.0, microcode 0x21000161, 2x Ethernet Controller X710 for 10GBASE-T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, 2x 1.7T SAMSUNG MZWLJ1T9HBJR-00007, Ubuntu 22.04.3 LTS, 5.15.0-84-generic, HammerDB Multi Instance, MySQL 8.0.33. Test by Intel as of 10/04/23. 8480+: 1-node, 2x Intel(R) Xeon(R) Platinum 8480+, 56 cores, HT On, Turbo On, NUMA 2, Integrated Accelerators Available [used]: DLB 8 [0], DSA 8 [0], IAX 8 [0], QAT 8 [0], Total Memory 1024GB (16x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 2.0, microcode 0x2b0004d0, 2x Ethernet Controller X710 for 10GBASE-T, 2x 1.7T SAMSUNG MZWLJ1T9HBJR-00007, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 5.15.0-84-generic, HammerDB Multi Instance, MySQL 8.0.33, as of 09/30/23. 8380: 1-node, 2x Intel(R) Xeon(R) Platinum 8380 CPU @ 2.30GHz, 40 cores, HT On, Turbo On, NUMA 2, Integrated Accelerators Available [used]: DLB 0 [0], DSA 0 [0], IAX 0 [0], QAT 0 [0], Total Memory 1024GB (16x64GB DDR4 3200 MT/s [3200 MT/s]), BIOS 1.4, microcode 0xd0003a5, 2x Ethernet Controller 10-Gigabit X540-AT2, 2x Ethernet Controller X710 for 10GBASE-T, 1x 894.3G INTEL SSDSC2KG96, Ubuntu 22.04.3 LTS, 5.15.0-84-generic, HammerDB Multi Instance, MySQL 8.0.33, Test by Intel as of 10/05/23. 8180M :1-node, 2x Intel(R) Xeon(R) Platinum 8180M CPU @ 2.50GHz, 28 cores, HT On, Turbo On, NUMA 2, Integrated Accelerators Available [used]: DLB 0 [0], DSA 0 [0], IAX 0 [0], QAT 0 [0], Total Memory 768GB (12x64GB DDR4 2666 MT/s [2666 MT/s]), BIOS 3.8b, microcode 0x2007006, 2x Ethernet Connection X722 for 10GBASE-T, 2x Ethernet Controller X710 for 10GBASE-T, 2x 1.7T SAMSUNG MZWLJ1T9HBJR-00007, 1x 894.3G Micron_​7450_​MTFDKBA960TFR, Ubuntu 22.04.3 LTS, 5.15.0-84-generic, HammerDB Multi Instance, MySQL 8.0.33. Test by Intel as of 10/17/23. OLTP Performance on MySQL* Database Test by Intel between September to October 2023
[D7] Up to 2.7x higher query throughput with 5th Gen Intel Xeon Platinum 8592+ processor compared to 2nd Gen Intel Xeon Scalable Processor 5th Generation Intel® Xeon® Platinum processor 5th Gen Intel Xeon Processor (Emerald Rapids) Node Configuration 1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores, HT On, Turbo On, NUMA 2, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 3B05.TEL4P1, microcode 0x21000161, 2x Ethernet Controller 10-Gigabit X540-AT2, 1x 1.7T INTEL SSDSC2KG019T8, 4x 3.5T INTEL SSDPF2KX038TZ, Red Hat Enterprise Linux 9.2 (Plow), 5.14.0-284.30.1.el9_​2.x86_​64, Test by Intel as of 11/13/23. 2nd Gen Intel Xeon Processor (Cascade Lake) Node Configuration 1-node, 2x Intel(R) Xeon(R) Platinum 8280M CPU @ 2.70GHz, 28 cores, HT On, Turbo On, NUMA 4, Total Memory 768GB (24x32GB DDR4 3200 MT/s [2666 MT/s]), BIOS SE5C620.86B.02.01.0016.032120230338, microcode 0x4003604, 2x Ethernet Connection X722 for 10GBASE-T, 1x 931.5G WDC WDS100T2B0B-00YS70, 4x 2.9T INTEL SSDPE2KE032T8, Red Hat Enterprise Linux 9.2 (Plow), 5.14.0-284.30.1.el9_​2.x86_​64, Test by Intel as of 11/15/23. Lakehouse - IBM watsonx.data - IBM Big Data Insights Test by Intel November 13, 2023, November 15, 2023
[D8] Up to to 2.5x higher query throughput with 5th Gen Intel Xeon Platinum 8592+ processor compared to 2nd Gen Intel Xeon Scalable Processor 5th Generation Intel® Xeon® Platinum processor 5th Gen Intel Xeon Processor (Emerald Rapids) Node Configuration 1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores, HT On, Turbo On, NUMA 2, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 3B05.TEL4P1, microcode 0x21000161, 2x Ethernet Controller 10-Gigabit X540-AT2, 1x 1.7T INTEL SSDSC2KG019T8, 4x 3.5T INTEL SSDPF2KX038TZ, Red Hat Enterprise Linux 9.2 (Plow), 5.14.0-284.30.1.el9_​2.x86_​64, Test by Intel as of 11/13/23. 2nd Gen Intel Xeon Processor (Cascade Lake) Node Configuration 1-node, 2x Intel(R) Xeon(R) Platinum 8280M CPU @ 2.70GHz, 28 cores, HT On, Turbo On, NUMA 4, Total Memory 768GB (24x32GB DDR4 3200 MT/s [2666 MT/s]), BIOS SE5C620.86B.02.01.0016.032120230338, microcode 0x4003604, 2x Ethernet Connection X722 for 10GBASE-T, 1x 931.5G WDC WDS100T2B0B-00YS70, 4x 2.9T INTEL SSDPE2KE032T8, Red Hat Enterprise Linux 9.2 (Plow), 5.14.0-284.30.1.el9_​2.x86_​64, Test by Intel as of 11/15/23. IBM Db2 Warehouse -IBM Big Data Insights Test by Intel November 13, 2023, November 15, 2023
[D201] Up to 1.62x higher RocksDB performance with 5th Gen Intel Xeon Platinum 8592+ using integrated Intel IAA vs. 4th Gen AMD EPYC 9554 using Zstd

Up to 32% latency reduction on Rocks DB with 5th Gen Intel Xeon Platinum 8592+ using integrated Intel IAA vs. 4th Gen AMD EPYC 9554 using Zstd

Up to 1.72x higher RocksDB Perf/W with 5th Gen Intel Xeon Platinum 8592+ using integrated Intel IAA vs. 4th Gen AMD EPYC 9554 using Zstd

5th Generation Intel® Xeon® Platinum processor 8592+: 1-node, 2x 5th Gen Intel Xeon Scalable processor 8592+ (64 cores) with integrated Intel In-Memory Analytics Accelerator (Intel IAA), Number of IAA device utilized=8(2 sockets active), HT On, Turbo On, SNC off, Total Memory 1024GB (16x64GB DDR5 5600), microcode 0x21000161, 2x Ethernet Controller 10-Gigabit X540-AT2, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 6.5.0-060500-generic, QPL v1.2.0, accel-config-v4.0, iaa_​compressor plugin v0.3.0, ZSTD v1.5.5, gcc 10.4.0, RocksDB v8.3.0 trunk (commit 62fc15f) (db_​bench), 4 threads per instance, 64 RocksDB instances, tested by Intel October 2023. 9554: 1-node, AMD platform with 2x 4th Gen AMD EPYC processor (64 cores), SMT On, Core Performance Boost On, NPS1, Total Memory 1024GB (16x64GB DDR5 4800), microcode 0xa10113e, 2x Ethernet Controller 10G X550T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 6.5.0-060500-generic, ZSTD v1.5.5, gcc 10.4.0, RocksDB v8.3.0 trunk (commit 62fc15f) (db_​bench), 4 threads per instance, 28 RocksDB instances, tested by Intel October 2023. RocksDB with IAA Test by Intel October 2023
[D202] Up to 1.15x higher ClickHouse performance with 5th Gen Intel Xeon Platinum 8592+ using integrated Intel IAA vs. 4th Gen AMD EPYC 9554 using Zstd

Up to 1.11x higher ClickHouse Perf/W with 5th Gen Intel Xeon Platinum 8592+ using integrated Intel IAA vs. 4th Gen AMD EPYC 9554 using Zstd

5th Generation Intel® Xeon® Platinum processor 8592+: 1-node, 2x 5th Gen Intel Xeon Scalable processor 8592+ (64 cores) with integrated Intel In-Memory Analytics Accelerator (Intel IAA), Number of IAA device utilized=4(1 sockets active), HT On, Turbo On, SNC off, Total Memory 1024GB (16x64GB DDR5 5600), microcode 0x21000161, 2x Ethernet Controller 10-Gigabit X540-AT2, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 6.5.0-060500-generic, ZSTD v1.5.0, QPL v1.3dev, accel-config-v4.1.1, clang13, Clickhouse 21dev, Star Schema Benchmark, Query 4.1, tested by Intel October 2023. 9554: 1-node, AMD platform with 2x 4th Gen AMD EPYC processor (64 cores), SMT On, Core Performance Boost On, NPS1, Total Memory 1024GB (16x64GB DDR5 4800), microcode 0xa10113e, 2x Ethernet Controller 10G X550T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 6.5.0-060500-generic, ZSTD v1.5.0, clang13, Clickhouse 21dev, Star Schema Benchmark, Query 4.1, tested by Intel October 2023. ClickHouse DB with IAA Test by Intel October 2023
[D203] Up to 1.70x higher HammerDB MySQL OLTP performance with 5th Gen Intel Xeon Platinum 8592+ vs. 4th Gen AMD EPYC 9554.

Up to 1.43x higher HammerDB MySQL OLTP Perf/W with 5th Gen Intel Xeon Platinum 8592+ using integrated vs. 4th Gen AMD EPYC 9554.

5th Generation Intel® Xeon® Platinum processor 1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores, HT On, Turbo On, NUMA 2, Integrated Accelerators Available [used]: DLB 8 [0], DSA 8 [0], IAX 8 [0], QAT 8 [0], Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 2.0, microcode 0x21000161, 2x Ethernet Controller X710 for 10GBASE-T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, 2x 1.7T SAMSUNG MZWLJ1T9HBJR-00007, Ubuntu 22.04.3 LTS, 5.15.0-84-generic, HammerDB Mv4.4, MySQL 8.0.33. Test by Intel as of 10/04/23. 1-node, 2x AMD EPYC 9554 64-Core Processor, 64 cores, HT On, Turbo On, NUMA 2, Integrated Accelerators Available [used]: DLB 0 [0], DSA 0 [0], IAX 0 [0], QAT 0 [0], Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 1.5, microcode 0xa10113e, 2x Ethernet Controller X710 for 10GBASE-T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, 2x 1.7T SAMSUNG MZWLJ1T9HBJR-00007, Ubuntu 22.04.3 LTS, 5.15.125-0515125-generic, HammerDB v4.4, MySQL 8.0.33. Test by Intel as of 10/05/23. HammerDB MySQL Test by Intel October 4, 2023 October 5, 2023
[D204] Up to 1.93x speedup and 1.64x higher perf/W for HammerDB Microsoft SQL Server 2022 and backup compression with 5th Gen Intel Xeon Platinum 8592+ using integrated Intel QAT vs. 4th Gen AMD EPYC 9554 using default compression. 5th Generation Intel® Xeon® Platinum processor 8592+: 1-node, 2x 5th Gen Intel Xeon Scalable processor 8592+ (64 cores) with integrated Intel Quick Assist Technology (Intel QAT), Number of IAA device utilized=8(2 sockets active), HT On, Turbo On, SNC off, Total Memory 1024GB (16x64GB DDR5 5600), microcode 0x21000161, 2x Ethernet Controller 10-Gigabit X540-AT2, 7x 3.5T INTEL SSDPE2KE032T807, QATZip 2.0.W.1.9.0-0008, Microsoft Windows Server Datacenter 2022, Microsoft SQL Server 2022, SQL Server Management Studio 19.0.1, HammerDB 4.5, tested by Intel October 2023. 9554: 1-node, AMD platform with 2x 4th Gen AMD EPYC processor (64 cores), SMT On, Core Performance Boost On, NPS1, Total Memory 1536GB (24x64GB DDR5 4800), microcode 0xa10113e, 2x Ethernet Controller 10G X550T, 7x 3.5T INTEL SSDPE2KE032T807, Microsoft Windows Server Datacenter 2022, Microsoft SQL Server 2022, SQL Server Management Studio 19.0.1, HammerDB 4.5, tested by Intel October 2023. OLTP Brokerage - MS SQL Server plus Backup Test by Intel October 2023
[E1] Up to 1.59x average performance gain with 5th Gen Intel Xeon Gold 6548Y+ processor vs. 3rd Gen Intel Xeon Gold 6348 5th Generation Intel® Xeon® Platinum processor Geomean of SPECrate2017_​fp_​base (est), SPECrate2017_​int_​base (est). 6548Y+: 1-node, 2x INTEL(R) XEON(R) GOLD 6548Y+, 32 cores, HT On, Turbo On, NUMA 4, Integrated Accelerators Available [used]: DLB 2 [0], DSA 2 [0], IAA 2 [0], QAT 2 [0], Total Memory 512GB (16x32GB DDR5 4800 MT/s [4800 MT/s]), BIOS EGSDREL1.SYS.0105.D74.2308261931, microcode 0x21000161, 1x Ethernet Controller I225-LM, 1x 931.5G WD Green 2.5 1000GB, 1x 931.5G CT1000MX500SSD1, CentOS Stream 9, 6.2.0,SpecCPU2017 ICC23.2.3, avx512 instruction Estimated based on measurement on Intel internal reference platforms as of 11/23/23. 6348: 1-node, 2x Intel(R) Xeon(R) Gold 6348 CPU @ 2.60GHz, 28 cores, HT On, Turbo On, NUMA 4, Integrated Accelerators Available [used]: DLB 0 [0], DSA 0 [0], IAA 0 [0], QAT 0 [0], Total Memory 512GB (16x32GB DDR4 3200 MT/s [3200 MT/s]), BIOS SE5C620.86B.01.01.0008.2305172341, microcode 0xd0003a5, 2x Ethernet Controller X710 for 10GBASE-T, 1x 1.7T SAMSUNG MZ1L21T9HCLS-00A07, CentOS Stream 9, 6.2.0, SpecCPU2017 ICC23.2.3, avx512 instruction Estimated based on measurement on Intel internal reference platforms as of 11/23/23. Geomean SIR + SFR Performance Test by Intel November 23, 2023
[E2] Up to 1.29x average performance/watt gain with 5th Gen Intel Xeon Gold 6548Y+ processor vs. 3rd Gen Intel Xeon Gold 6348 5th Generation Intel® Xeon® Platinum processor Geomean of SPECrate2017_​fp_​base (est), SPECrate2017_​int_​base (est) performance/watt 6548Y+: 1-node, 2x INTEL(R) XEON(R) GOLD 6548Y+, 32 cores, HT On, Turbo On, NUMA 4, Integrated Accelerators Available [used]: DLB 2 [0], DSA 2 [0], IAA 2 [0], QAT 2 [0], Total Memory 512GB (16x32GB DDR5 4800 MT/s [4800 MT/s]), BIOS EGSDREL1.SYS.0105.D74.2308261931, microcode 0x21000161, 1x Ethernet Controller I225-LM, 1x 931.5G WD Green 2.5 1000GB, 1x 931.5G CT1000MX500SSD1, CentOS Stream 9, 6.2.0,SpecCPU2017 ICC23.2.3, avx512 instruction Estimated based on measurement on Intel internal reference platforms as of 11/23/23. 6348: 1-node, 2x Intel(R) Xeon(R) Gold 6348 CPU @ 2.60GHz, 28 cores, HT On, Turbo On, NUMA 4, Integrated Accelerators Available [used]: DLB 0 [0], DSA 0 [0], IAA 0 [0], QAT 0 [0], Total Memory 512GB (16x32GB DDR4 3200 MT/s [3200 MT/s]), BIOS SE5C620.86B.01.01.0008.2305172341, microcode 0xd0003a5, 2x Ethernet Controller X710 for 10GBASE-T, 1x 1.7T SAMSUNG MZ1L21T9HCLS-00A07, CentOS Stream 9, 6.2.0, SpecCPU2017 ICC23.2.3, avx512 instruction Estimated based on measurement on Intel internal reference platforms as of 11/23/23. Geomean SIR+SFR Perf/watt Test by Intel November 23, 2023
[E3] Up to 2.81x higher real-time inference performance for Image Classification with Intel OpenVINO on 5th Gen Intel® Xeon® Gold 6548Y+ processor vs. 3rd Gen Intel Xeon Gold 6348 5th Generation Intel® Xeon® Platinum processor 6548Y+: 1-node, 2x INTEL(R) XEON(R) GOLD 6548Y+, 32 cores, HT On, Turbo On, NUMA 2, Integrated Accelerators Available [used]: DLB 2 [0], DSA 2 [0], IAA 2 [0], QAT 2 [0], Total Memory 512GB (16x32GB DDR5 4800 MT/s [4800 MT/s]), BIOS EGSDREL1.SYS.0105.D74.2308261931, microcode 0x21000161, 1x Ethernet Controller I225-LM, 1x 931.5G WD Green 2.5 1000GB, 1x 931.5G CT1000MX500SSD1, CentOS Stream 9, 6.2.0, OpenVino Ver 2023.1.0 benchmark_​app for Resnet50. INT8, BS=1 Test by Intel as of 10/19/23. 6348: 1-node, 2x Intel(R) Xeon(R) Gold 6348 CPU @ 2.60GHz, 28 cores, HT On, Turbo On, NUMA 2, Integrated Accelerators Available [used]: DLB 0 [0], DSA 0 [0], IAA 0 [0], QAT 0 [0], Total Memory 512GB (16x32GB DDR4 3200 MT/s [3200 MT/s]), BIOS SE5C620.86B.01.01.0008.2305172341, microcode 0xd0003a5, 2x Ethernet Controller X710 for 10GBASE-T, 1x 1.7T SAMSUNG MZ1L21T9HCLS-00A07, CentOS Stream 9, 6.2.0, OpenVino Ver 2023.1.0 benchmark_​app for Resnet50. INT8, BS=1 Test by Intel as of 10/19/23. ResNet50-v1-5 image classifcation 3-Year refresh platform (INT8, BS=1) Test by Intel October 19, 2023
[E4] Up to 5.28x higher real-time inference performance for Object Detection with Intel OpenVINO on 5th Gen Intel® Xeon® Gold 6548Y+ processor vs. 3rd Gen Intel Xeon Gold 6348. 5th Generation Intel® Xeon® Platinum processor 6548Y+: 1-node, 2x INTEL(R) XEON(R) GOLD 6548Y+, 32 cores, HT On, Turbo On, NUMA 2, Integrated Accelerators Available [used]: DLB 2 [0], DSA 2 [0], IAA 2 [0], QAT 2 [0], Total Memory 512GB (16x32GB DDR5 4800 MT/s [4800 MT/s]), BIOS EGSDREL1.SYS.0105.D74.2308261931, microcode 0x21000161, 1x Ethernet Controller I225-LM, 1x 931.5G WD Green 2.5 1000GB, 1x 931.5G CT1000MX500SSD1, CentOS Stream 9, 6.2.0, OpenVino Ver 2023.1.0 benchmark_​app for SSD-Resnet34. INT8, BS=1 Test by Intel as of 10/19/23. 6348: 1-node, 2x Intel(R) Xeon(R) Gold 6348 CPU @ 2.60GHz, 28 cores, HT On, Turbo On, NUMA 2, Integrated Accelerators Available [used]: DLB 0 [0], DSA 0 [0], IAA 0 [0], QAT 0 [0], Total Memory 512GB (16x32GB DDR4 3200 MT/s [3200 MT/s]), BIOS SE5C620.86B.01.01.0008.2305172341, microcode 0xd0003a5, 2x Ethernet Controller X710 for 10GBASE-T, 1x 1.7T SAMSUNG MZ1L21T9HCLS-00A07, CentOS Stream 9, 6.2.0, OpenVino Ver 2023.1.0 benchmark_​app for SSD-Resnet34. INT8, BS=1 Test by Intel as of 10/19/23. SSD-ResNet34 obj detection 3-year refresh platform (INT8, BS=1) Test by Intel October 19, 2023
[E5] Up to 3.13x higher real-time inference performance for Image Classification on ResNet-50 with TensorFlow on 5th Gen Intel Xeon Gold 6548Y+ processor vs. AMD EPYC™ 9334 5th Generation Intel® Xeon® Platinum processor 6548Y+: 1-node, 2x INTEL(R) XEON(R) GOLD 6548Y+, 32 cores, HT On, Turbo On, NUMA 2, Integrated Accelerators Available [used]: DLB 2 [0], DSA 2 [0], IAA 2 [0], QAT 2 [0], Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5200 MT/s]), BIOS 3B05.TEL4P1, microcode 0x21000161, 2x Ethernet Controller X710 for 10GBASE-T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 5.15.0-78-generic, ResNet50v1.5 Intel TensorFlow 2.13. INT8, BS=N Test by INTEL as of 10/25/23 9334: 1-node, 2x AMD EPYC 9334 32-Core Processor, 32 cores, HT On, Turbo On, NUMA 2, Integrated Accelerators Available [used]: DLB 0 [0], DSA 0 [0], IAA 0 [0], QAT 0 [0], Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 1.5, microcode 0xa10113e, 2x Ethernet Controller 10G X550T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 5.15.125-0515125-generic, ResNet50v1.5 ZenDNN 4.1 TensorFlow 2.12.1. INT8, BS=N Test by INTEL as of 10/23/23. ResNet50-v1-5 image classifcation vs AMD EPYC 9334 (INT8, BS=N) Test by Intel October 25, 2023 , October 23, 2023
[E6] up to 2.1x more video analytic streams with 5th Gen Intel Xeon Gold 6548Y+ vs Intel Xeon Gold 6348 5th Generation Intel® Xeon® Platinum processor 6548Y+: 1-node, 2x INTEL(R) XEON(R) GOLD 6548Y+, 32 cores, HT On, Turbo On, NUMA 2, Integrated Accelerators Available [used]: DLB 2 [0], DSA 2 [0], IAX 2 [0], QAT 2 [0], Total Memory 256GB (16x16GB DDR5 4800 MT/s [4800 MT/s]), BIOS EGSDCRB1.SYS.0105.D74.2308261931, microcode 0x21000161, 1x Ethernet Controller I225-LM, 1x 931.5G Samsung SSD 970 EVO Plus 1TB, Red Hat Enterprise Linux 9.2 (Plow), 5.14.0-284.11.1.el9_​2.x86_​64, gcc (GCC) 11.3.1, VES 2023WW37. HEVC H.265, Test by Intel as of 10/16/23. 6348: 1-node, 2x Intel(R) Xeon(R) Gold 6348 CPU @ 2.60GHz, 28 cores, HT On, Turbo On, NUMA 2, Integrated Accelerators Available [used]: DLB 0 [0], DSA 0 [0], IAX 0 [0], QAT 0 [0], Total Memory 256GB (16x16GB DDR4 3200 MT/s [3200 MT/s]), BIOS WLYDCRB1.SYS.0030.P41.2309150558, microcode 0xd0003d1, 1x I210 Gigabit Network Connection, 1x 894.3G INTEL SSDSCKKB960G8, Red Hat Enterprise Linux 9.2 (Plow), 5.14.0-284.11.1.el9_​2.x86_​64, gcc (GCC) 11.3.1, VES 2023WW37. HEVC H.265, Test by Intel as of 10/16/23. Video Edge Server Test by Intel October 16, 2023
[E7] Up to 2.0x more video analytic streams for frictionless retail checkout with 5th Gen Intel Xeon Gold 6548Y+ vs Intel Xeon Gold 6348 5th Generation Intel® Xeon® Platinum processor 6548Y+: 1-node, 2x INTEL(R) XEON(R) GOLD 6548Y+, 32 cores, HT On, Turbo On, NUMA 2, Integrated Accelerators Available [used]: DLB 2 [0], DSA 2 [0], IAX 2 [0], QAT 2 [0], Total Memory 256GB (16x16GB DDR5 4800 MT/s [4800 MT/s]), BIOS EGSDCRB1.SYS.0105.D74.2308261931, microcode 0x21000161, 1x Ethernet Controller I225-LM, 1x 931.5G Samsung SSD 970 EVO Plus 1TB, Red Hat Enterprise Linux 9.2 (Plow), 5.14.0-284.11.1.el9_​2.x86_​64, gcc (GCC) 11.3.1, FRC 2023WW37. Test by Intel as of 10/16/23. 6348: 1-node, 2x Intel(R) Xeon(R) Gold 6348 CPU @ 2.60GHz, 28 cores, HT On, Turbo On, NUMA 2, Integrated Accelerators Available [used]: DLB 0 [0], DSA 0 [0], IAX 0 [0], QAT 0 [0], Total Memory 256GB (16x16GB DDR4 3200 MT/s [3200 MT/s]), BIOS WLYDCRB1.SYS.0030.P41.2309150558, microcode 0xd0003d1, 1x I210 Gigabit Network Connection, 1x 894.3G INTEL SSDSCKKB960G8, Red Hat Enterprise Linux 9.2 (Plow), 5.14.0-284.11.1.el9_​2.x86_​64, gcc (GCC) 11.3.1, FRC 2023WW37.Test by Intel as of 10/16/23. Frictionless Retail Checkout Test by Intel October 16, 2023
[G1] 1.21x average general compute performance gain with 5th Gen Intel Xeon Platinum 8592+ processor over prior generation Intel Xeon Platinum 8480+

1.84x average general compute performance gain with 5th Gen Intel Xeon Platinum 8592+ processor over 3rd Gen Intel Xeon Platinum 8380

2.8x average general compute performance gain with 5th Gen Intel Xeon Platinum 8592+ processor over Intel Xeon Platinum 8180

5th Generation Intel® Xeon® Platinum processor Geomean of HP Linpack, STREAM Triad, SPECrate2017_​fp_​base (est), SPECrate2017_​int_​base (est). 8592+: 1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS EGSDCRB1.SYS.0105.D74.2308261931, microcode 0x21000170, 1x Ethernet Controller I225-LM, 1x 7T INTEL SSDPF2KX076TZ, Ubuntu 22.04.3 LTS, 5.15.0-84-generic. Test by Intel as of Nov 2023 8480+: 1-node, 2x Intel(R) Xeon(R) Platinum 8480+, 56 cores, Total Memory 1024GB (16x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS EGSDCRB1.SYS.0037.P02.2305261001, microcode 0x2b0004b1, 1x Ethernet Controller I225-LM, 1x 1.5T INTEL SSDPF21Q016TB, Ubuntu 22.04.1 LTS, 5.15.0-83-generic. Test by Intel as of Nov 2023 8380: 1-node, 2x Intel(R) Xeon(R) Platinum 8380 CPU @ 2.30GHz, 40 cores, Total Memory 1024GB (16x64GB DDR4 3200 MT/s [3200 MT/s]), BIOS SE5C620.86B.01.01.0008.2305172341, microcode 0xd0003a5, 2x Ethernet Controller X710 for 10GBASE-T, 2x 1.5T INTEL SSDPF21Q016TB, Ubuntu 22.04.2 LTS, 5.15.0-83-generic. Test by Intel as of Nov 2023 8180: 1-node, 2x Intel(R) Xeon(R) Platinum 8180 CPU @ 2.50GHz, 28 cores, Total Memory 192GB (12x16GB DDR4 2666 MT/s [2666 MT/s]), BIOS SE5C620.86B.02.01.0016.032120230338, microcode 0x2007006, 2x Ethernet Connection X722 for 10GBASE-T, 1x 372.6G INTEL SSDSC2BA40, Ubuntu 22.04.3 LTS, 5.15.0-84-generic. Test by Intel as of Nov 2023 Software Configuration: Integer, FP Throughput: HT on, Turbo on, est. SPEC CPU2017 v1.1.8, GCC 12.1 Memory Bandwidth: HT off, Turbo on, STREAM version 5.10, OneAPI 2022.1 LINPACK: HT off, Turbo on, HPLinpack 2.3, OneAPI 2023.2 Geomean SPECcpu rate, Stream Triad, Linpack Test by Intel November 2023
[G5] Up to 1.13x higher memory bandwidth on 5th Gen Intel Xeon Platinum 8592+ processor vs. prior generation. 5th Generation Intel® Xeon® Platinum processor 8592+: 1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS EGSDCRB1.SYS.0105.D74.2308261931, microcode 0x21000170, 1x Ethernet Controller I225-LM, 1x 7T INTEL SSDPF2KX076TZ, Ubuntu 22.04.3 LTS, 5.15.0-84-generic. Test by Intel as of 09/26/23. 8480+: 1-node, 2x Intel(R) Xeon(R) Platinum 8480+, 56 cores, Total Memory 1024GB (16x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS EGSDCRB1.SYS.0037.P02.2305261001, microcode 0x2b0004b1, 1x Ethernet Controller I225-LM, 1x 1.5T INTEL SSDPF21Q016TB, Ubuntu 22.04.1 LTS, 5.15.0-83-generic. Test by Intel as of 09/18/23. Memory Bandwidth: HT off, Turbo on, NUMA 4/8 on 8592+/8480+ STREAM version 5.10, OneAPI 2022.1 Stream Triad Test by Intel September 26, 2023, September 18, 2023
[G7] Up to 1.21x higher integer throughput performance on 5th Gen Intel Xeon Platinum 8592+ processor vs. prior generation.

Up to 1.23x higher floating point throughput performance on 5th Gen Intel Xeon Platinum 8592+ processor vs. prior generation.

5th Generation Intel® Xeon® Platinum processor 8592+: 1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS EGSDCRB1.SYS.0105.D74.2308261931, microcode 0x21000170, 1x Ethernet Controller I225-LM, 1x 7T INTEL SSDPF2KX076TZ, Ubuntu 22.04.3 LTS, 5.15.0-84-generic. Test by Intel as of 09/26/23. 8480+: 1-node, 2x Intel(R) Xeon(R) Platinum 8480+, 56 cores, Total Memory 1024GB (16x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS EGSDCRB1.SYS.0037.P02.2305261001, microcode 0x2b0004b1, 1x Ethernet Controller I225-LM, 1x 1.5T INTEL SSDPF21Q016TB, Ubuntu 22.04.1 LTS, 5.15.0-83-generic. Test by Intel as of 09/18/23 Integer, FP Throughput: HT on, Turbo on, NUMA 4/8 on 8592+/8480+, est. SPEC CPU2017 v1.1.9, OneAPI 2023.2 Integer & floating point throughput - SPECcpu2017 rate [est] Test by Intel September 26, 2023, September 18, 2023
[G8] Up to 1.05x higher integer speed performance on 5th Gen Intel Xeon Platinum 8592+ processor vs. prior generation.

Up to 1.11x higher floating point speed performance on 5th Gen Intel Xeon Platinum 8592+ processor vs. prior generation.

5th Generation Intel® Xeon® Platinum processor 8592+: 1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS EGSDCRB1.SYS.0105.D74.2308261931, microcode 0x21000170, 1x Ethernet Controller I225-LM, 1x 7T INTEL SSDPF2KX076TZ, Ubuntu 22.04.3 LTS, 5.15.0-84-generic. Test by Intel as of 09/26/23. 8480+: 1-node, 2x Intel(R) Xeon(R) Platinum 8480+, 56 cores, Total Memory 1024GB (16x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS EGSDCRB1.SYS.0037.P02.2305261001, microcode 0x2b0004b1, 1x Ethernet Controller I225-LM, 1x 1.5T INTEL SSDPF21Q016TB, Ubuntu 22.04.1 LTS, 5.15.0-83-generic. Test by Intel as of 09/18/23 Integer, FP Throughput: HT on, Turbo on, NUMA 4/8 on 8592+/8480+, est. SPEC CPU2017 v1.1.9, OneAPI 2023.2 Integer & floating point speed - SPECcpu2017 speed [est] Test by Intel September 26, 2023, September 18, 2023
[G9] Up to 1.26x higher LINPACK performance on 5th Gen Intel Xeon Platinum 8592+ processor vs. prior generation. 5th Generation Intel® Xeon® Platinum processor 8592+: 1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS EGSDCRB1.SYS.0105.D74.2308261931, microcode 0x21000170, 1x Ethernet Controller I225-LM, 1x 7T INTEL SSDPF2KX076TZ, Ubuntu 22.04.3 LTS, 5.15.0-84-generic. Test by Intel as of 09/26/23. 8480+: 1-node, 2x Intel(R) Xeon(R) Platinum 8480+, 56 cores, Total Memory 1024GB (16x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS EGSDCRB1.SYS.0037.P02.2305261001, microcode 0x2b0004b1, 1x Ethernet Controller I225-LM, 1x 1.5T INTEL SSDPF21Q016TB, Ubuntu 22.04.1 LTS, 5.15.0-83-generic. Test by Intel as of 09/18/23. LINPACK: HT off, Turbo on, NUMA 2/2 on 8592+//8480+, HPLinpack 2.3, OneAPI 2023.2 Intel® Distribution for LINPACK Test by Intel September 26, 2023, September 18, 2023
[G10] 15% IPC Improvement with 5th Gen Intel Xeon Scalable Processor vs. 4th Gen Intel Xeon Scalable Processor 5th Generation Intel® Xeon® Platinum processor Results have been estimated or simulated. Performance comparison between Emarald Rapids and Sapphire Rapids at same core count, same frequency, same compiler. IPC Test by Intel December, 2023
[G11] Up to 3x Increased Last level Cache with 5th Gen Intel Xeon Scalable Processor vs. 4th Gen Intel Xeon Scalable Processor 5th Generation Intel® Xeon® Platinum processor 5th Gen Xeon enhancements(select SKUs) are compared to 4th Gen Intel® Xeon® Platinum processor 8480+ Cache Test by Intel December, 2023
[G12] Up to 1.16x Memory Bandwidth Improvement on 5th Gen Intel Xeon Scalable Processor vs. 4th Gen Intel Xeon Scalable Processor. 5th Generation Intel® Xeon® Platinum processor Results have been estimated or simulated. Comparing 5th Gen Intel® Xeon® Scalable processor with 8 memory-channels running at up to 5600MT/s vs. 4th Gen Intel® Xeon® Scalable processor [Sapphire Rapids] with 8 memory-channels running at up to 4800MT/s. Theoretical Memory Bandwidth Test by Intel December, 2023
[H1] Up to 1.22x higher average HPC performance and 1.08x higher average performance/watt on 5th Gen Intel Xeon Scalable platform vs. prior gen

Up to 1.19x higher average Industry Standard performance on 5th Gen Intel Xeon Scalable platform vs. prior gen

Up to 1.26x higher Earth System Model HPC performance on 5th Gen Intel Xeon Scalable platform vs. prior gen Up to 1.16x higher average FSI performance on 5th Gen Intel Xeon Scalable platform vs. prior gen

Up to 1.25x higher average Life & Material Science HPC performance on 5th Gen Intel Xeon Scalable platform vs. prior gen

Up to 1.3x higher average Manufacturing HPC performance on 5th Gen Intel Xeon Scalable platform vs. prior gen

Up to 2.14x higher average HPC Performance and 1.56x higher average HPC Performance/Watt with Intel® Xeon® Platinum 8592+ across a broad set of HPC codes vs. prior generation Intel Xeon Platinum 8380

5th Generation Intel® Xeon® Platinum processor See claims H2-H14: 1.22x and 1.08x: Geomean of HPL, HPCG, Stream Triad, WRF, Monte Carlo, Black Scholes, Binomial Options, GROMACS, NAMD, LAMMPS, Ansys-LS-DYNA, ANSYS Fluent, ESI Group OpenFOAM, See claims H2-H4: 1.19x: Geomean of HPL, HPCG, Stream Triad. See claims H8: 1.26x: Geomean of WRF See claims H11-H13: 1.16x: Geomean of Binomial Options,Monte Carlo,Black Scholes. See claims H9,H10,H14: 1.25x: Geomean of GROMACS, NAMD, LAMMPS. See claims H5-H7: 1.3x: Geomean of ANSYS Fluent,ESI Group OpenFOAM,Ansys-LS-DYNA See H2-H14: 2.14x and 1.56x: Geomean of HPL, HPCG, Stream Triad, WRF, Monte Carlo, Black Scholes, Binomial Options, GROMACS, NAMD, LAMMPS, Ansys-LS-DYNA, ANSYS Fluent, ESI Group OpenFOAM vs 3rd Gen Xeon 8380 This offering is not approved or endorsed by OpenCFD Limited, producer and distributor of the OpenFOAM software via www.openfoam.com, and owner of the OPENFOAM® and OpenCFD® trademark Average HPC Performance Test by Intel December, 2023
[H2] Up to 1.1x higher Stream Triad performance on 5th Gen Intel Xeon Scalable platform vs. prior gen

Up to 1.71x higher Stream Triad performance on 5th Gen Intel Xeon Scalable platform vs. 3rd Gen Intel Xeon Platform

5th Generation Intel® Xeon® Platinum processor 8592+: 1-node 2x Intel Xeon 8592+, HT On, Turbo On, SNC2, 1024 GB DDR5-5600, ucode 0x21000161, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_​7.x86_​64, icc:2023.2.0 Stream V5.10. Test by Intel as of October 2023. 8490H: 1-node, 2x 4th Gen Intel Xeon 8490H, HT On, Turbo On, SNC4, 1024 GB DDR4-4800, ucode=0x2b0004d0, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_​7.x86_​64, icc:2023.2.0, Stream V5.10. Test by Intel as of March 2023. 8380: 1-node, 2x 3rd Gen Intel Xeon 8380, HT On, Turbo On, SNC2, 1024 GB DDR4-3200, ucode=0xd0003a5, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_​7.x86_​64, icc:2023.2.0, Stream V5.10. Test by Intel as of October 2023. Stream Triad Test by Intel March 2023, October 2023
[H3] Up to 1.19x higher HPL performance on 5th Gen Intel Xeon Scalable platform vs. prior gen

Up to 1.86x higher HPL performance on 5th Gen Intel Xeon Scalable platform vs. 3rd Gen Intel Xeon Platform

5th Generation Intel® Xeon® Platinum processor 8592+: 1-node 2x Intel Xeon 8592+, HT On, Turbo On, SNC2, 1024 GB DDR5-5600, ucode 0x21000161, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_​7.x86_​64, HPL from MKL_​v2022.1.0, cmkl:2023.2.0, icc:2023.2.0, impi:2021.10.0. . Test by Intel as of October 2023. 8490H: 1-node, 2x 4th Gen Intel Xeon 8490H, HT On, Turbo On, SNC4, 1024 GB DDR4-4800, ucode=0x2b0004d0, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_​7.x86_​64, HPL from MKL_​v2022.1.0, cmkl:2023.2.0, icc:2023.2.0, impi:2021.10.0. Test by Intel as of March 2023. 8380: 1-node, 2x 3rd Gen Intel Xeon 8380, HT On, Turbo On, SNC2, 1024 GB DDR4-3200, ucode=0xd0003a5, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_​7.x86_​64, HPL from MKL_​v2022.1.0, cmkl:2023.2.0 icc:2023.2.0, impi:2021.10.0. Test by Intel as of October 2023. HPL Test by Intel March 2023, October 2023
[H4] Up to 1.28x higher HPCG performance on 5th Gen Intel Xeon Scalable platform vs. prior gen

Up to 1.92x higher HPCG performance on 5th Gen Intel Xeon Scalable platform vs. 3rd Gen Intel Xeon Platform

5th Generation Intel® Xeon® Platinum processor 8592+: 1-node 2x Intel Xeon 8592+, HT On, Turbo On, SNC2, 1024 GB DDR5-5600, ucode 0x21000161, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_​7.x86_​64, HPCG from MKL_​v2022.1.0. cmkl:2023.2.0 icc:2023.2.0, impi:2021.10.0. Test by Intel as of October 2023. 8490H: 1-node, 2x 4th Gen Intel Xeon 8490H, HT On, Turbo On, SNC4, 1024 GB DDR4-4800, ucode=0x2b0004d0, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_​7.x86_​64, HPCG from MKL_​v2022.1.0. cmkl:2023.2.0 icc:2023.2.0, impi:2021.10.0. Test by Intel as of March 2023. 8380: 1-node, 2x 3rd Gen Intel Xeon 8380, HT On, Turbo On, SNC2, 1024 GB DDR4-3200, ucode=0xd0003a5, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_​7.x86_​64, HPCG from MKL_​v2022.1.0. cmkl:2023.2.0 icc:2023.2.0,impi:2021.10.0. Test by Intel as of October 2023. HPCG Test by Intel March 2023, October 2023
[H5] Up to 1.35x higher OpenFOAM performance on 5th Gen Intel Xeon Scalable platform vs. prior gen

Up to 2x higher OpenFOAM performance on 5th Gen Intel Xeon Scalable platform vs. 3rd Gen Intel Xeon Platform

5th Generation Intel® Xeon® Platinum processor OpenFOAM (Geomean of MotorBike 20M, MotorBike 42M) 8592+: 1-node 2x Intel Xeon 8592+, HT On, Turbo On, SNC2, 1024 GB DDR5-5600, ucode 0x21000161, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_​7.x86_​64, OpenFOAM v8, ifort:2023.2.0 icc:2023.2.0, impi:2021.10.0. Test by Intel as of October 2023. 8490H: 1-node, 2x 4th Gen Intel Xeon 8490H, HT On, Turbo On, SNC4, 1024 GB DDR4-4800, ucode=0x2b0004d0, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_​7.x86_​64, OpenFOAM v8, ifort:2023.2.0 icc:2023.2.0, impi:2021.10.0. Test by Intel as of March 2023. 8380: 1-node, 2x 3rd Gen Intel Xeon 8380, HT On, Turbo On, SNC2, 1024 GB DDR4-3200, ucode=0xd0003a5, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_​7.x86_​64, OpenFOAM v8, ifort:2023.2.0 icc:2023.2.0, impi:2021.10.0. Test by Intel as of October 2023. ESI Group OpenFOAM Test by Intel March 2023, October 2023
[H6] Up to 1.17x higher ANSYS Fluent performance on 5th Gen Intel Xeon Scalable platform vs. prior gen

Up to 2x higher ANSYS Fluent performance on 5th Gen Intel Xeon Scalable platform vs. 3rd Gen Intel Xeon Platform

5th Generation Intel® Xeon® Platinum processor ANSYS Fluent (Geomean of aircraft_​wing_​14m,aircraft_​wing_​2m,combustor_​12m, combustor_​16m, combustor_​71m, exhaust_​system_​33m, f1_​racecar_​140m,fluidized_​bed_​2m, ice_​2m, landing_​gear_​15m, oil_​rig_​7m, pump_​2m, rotor_​3m, sedan_​4m) 8592+: 1-node 2x Intel Xeon 8592+, HT On, Turbo On, SNC2, 1024 GB DDR5-5600, ucode 0x21000161, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_​7.x86_​64, Ansys Fluent 2023R1, impi:2021.10.0. Test by Intel as of October 2023. 8490H: 1-node, 2x 4th Gen Intel Xeon 8490H, HT On, Turbo On, SNC4, 1024 GB DDR4-4800, ucode=0x2b0004d0, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_​7.x86_​64, Ansys Fluent 2023R1, impi:2021.10.0. Test by Intel as of March 2023. 8380: 1-node, 2x 3rd Gen Intel Xeon 8380, HT On, Turbo On, SNC2, 1024 GB DDR4-3200, ucode=0xd0003a5, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_​7.x86_​64, Ansys Fluent 2023R1, impi:2021.10.0. Test by Intel as of October 2023. ANSYS Fluent Test by Intel March 2023, October 2023
[H7] Up to 1.42x higher Ansys LS-DYNA performance on 5th Gen Intel Xeon Scalable platform vs. prior gen

Up to 2.36x higher Ansys LS-DYNA performance on 5th Gen Intel Xeon Scalable platform vs. 3rd Gen Intel Xeon Platform

5th Generation Intel® Xeon® Platinum processor Ansys LS-DYNA (Geomean of 3cars-150ms, ODB-10M, car2car/120ms) 8592+: 1-node 2x Intel Xeon 8592+, HT On, Turbo On, SNC2, 1024 GB DDR5-5600, ucode 0x21000161, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_​7.x86_​64, Ansys LS-DYNA R11, impi:2021.10.0. Test by Intel as of October 2023. 8490H: 1-node, 2x 4th Gen Intel Xeon 8490H, HT On, Turbo On, SNC4, 1024 GB DDR4-4800, ucode=0x2b0004d0, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_​7.x86_​64, Ansys LS-DYNA R11, impi:2021.10.0. Test by Intel as of March 2023. 8380: 1-node, 2x 3rd Gen Intel Xeon 8380, HT On, Turbo On, SNC2, 1024 GB DDR4-3200, ucode=0xd0003a5, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_​7.x86_​64, Ansys LS-DYNA R11, impi:2021.10.0. Test by Intel as of October 2023. ANSYS LS-DYNA Test by Intel March 2023, October 2023
[H8] Up to 1.26x higher WRF performance on 5th Gen Intel Xeon Scalable platform vs. prior gen

Up to 1.98x higher WRF performance on 5th Gen Intel Xeon Scalable platform vs. 3rd Gen Inel Xeon Platform

5th Generation Intel® Xeon® Platinum processor WRF (Geomean of CONUS 2.5KM, CONUS 12KM) 8592+: 1-node 2x Intel Xeon 8592+, HT On, Turbo On, SNC2, 1024 GB DDR5-5600, ucode 0x21000161, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_​7.x86_​64, WRF v4.2.2, icc:2023.2.0 ifort:2021.10.0, impi:2021.10.0. Test by Intel as of October 2023. 8490H: 1-node, 2x 4th Gen Intel Xeon 8490H, HT On, Turbo On, SNC4, 1024 GB DDR4-4800, ucode=0x2b0004d0, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_​7.x86_​64, WRF v4.2.2, icc:2023.2.0 ifort:2021.10.0, impi:2021.10.0. Test by Intel as of March 2023. 8380: 1-node, 2x 3rd Gen Intel Xeon 8380, HT On, Turbo On, SNC2, 1024 GB DDR4-3200, ucode=0xd0003a5, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_​7.x86_​64, WRF v4.2.2, icc:2023.2.0 ifort:2021.10.0, impi:2021.10.0. Test by Intel as of October 2023. WRF Test by Intel March 2023, October 2023
[H9] Up to 1.19x higher GROMACS performance on 5th Gen Intel Xeon Scalable platform vs. prior gen

Up to 2.3x higher GROMACS performance on 5th Gen Intel Xeon Scalable platform vs. 3rd Gen Intel Xeon Platform

5th Generation Intel® Xeon® Platinum processor GROMACS (Geomean of benchMEM, benchPEP-h,benchPEP,benchRIB,ion_​channel_​pme,lignocellulose_​rf, water_​rf,water_​pme) 8592+: 1-node 2x Intel Xeon 8592+, HT On, Turbo On, SNC2, 1024 GB DDR5-5600, ucode 0x21000161, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_​7.x86_​64, GROMACS v2021.4, cmkl:2023.2.0 icc:2023.2.0, impi:2021.10.0. Test by Intel as of October 2023. 8490H: 1-node, 2x 4th Gen Intel Xeon 8490H, HT On, Turbo On, SNC4, 1024 GB DDR4-4800, ucode=0x2b0004d0, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_​7.x86_​64, GROMACS v2021.4, cmkl:2023.2.0 icc:2023.2.0, impi:2021.10.0. Test by Intel as of March 2023. 8380: 1-node, 2x 3rd Gen Intel Xeon 8380, HT On, Turbo On, SNC2, 1024 GB DDR4-3200, ucode=0xd0003a5, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_​7.x86_​64, GROMACS v2021.4, cmkl:2023.2.0 icc:2023.2.0, impi:2021.10.0, impi:2021.10.0. Test by Intel as of October 2023. GROMACS Test by Intel March 2023, October 2023
[H10] Up to 1.17x higher NAMD performance on 5th Gen Intel Xeon Scalable platform vs. prior gen

Up to 3x higher NAMD performance on 5th Gen Intel Xeon Scalable platform vs. 3rd Gen Intel Xeon Platform

5th Generation Intel® Xeon® Platinum processor NAMD (Geomean of apoa1_​npt_​2fs, stmv_​npt_​2fs) 8592+: 1-node 2x Intel Xeon 8592+, HT On, Turbo On, SNC2, 1024 GB DDR5-5600, ucode 0x21000161, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_​7.x86_​64, NAMD v2.15alpha, cmkl:2023.2.0 icc:2023.2.0 tbb:2021.10.0. Test by Intel as of October 2023. 8490H: 1-node, 2x 4th Gen Intel Xeon 8490H, HT On, Turbo On, SNC4, 1024 GB DDR4-4800, ucode=0x2b0004d0, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_​7.x86_​64, NAMD v2.15alpha, cmkl:2023.2.0 icc:2023.2.0 tbb:2021.10.0. Test by Intel as of October 2023. 8380: 1-node, 2x 3rd Gen Intel Xeon 8380, HT On, Turbo On, SNC2, 1024 GB DDR4-3200, ucode=0xd0003a5, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_​7.x86_​64, NAMD v2.15alpha, cmkl:2023.2.0 icc:2023.2.0 tbb:2021.10.0. Test by Intel as of October 2023. NAMD Test by Intel October 2023
[H11] Up to 1.2x higher Binomial Options performance on 5th Gen Intel Xeon Scalable platform vs. prior gen

Up to 1.92x higher Binomial Options performance on 5th Gen Intel Xeon Scalable platform vs. 3rd Gen Intel Xeon Platform

5th Generation Intel® Xeon® Platinum processor 8592+: 1-node 2x Intel Xeon 8592+, HT On, Turbo On, SNC2, 1024 GB DDR5-5600, ucode 0x21000161, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_​7.x86_​64, Binomial Options v1.1, icc:2023.2.0 tbb:2021.10.0. Test by Intel as of October 2023. 8490H: 1-node, 2x 4th Gen Intel Xeon 8490H, HT On, Turbo On, SNC4, 1024 GB DDR4-4800, ucode=0x2b0004d0, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_​7.x86_​64, Binomial Options v1.1, icc:2023.2.0 tbb:2021.10.0. Test by Intel as of March 2023. 1-node, 2x 3rd Gen Intel Xeon 8380, HT On, Turbo On, SNC2, 1024 GB DDR4-3200, ucode=0xd0003a5, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_​7.x86_​64, Binomial Options v1.1, icc:2023.2.0 tbb:2021.10.0. Test by Intel as of October 2023. Binomial Options Test by Intel March 2023, October 2023
[H12] Up to 1.18x higher Monte Carlo performance on 5th Gen Intel Xeon Scalable platform vs. prior gen

Up to 1.66x higher Monte Carlo performance on 5th Gen Intel Xeon Scalable platform vs. 3rd Gen Intel Xeon Platform

5th Generation Intel® Xeon® Platinum processor 8592+: 1-node 2x Intel Xeon 8592+, HT On, Turbo On, SNC2, 1024 GB DDR5-5600, ucode 0x21000161, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_​7.x86_​64, Monte Carlo v1.2, cmkl:2023.2.0 icc:2023.2.0 tbb:2021.10.0. Test by Intel as of October 2023. 8490H: 1-node, 2x 4th Gen Intel Xeon 8490H, HT On, Turbo On, SNC4, 1024 GB DDR4-4800, ucode=0x2b0004d0, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_​7.x86_​64, Monte Carlo v1.2, cmkl:2023.2.0 icc:2023.2.0 tbb:2021.10.0. Test by Intel as of March 2023. 8380: 1-node, 2x 3rd Gen Intel Xeon 8380, HT On, Turbo On, SNC2, 1024 GB DDR4-3200, ucode=0xd0003a5, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_​7.x86_​64, Monte Carlo v1.2, cmkl:2023.2.0 icc:2023.2.0 tbb:2021.10.0. Test by Intel as of October 2023. Monte Carlo Test by Intel March 2023, October 2023
[H13] Up to 1.12x higher Black Scholes performance on 5th Gen Intel Xeon Scalable platform vs. prior gen

Up to 2.31x higher Black Scholes performance on 5th Gen Intel Xeon Scalable platform vs. 3rd Gen Intel Xeon Platform

5th Generation Intel® Xeon® Platinum processor 8592+: 1-node 2x Intel Xeon 8592+, HT On, Turbo On, SNC2, 1024 GB DDR5-5600, ucode 0x21000161, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_​7.x86_​64, Black Scholes v1.4, cmkl:2023.2.0 icc:2023.2.0 tbb:2021.10.0. Test by Intel as of October 2023. 8490H: 1-node, 2x 4th Gen Intel Xeon 8490H, HT On, Turbo On, SNC4, 1024 GB DDR4-4800, ucode=0x2b0004d0, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_​7.x86_​64, Black Scholes v1.4, cmkl:2023.2.0 icc:2023.2.0 tbb:2021.10.0. Test by Intel as of March 2023. 8380: 1-node, 2x 3rd Gen Intel Xeon 8380, HT On, Turbo On, SNC2, 1024 GB DDR4-3200, ucode=0xd0003a5, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_​7.x86_​64, Black Scholes v1.4, cmkl:2023.2.0 icc:2023.2.0 tbb:2021.10.0. Test by Intel as of October 2023. Black Scholes Test by Intel March 2023, October 2023
[H14] Up to 1.31x higher LAMMPS performance on 5th Gen Intel Xeon Scalable platform vs. prior gen

Up to 3x higher LAMMPS performance on 5th Gen Intel Xeon Scalable platform vs. 3rd Gen Intel Xeon Platform

5th Generation Intel® Xeon® Platinum processor LAMMPS (Geomean of Polyethylene,DPD,Copper, Liquid Crystal,Atomic Fluid,Protein, Stillinger-Weber,Tersoff, Water) 8592+: 1-node 2x Intel Xeon 8592+, HT On, Turbo On, SNC2, 1024 GB DDR5-5600, ucode 0x21000161, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_​7.x86_​64, LAMMPS v2021-09-29, cmkl:2023.2.0 icc:2023.2.0 tbb:2021.10.0, impi:2021.10.0. Test by Intel as of October 2023. 8490H: 1-node, 2x 4th Gen Intel Xeon 8490H, HT On, Turbo On, SNC4, 1024 GB DDR4-4800, ucode=0x2b0004d0, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_​7.x86_​64, LAMMPS v2021-09-29, cmkl:2023.2.0 icc:2023.2.0 tbb:2021.10.0, impi:2021.10.0. Test by Intel as of March 2023. 8380: 1-node, 2x 3rd Gen Intel Xeon 8380, HT On, Turbo On, SNC2, 1024 GB DDR4-3200, ucode=0xd0003a5, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_​7.x86_​64, LAMMPS v2021-09-29, cmkl:2023.2.0 icc:2023.2.0 tbb:2021.10.0, impi:2021.10.0. Test by Intel as of October 2023. LAMMPS Test by Intel March 2023, October 2023
[H201] Up to 1.55x higher FSI performance with 5th Gen Intel Xeon Platinum 8592+ vs. 4th Gen AMD EPYC 9554.

Up to 1.20x higher FSI Perf/W with 5th Gen Intel Xeon Platinum 8592+ using integrated Intel IAA vs. 4th Gen AMD EPYC 9554.

5th Generation Intel® Xeon® Platinum processor Geomean of Binomial Options, Monte Carlo, BlackScholes. Binomial Options 8592+: 1-node 2x Intel Xeon 8592+, HT On, Turbo On, SNC2, 1024 GB DDR5-5600, ucode 0x21000161, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_​7.x86_​64, Binomial Options v1.1, icc:2023.2.0 tbb:2021.10.0. Test by Intel as of October 2023. AMD EPYC 9554: 1-node, 2x AMD EPYC 9554, SMT On, Turbo On, CTDP=360W, NPS=4, 1536GB DDR5-4800, ucode= 0xa101111, Red Hat Enterprise Linux 8.7, Kernel 4.18, Binomial Options v1.1, icc:2023.2.0 tbb:2021.10.0. Test by Intel as of March 2023 Monte Carlo 8592+: 1-node 2x Intel Xeon 8592+, HT On, Turbo On, SNC2, 1024 GB DDR5-5600, ucode 0x21000161, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_​7.x86_​64, Monte Carlo v1.2, cmkl:2023.2.0 icc:2023.2.0 tbb:2021.10.0. Test by Intel as of October 2023. AMD EPYC 9554: 1-node, 2x AMD EPYC 9554, SMT On, Turbo On, CTDP=360W, NPS=4, 1536GB DDR5-4800, ucode= 0xa101111, Red Hat Enterprise Linux 8.7, Kernel 4.18,Monte Carlo v1.2, cmkl:2023.2.0 icc:2023.2.0 tbb:2021.10.0. Test by Intel as of March 2023 BlackScholes 8592+: 1-node 2x Intel Xeon 8592+, HT On, Turbo On, SNC2, 1024 GB DDR5-5600, ucode 0x21000161, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_​7.x86_​64, Black Scholes v1.4, cmkl:2023.2.0 icc:2023.2.0 tbb:2021.10.0. Test by Intel as of October 2023. AMD EPYC 9554: 1-node, 2x AMD EPYC 9554, SMT On, Turbo On, CTDP=360W, NPS=4, 1536GB DDR5-4800, ucode= 0xa101111, Red Hat Enterprise Linux 8.7, Kernel 4.18, Black Scholes v1.4, cmkl:2023.2.0 icc:2023.2.0 tbb:2021.10.0. Test by Intel as of March 2023 FSI - Binomial, Monte Carlo, BlackScholes Test by Intel March 2023, October 2023
[H202] Up to 1.36x higher NAMD (Life and Material Science) performance on 5th Gen Intel Xeon Scalable platform vs. 4th Gen AMD EPYC 9554. 5th Generation Intel® Xeon® Platinum processor NAMD (Geomean of apoa1_​npt_​2fs, stmv_​npt_​2fs) 8592+: 1-node 2x Intel Xeon 8592+, HT On, Turbo On, SNC2, 1024 GB DDR5-5600, ucode 0x21000161, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_​7.x86_​64, NAMD v2.15alpha, cmkl:2023.2.0 icc:2023.2.0 tbb:2021.10.0. Test by Intel as of October 2023. AMD EPYC 9554: 1-node, 2x AMD EPYC 9554, SMT On, Turbo On, CTDP=360W, NPS=4, 1536GB DDR5-4800, ucode= 0xa101111, Red Hat Enterprise Linux 8.7, Kernel 4.18, NAMD v2.15alpha, cmkl:2023.2.0 icc:2023.2.0 tbb:2021.10.0. Test by Intel as of March 2023. NAMD Test by Intel March 2023, October 2023
[H203] Up to 1.48x higher LAMMPS (Life and Material Science) performance on 5th Gen Intel Xeon Scalable platform vs. 4th Gen AMD EPYC 9554. 5th Generation Intel® Xeon® Platinum processor LAMMPS (Geomean of Polyethylene,DPD,Copper, Liquid Crystal,Atomic Fluid,Protein, Stillinger-Weber,Tersoff, Water) 8592+: 1-node 2x Intel Xeon 8592+, HT On, Turbo On, SNC2, 1024 GB DDR5-5600, ucode 0x21000161, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_​7.x86_​64, LAMMPS v2021-09-29, cmkl:2023.2.0 icc:2023.2.0 tbb:2021.10.0, impi:2021.10.0. Test by Intel as of October 2023. AMD EPYC 9554: 1-node, 2x AMD EPYC 9554, SMT On, Turbo On, CTDP=360W, NPS=4, 1536GB DDR5-4800, ucode= 0xa101111, Red Hat Enterprise Linux 8.7, Kernel 4.18, LAMMPS v2021-09-29, cmkl:2023.2.0 icc:2023.2.0 tbb:2021.10.0, impi:2021.10.0. Test by Intel as of March 2023. LAMMPS Test by Intel March 2023, October 2023
[H204] Up to 1.08x higher GROMACS (Life and Material Science) performance on 5th Gen Intel Xeon Scalable platform vs. 4th Gen AMD EPYC 9554. 5th Generation Intel® Xeon® Platinum processor GROMACS (Geomean of benchMEM, benchPEP-h,benchPEP,benchRIB,ion_​channel_​pme,lignocellulose_​rf, water_​rf,water_​pme) 8592+: 1-node 2x Intel Xeon 8592+, HT On, Turbo On, SNC2, 1024 GB DDR5-5600, ucode 0x21000161, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_​7.x86_​64, GROMACS v2021.4, cmkl:2023.2.0 icc:2023.2.0, impi:2021.10.0. Test by Intel as of October 2023. AMD EPYC 9554: 1-node, 2x AMD EPYC 9554, SMT On, Turbo On, CTDP=360W, NPS=4, 1536GB DDR5-4800, ucode= 0xa101111, Red Hat Enterprise Linux 8.7, Kernel 4.18, GROMACS v2021.4, cmkl:2023.2.0 icc:2023.2.0, impi:2021.10.0. Test by Intel as of March 2023 GROMACS Test by Intel March 2023, October 2023
[N1] 1.5x average performance gain with 5th Gen Intel Xeon Scalable Processor on a range of broadly-deployed communication infrastructure workloads vs. prior gen 5th Generation Intel® Xeon® Platinum processor See N2-N7. Geomean of NGINX RSA2K handshake, NGINX SHA256, 5G UPF FiB, IPSEC Geomean Test by Intel September 25, 2023, October 2, 2023
[N2] Up to 1.60x higher throughput on VPP IPv4 FIB (64B) performance with the new 5th Gen Intel Xeon Platinum 8592+ processor compared to the previous generation 5th Generation Intel® Xeon® Platinum processor 8592+: 1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores, HT On, Turbo Off, NUMA 2, Total Memory 512GB (16x32GB DDR5 5600 MT/s [5600 MT/s]), BIOS EGSDCRB1.SYS.0105.D74.2308261933, microcode 0x21000161, 1x Ethernet Controller I225-LM, 1x 223.6G INTEL SSDSC2KB240G8, 1x 240M Disk, Ubuntu 22.04 LTS, 5.15.0-27-generic, Workload: VPP ipv4-fib-1.25M flows 64B packets, VPP version 23.10-rc0~0-ga7dd04d73. Test by Intel as of 09/25/23. 8470N:1-node, 2x Intel(R) Xeon(R) Platinum 8470N, 52 cores, HT On, Turbo Off, NUMA 2, Integrated Accelerators Available [used]: DLB 8 [0], DSA 8 [0], IAA 0 [0], QAT 8 [0], Total Memory 512GB (16x32GB DDR5 5600 MT/s [4800 MT/s]), BIOS EGSDCRB1.SYS.0102.D37.2305081420, microcode 0x2b0004b1, 1x Ethernet Controller I225-LM, 1x 223.6G INTEL SSDSC2KB240G8, Ubuntu 22.04 LTS, 5.15.0-27-generic, Workload: VPP ipv4-fib-1.25M flows 64B packets, VPP version 23.10-rc0~0-ga7dd04d73 ,Test by Intel as of 10/02/23. VPP IPv4 forward information base (FIB) Test by Intel September 25, 2023, October 2, 2023
[N3] Up to 1.69x higher VPP IPSec (512B) Muti-Tunnel throughput with the new 5th Gen Intel Xeon Platinum 8592+ processor compared to the previous generation. 5th Generation Intel® Xeon® Platinum processor 8592+:1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores, HT On, Turbo Off, NUMA 2, Total Memory 512GB (16x32GB DDR5 5600 MT/s [5600 MT/s]), BIOS EGSDCRB1.SYS.0105.D74.2308261933, microcode 0x21000161, 1x Ethernet Controller I225-LM, 1x 223.6G INTEL SSDSC2KB240G8, 1x 240M Disk, Ubuntu 22.04 LTS, 5.15.0-27-generic, Workload: VPP IPSec 120K tunnels 512B packets, VPP version 23.10-rc0~0-ga7dd04d73, score=390Gb/s, wall power 1225WTest by Intel as of 09/25/23. 8470N: 1-node, 2x Intel(R) Xeon(R) Platinum 8470N, 52 cores, HT On, Turbo Off, NUMA 2, Integrated Accelerators Available [used]: DLB 8 [0], DSA 8 [0], IAA 0 [0], QAT 8 [0], Total Memory 512GB (16x32GB DDR5 5600 MT/s [4800 MT/s]), BIOS EGSDCRB1.SYS.0102.D37.2305081420, microcode 0x2b0004b1, 1x Ethernet Controller I225-LM, 1x 223.6G INTEL SSDSC2KB240G8, Ubuntu 22.04 LTS, 5.15.0-27-generic, Workload: VPP IPSec 100K tunnels 512B packets, VPP version 23.10-rc0~0-ga7dd04d73, score=231Gb/s, wall power 1280WTest by Intel as of 10/02/23. VPP IPSec Multi-Tunnel Security Gateway Test by Intel September 25, 2023, October 2, 2023
[N4] Up to 1.51X higher throughput with 5th Gen Intel Xeon Platinum 8592+ on user plane functions in 5G wireless core network compared to prior gen. 5th Generation Intel® Xeon® Platinum processor 8592+ : 1-node, 2x Xeon(R) Platinum 8592+, 64 cores, HT On, Turbo On, NUMA 2, Integrated Accelerators Available [used]: DLB 2 [0], DSA 2 [0], IAA 2 [0], QAT 2 [0], Total Memory 512GB (16x32GB DDR5 5600 MT/s [5600 MT/s]), BIOS EGSDCRB1.SYS.0105.D74.2308261933, microcode 0x21000161, 10x Ethernet Controller E810-C for QSFP, 1x Ethernet interface, 1x Ethernet Controller I225-LM, 1x 745.2G INTEL SSDSC2BA800G4, 1x 240M Disk, Ubuntu 22.04 LTS, 5.15.0-27-generic, upf-release-pma4,gcc (Ubuntu 11.2.0-19ubuntu1) 11.2.0, score=767.3,Test by Intel as of 09/26/23. 8470N: 1-node, 2x Intel(R) Xeon(R) Platinum 8470N, 52 cores, HT On, Turbo On, NUMA 2, Integrated Accelerators Available [used]: DLB 8 [0], DSA 8 [0], IAA 0 [0], QAT 8 [0], Total Memory 512GB (16x32GB DDR5 5600 MT/s [4800 MT/s]), BIOS EGSDCRB1.86B.0102.D37.2305081415, microcode 0xab0004b1, 1x Ethernet Controller I225-LM, 10x Ethernet Controller E810-C for QSFP, 1x Ethernet interface, 1x 745.2G INTEL SSDSC2BA800G4, 1x 240M Disk, Ubuntu 22.04 LTS, 5.15.0-27-generic, upf-release-pma4,gcc (Ubuntu 11.2.0-19ubuntu1) 11.2.0, score=517.5G, Test by Intel as of 09/28/23. 5G User plane functions Test by Intel September 26, 2023, September 28, 2023
[N5] Up to 1.47x higher throughput with 5th Gen Intel® Xeon® Platinum 8592+ processor vs prior gen on NGINX TLS 1.3 AES128-GCM-SHA256 Bulk throughput with non-optimized software 5th Generation Intel® Xeon® Platinum processor 8592+: 1-node, 2x Xeon(R) Platinum 8592+, 64 cores, HT On, Turbo On, NUMA 4, Integrated Accelerators Available [used]: DLB 2 [0], DSA 2 [0], IAA 2 [0], QAT 2 [0], Total Memory 512GB (16x32GB DDR5 5600 MT/s [5600 MT/s]), BIOS EGSDCRB1.SYS.0105.D74.2308261933, microcode 0x21000161, 1x Ethernet Controller I225-LM, 7x Ethernet Controller E810-C for QSFP, 1x 223.6G INTEL SSDSC2KB240G8, 1x 240M Disk, Ubuntu 22.04 LTS, 5.15.0-27-generic, NGINx v0.5.1, OpenSSL 3.1.3, test by Intel on 10/19/2023 8470N: 1-node, 2x Intel(R) Xeon(R) Platinum 8470N, 52 cores, HT On, Turbo On, NUMA 2, Integrated Accelerators Available [used]: DLB 8 [0], DSA 8 [0], IAA 0 [0], QAT 8 [0], Total Memory 512GB (16x32GB DDR5 5600 MT/s [4800 MT/s]), BIOS EGSDCRB1.SYS.0102.D37.2305081420, microcode 0x2b0004b1, 10x Ethernet Controller E810-C for QSFP, 1x Ethernet Controller I225-LM, 1x 223.6G INTEL SSDSC2KB240G8, 1x 240M Disk, Ubuntu 22.04 LTS, 5.15.0-27-generic, NGINx v0.5.1, OpenSSL 3.1.3, test by Intel on 10/19/2023 NGINX TLS 1.3 Webserver: AES128-GCM-SHA256 Test by Intel October 19, 2023
[N6] Up to 1.69x higher connections/second with 5th Gen Intel® Xeon® Platinum 8592+ processor compared to 4th Gen Intel® Xeon® Platinum 8470N processor on NGINX TLS 1.3 ECDHE-X25519-RSA2K handshake with integrated QAT accelerator. 5th Generation Intel® Xeon® Platinum processor 8592+ QATHW+QATSW Turbo:1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores, HT On, Turbo On, NUMA 2, Integrated Accelerators Available [used]: DLB 8 [0], DSA 8 [0], IAA 2 [0], QAT 8 [0], Total Memory 512GB (16x32GB DDR5 5600 MT/s [5600 MT/s]), BIOS EGSDCRB1.SYS.0105.D74.2308261933, microcode 0x21000161, 10x Ethernet Controller E810-C for QSFP (only 8x Ethernet Controller E810-C for QSFP used), 1x Ethernet Controller I225-LM, 1x 240M Disk, 1x 223.6G INTEL SSDSC2KB240G8, Ubuntu 22.04 LTS, 5.15.0-27-generic, NGINx v0.5.1 TLSv1.3 Handshake, gcc 11.4.0, Openssl 3.1.3, QAT Enginev1.4 , IPPCP 2021.8, IPSec v1.4, QAT20.L.1.1.20-00030, Cipher: ECDHE-X25519-RSA2K, score=241165 cps. 8470N Turbo: 1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores, HT On, Turbo On, NUMA 2, Integrated Accelerators Available [used]: DLB 8 [0], DSA 8 [0], IAA 2 [0], QAT 8 [0], Total Memory 512GB (16x32GB DDR5 5600 MT/s [5600 MT/s]), BIOS EGSDCRB1.SYS.0105.D74.2308261933, microcode 0x21000161, 10x Ethernet Controller E810-C for QSFP [Measured on 6x Ethernet Controller E810-C for QSFP], 1x Ethernet Controller I225-LM, 1x 240M Disk, 1x 223.6G INTEL SSDSC2KB240G8, Ubuntu 22.04 LTS, 5.15.0-27-generic, NGINx v0.5.1 TLSv1.3 Handshake, gcc 11.4.0, Openssl 3.1.3, QAT Enginev1.4 , IPPCP 2021.8, IPSec v1.4, Cipher: ECDHE-X25519-RSA2K, score=142803 cps.Test by Intel as of 10/20/23. NGINX TLS 1.3 ECDHE-X25519-RSA2K handshake Test by Intel October 20, 2023
[N7] Up to 1.4x higher connections/second with 5th Gen Intel Xeon Platinum 8592+ processor compared to prev gen on on NGINX TLS 1.3 ECDHE-X25519-P256 handshake with optimized software 5th Generation Intel® Xeon® Platinum processor 8592+: 1-node, 2x Xeon(R) Platinum 8592+, 64 cores, HT On, Turbo On, NUMA 4, Integrated Accelerators Available [used]: DLB 2 [0], DSA 2 [0], IAA 2 [0], QAT 2 [0], Total Memory 512GB (16x32GB DDR5 5600 MT/s [5600 MT/s]), BIOS EGSDCRB1.SYS.0105.D74.2308261933, microcode 0x21000161, 1x Ethernet Controller I225-LM, 7x Ethernet Controller E810-C for QSFP, 1x 223.6G INTEL SSDSC2KB240G8, 1x 240M Disk, Ubuntu 22.04 LTS, 5.15.0-27-generic, NGINx v0.5.1, OpenSSL 3.1.3, test by Intel on 10/19/2023 8470N: 1-node, 2x Intel(R) Xeon(R) Platinum 8470N, 52 cores, HT On, Turbo On, NUMA 2, Integrated Accelerators Available [used]: DLB 8 [0], DSA 8 [0], IAA 0 [0], QAT 8 [0], Total Memory 512GB (16x32GB DDR5 5600 MT/s [4800 MT/s]), BIOS EGSDCRB1.SYS.0102.D37.2305081420, microcode 0x2b0004b1, 10x Ethernet Controller E810-C for QSFP, 1x Ethernet Controller I225-LM, 1x 223.6G INTEL SSDSC2KB240G8, 1x 240M Disk, Ubuntu 22.04 LTS, 5.15.0-27-generic, NGINx v0.5.1, OpenSSL 3.1.3, test by Intel on 10/19/2023 NGINX TLS 1.3 ECDHE-X25519-P256 handshake Test by Intel October 19, 2023
[N8] Up to 2.25x higher performance and 1.55x higher performance per watt with 2-socket 5th Gen Intel Xeon Platinum 8592+ vs. 3rd Gen Intel Xeon Processor on CDN Video-On-Demand with Varnish Enterprise [12.8k connections] 5th Generation Intel® Xeon® Platinum processor 8592+: 1-node, 2x Intel® Xeon® Platinum 8592+ Processor, 64 cores, HT On, Turbo On, Total Memory 512 GB (16 slots/ 32 GB/ 4800 MT/s), 16x Samsung PM1743 15.36TB, 4x NVIDIA MCX755106AS-HEAT, BIOS EGSDCRB1.SYS.0105.D74.2308261931 (ucode 0x21000190), RHEL 8.8, kernel 4.18.0-477.27.1.el8_​8.x86_​64, gcc (GCC) 8.5.0 20210514 (Red Hat 8.5.0-10), OpenSSL 1.1.1k FIPS 25 Mar 2021, varnish-plus-6.0.11r7 revision e0b27762e2866a9c853db8268d1dda2f9913e40b, wrk master 02/07/2021 (keep alive, 768 OR 1600 OR 12800 total connections) Throughput measured with 100% Transport Layer Security (TLS) traffic with 100% target cache hit ratio. Test by Intel as of 10/12/2023 8380: 1-node,2x Intel® Xeon® Platinum 8380 Processor, 40 cores, HT On, Turbo On, Total Memory 512 GB (16 slots/ 32 GB/ 3200 MT/s), 12x Intel® P5510, 4x Mellanox MCX516A-CDAT, BIOS 1.5 (ucode 0xd0003a5), RHEL 8.8, kernel 4.18.0-477.27.1.el8_​8.x86_​64, gcc (GCC) 8.5.0 20210514 (Red Hat 8.5.0-10), OpenSSL 1.1.1k FIPS 25 Mar 2021, varnish-plus-6.0.11r7 revision e0b27762e2866a9c853db8268d1dda2f9913e40b, wrk master 02/07/2021 (keep alive, 768 OR 1600 OR 12800 total connections) Throughput measured with 100% Transport Layer Security (TLS) traffic with 100% target cache hit ratio. Test by Intel as of 10/17/2023. CDN Performance - Video-on-Demand Test by Intel October 12, 2023, October 17, 2023
[N9] Up to 2.25x higher performance and 1.65x higher performance per watt with 2-socket 5th Gen Intel Xeon Platinum 8592+ vs. 3rd Gen Intel Xeon Processor on CDN Live with Varnish Enterprise [84k connections] 5th Generation Intel® Xeon® Platinum processor 8592+: 1-node, pre-production platform with 2x Intel® Xeon® Platinum 8592+ Processor, 64 cores, HT On, Turbo On, Total Memory 512 GB (16 slots/ 32 GB/ 4800 MT/s), 16x Samsung PM1743 15.36TB, 4x NVIDIA MCX755106AS-HEAT, BIOS EGSDCRB1.SYS.0105.D74.2308261931 (ucode 0x21000190), RHEL 8.8, kernel 4.18.0-477.27.1.el8_​8.x86_​64, gcc (GCC) 8.5.0 20210514 (Red Hat 8.5.0-10), OpenSSL 1.1.1k FIPS 25 Mar 2021, varnish-plus-6.0.11r7 revision e0b27762e2866a9c853db8268d1dda2f9913e40b, wrk master 02/07/2021 (keep alive, 768 OR 1600 OR 12800 OR 84000 total connections) Throughput measured with 100% Transport Layer Security (TLS) traffic with 98.8% target cache hit ratio. Test by Intel as of 10/12/2023. 8380: 1-node,,2x Intel® Xeon® Platinum 8380 Processor, 40 cores, HT On, Turbo On, Total Memory 512 GB (16 slots/ 32 GB/ 3200 MT/s), 12x Intel® P5510, 4x Mellanox MCX516A-CDAT, BIOS 1.5 (ucode 0xd0003a5), RHEL 8.8, kernel 4.18.0-477.27.1.el8_​8.x86_​64, gcc (GCC) 8.5.0 20210514 (Red Hat 8.5.0-10), OpenSSL 1.1.1k FIPS 25 Mar 2021, varnish-plus-6.0.11r7 revision e0b27762e2866a9c853db8268d1dda2f9913e40b, wrk master 02/07/2021 (keep alive, 768 OR 1600 OR 12800 OR 84000 total connections) Throughput measured with 100% Transport Layer Security (TLS) traffic with 98.8% target cache hit ratio. Test by Intel as of 10/17/2023. CDN - Live Test by Intel October 12, 2023, October 17, 2023
[N10] Up to 1.2x higher performance with 2-socket 5th Gen Intel Xeon Gold 6538N vs. 3rd Gen Intel Xeon Processor on CDN Video-on-Demand with Varnish Enterprise [48k connections]

Up to 1.43x higher performance with 2-socket 5th Gen Intel Xeon Gold 6538N vs. 3rd Gen Intel Xeon Processor on CDN Live with Varnish Enterprise [48k connections]

5th Generation Intel® Xeon® Platinum processor CDN- VoD 6538N: 1-node, 2x Intel® Xeon® Platinum 6538N Processor, 32 cores, HT On, Turbo On, Total Memory 512 GB (16 slots/ 32 GB/ 4800 MT/s), 16x Samsung PM1743 15.36TB, 4x NVIDIA MCX755106AS-HEAT, BIOS EGSDCRB1.SYS.0105.D74.2308261931 (ucode 0x21000190), RHEL 8.8, kernel 4.18.0-477.27.1.el8_​8.x86_​64, gcc (GCC) 8.5.0 20210514 (Red Hat 8.5.0-10), OpenSSL 1.1.1k FIPS 25 Mar 2021, varnish-plus-6.0.11r7 revision e0b27762e2866a9c853db8268d1dda2f9913e40b, wrk master 02/07/2021 (keep alive, 768 OR 1600 OR 12800 OR 84000 total connections) Throughput measured with 100% Transport Layer Security (TLS) traffic with 100% target cache hit ratio. Test by Intel as of 10/14/2023 6338N:. 1-node, 2x Intel® Xeon® Platinum 8380 Processor, 40 cores, HT On, Turbo On, Total Memory 512 GB (16 slots/ 32 GB/ 3200 MT/s @ 2666 MT/s), 12x Intel® P5510, 4x Mellanox MCX516A-CDAT, BIOS 1.5 (ucode 0xd0003a5), RHEL 8.8, kernel 4.18.0-477.27.1.el8_​8.x86_​64, gcc (GCC) 8.5.0 20210514 (Red Hat 8.5.0-10), OpenSSL 1.1.1k FIPS 25 Mar 2021, varnish-plus-6.0.11r7 revision e0b27762e2866a9c853db8268d1dda2f9913e40b, wrk master 02/07/2021 (keep alive, 768 OR 1600 OR 12800 OR 84000 total connections) Throughput measured with 100% Transport Layer Security (TLS) traffic with 100% target cache hit ratio. Test by Intel as of 10/17/2023 CDN-Live : 6538N 1-node, 2x Intel® Xeon® Platinum 6538N Processor, HT On, Turbo On, Total Memory 512 GB (16 slots/ 32 GB/ 4800 MT/s), 16x Samsung PM1743 15.36TB, 4x NVIDIA MCX755106AS-HEAT, BIOS EGSDCRB1.SYS.0105.D74.2308261931 (ucode 0x21000190), RHEL 8.8, kernel 4.18.0-477.27.1.el8_​8.x86_​64, gcc (GCC) 8.5.0 20210514 (Red Hat 8.5.0-10), OpenSSL 1.1.1k FIPS 25 Mar 2021, varnish-plus-6.0.11r7 revision e0b27762e2866a9c853db8268d1dda2f9913e40b, wrk master 02/07/2021 (keep alive, 768 OR 1600 OR 12800 OR 84000 total connections) Throughput measured with 100% Transport Layer Security (TLS) traffic with 100% target cache hit ratio. Test by Intel as of 10/14/2023. 6338N: 1-node,,2x Intel® Xeon® Platinum 8380 Processor, HT On, Turbo On, Total Memory 512 GB (16 slots/ 32 GB/ 3200 MT/s @ 2666 MT/s), 12x Intel® P5510, 4x Mellanox MCX516A-CDAT, BIOS 1.5 (ucode 0xd0003a5), RHEL 8.8, kernel 4.18.0-477.27.1.el8_​8.x86_​64, gcc (GCC) 8.5.0 20210514 (Red Hat 8.5.0-10), OpenSSL 1.1.1k FIPS 25 Mar 2021, varnish-plus-6.0.11r7 revision e0b27762e2866a9c853db8268d1dda2f9913e40b, wrk master 02/07/2021 (keep alive, 768 OR 1600 OR 12800 OR 84000 total connections) Throughput measured with 100% Transport Layer Security (TLS) traffic with 100% target cache hit ratio. Test by Intel as of 10/17/2023 CDN - VoD and Live Test by Intel October 14, 2023, October 17, 2023
[N11] 3.2x average1 performance gain on a range of broadly-deployed network workloads vs. 3-Year Refresh Platform 5th Generation Intel® Xeon® Platinum processor See N12-N14. Geomean of 5G UPF FiB, IPSEC Geomean - Refresh Test by Intel September 25, 2023, October 2, 2023
[N12] Up to 3x higher throughput on VPP IPv4 FIB (64B) performance with the new 5th Gen Intel Xeon Platinum 8592+ processor compared to the 3rd Gen Intel Xeon Processor 5th Generation Intel® Xeon® Platinum processor 8592+: 1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores, HT On, Turbo Off, NUMA 2, Total Memory 512GB (16x32GB DDR5 5600 MT/s [5600 MT/s]), BIOS EGSDCRB1.SYS.0105.D74.2308261933, microcode 0x21000161, 1x Ethernet Controller I225-LM, 1x 223.6G INTEL SSDSC2KB240G8, 1x 240M Disk, Ubuntu 22.04 LTS, 5.15.0-27-generic, Workload: VPP ipv4-fib-1.25M flows 64B packets, VPP version 23.10-rc0~0-ga7dd04d73, score=505Gb/s, wall power 910WTest by Intel as of 09/25/23. 6338N: 1-node, 2x Intel(R) Xeon(R) Gold 6338N CPU @ 2.20GHz, 32 cores, HT On, Turbo Off, NUMA 2, Integrated Accelerators Available [used]: DLB 0 [0], DSA 0 [0], IAA 0 [0], QAT 0 [0], Total Memory 256GB (16x16GB DDR4 2933 MT/s [2666 MT/s]), BIOS WLYDCRB1.KSM.0030.P26.2303301709, microcode 0xd0003a5, 1x I210 Gigabit Network Connection, 1x 240M Disk, 1x 223.6G KINGSTON SUV400S37240G, Ubuntu 22.04 LTS, 5.15.0-27-generic, Workload: VPP ipv4-fib-1M flows 64B packets, VPP version 23.10-rc0~0-ga7dd04d73. score=167Gb/s, Test by Intel as of 10/02/23. VPP IPv4 forward information base (FIB) - 3-Yr Refresh Test by Intel September 25, 2023 October 2, 2023
[N13] Up to 3.64x higher VPP IPSec (512B) Multi-Tunnel throughput with the new 5th Gen Intel Xeon Platinum 8592+ processor compared to the 3rd Gen Intel Xeon Processor 5th Generation Intel® Xeon® Platinum processor 8592+:1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores, HT On, Turbo Off, NUMA 2, Total Memory 512GB (16x32GB DDR5 5600 MT/s [5600 MT/s]), BIOS EGSDCRB1.SYS.0105.D74.2308261933, microcode 0x21000161, 1x Ethernet Controller I225-LM, 1x 223.6G INTEL SSDSC2KB240G8, 1x 240M Disk, Ubuntu 22.04 LTS, 5.15.0-27-generic, Workload: VPP IPSec 120K tunnels 512B packets, VPP version 23.10-rc0~0-ga7dd04d73, score=390Gb/s, wall power 1225WTest by Intel as of 09/25/23. 6338N: 1-node, 2x Intel(R) Xeon(R) Gold 6338N CPU @ 2.20GHz, 32 cores, HT On, Turbo Off, NUMA 2, Integrated Accelerators Available [used]: DLB 0 [0], DSA 0 [0], IAA 0 [0], QAT 0 [0], Total Memory 256GB (16x16GB DDR4 2933 MT/s [2666 MT/s]), BIOS WLYDCRB1.KSM.0030.P26.2303301709, microcode 0xd0003a5, 1x I210 Gigabit Network Connection, 1x 240M Disk, 1x 223.6G KINGSTON SUV400S37240G, Ubuntu 22.04 LTS, 5.15.0-27-generic, Workload: VPP IPSec 56K tunnels 512B packets, VPP version 23.10-rc0~0-ga7dd04d73. score=107Gb/s, wall power 514W Test by Intel as of 10/02/23. VPP IPSec Multi-Tunnel Security Gateway Test by Intel September 25, 2023 October 2, 2023
[N14] Up to 3X higher throughput with 5th Gen Intel Xeon Platinum 8592+ on user plane functions in 5G wireless core network compared to the 3rd Gen Intel Xeon Processor 5th Generation Intel® Xeon® Platinum processor 8592+: 1-node, 2x Intel(R) Xeon(R) Platinum 8592+, 64 cores, HT On, Turbo Off, NUMA 2, Total Memory 512GB (16x32GB DDR5 5600 MT/s [5600 MT/s]), BIOS EGSDCRB1.SYS.0105.D74.2308261933, microcode 0x21000161, 1x Ethernet Controller I225-LM, 1x 223.6G INTEL SSDSC2KB240G8, 1x 240M Disk, Ubuntu 22.04 LTS, 5.15.0-27-generic, VPP IPSec (Multi Tunnel ), 23.10-rc0~0-ga7dd04d73, gcc (Ubuntu 9.4.0-5ubuntu1) 9.4.0 , Test by Intel as of 09/25/23. 6338N: 1-node, 2x Intel(R) Xeon(R) Gold 6338N CPU @ 2.20GHz, 32 cores, HT On, Turbo Off, NUMA 2, Integrated Accelerators Available [used]: DLB 0 [0], DSA 0 [0], IAA 0 [0], QAT 0 [0], Total Memory 256GB (16x16GB DDR4 2933 MT/s [2666 MT/s]), BIOS WLYDCRB1.KSM.0030.P26.2303301709, microcode 0xd0003a5, 1x I210 Gigabit Network Connection, 1x 240M Disk, 1x 223.6G KINGSTON SUV400S37240G, Ubuntu 22.04 LTS, 5.15.0-27-generic, VPP IPSec (Multi Tunnel), 23.10-rc0~0-ga7dd04d73, gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0.Test by Intel as of 04/08/22. 5G User plane functions Test by Intel September 25, 2023, April 8, 2023
[N15] Up to 1.23x higher NGINX TLS Handshake performance with 5th Gen Intel Xeon Platinum 8592+ vs 4th Gen Intel Xeon Platinum 8480+

Up to 2.17x higher NGINX TLS Handshake performance per core with 5th Gen Intel Xeon Platinum 8592+ with integrated QAT vs OOB software

Up to 1.73x higher NGINX TLS Handshake performance with 5th Gen Intel Xeon Platinum 8592+vs. 3rd Gen Intel Xeon Platinum 8380

Up to 7.92x higher NGINX TLS Handshake performance with 5th Gen Intel Xeon Platinum 8592+ vs. 1st Gen Intel Xeon Platinum 8180

Up to 3.85x higher NGINX TLS Handshake performance per core with 5th Gen Intel Xeon Platinum 8592+ with integrated QAT vs. 1st Gen Intel Xeon Platinum 8180

5th Generation Intel® Xeon® Platinum processor 8592+: 1-node, 2x 5th Gen Intel Xeon Scalable processor (64 core) with integrated Intel Quick Assist Technology (Intel QAT), QAT device utilized=4 (1 active socket), HT On, Turbo Off, SNC On, with 1024GB DDR5 memory (16x64 GB 5600), microcode 0x21000161, Ubuntu 22.04.3 LTS, 5.15.0-78-generic, 1x 1.7T SAMSUNG MZWLJ1T9HBJR-00007, 1x Intel® Ethernet Network Adapter E810-2CQDA2, 1x100GbE, NGINX Async v0.5.1, OpenSSL 3.1.3, IPP Crypto 2021.8, IPsec MB v 1.4, QAT _​Engine v 1.4.0, QAT Driver 20.l.1.1..20-00030, TLS 1.3 Webserver: ECDHE-X25519-RSA2K, tested by Intel October 2023. 8480+: 1-node, 2x 4th Gen Intel Xeon Scalable processor (56 core) with integrated Intel Quick Assist Technology (Intel QAT), QAT device utilized=4 (1 active socket), HT On, Turbo Off, SNC Off, with 1024GB DDR5 memory (16x64 GB 4800), microcode 0x2b0004d0, Ubuntu 22.04.3 LTS, 5.15.0-78-generic, 1x 1.7T SAMSUNG MZWLJ1T9HBJR-00007, 1x Intel® Ethernet Network Adapter E810-2CQDA2, 1x100GbE, NGINX Async v0.5.1, OpenSSL 3.1.3, IPP Crypto 2021.8, IPsec MB v 1.4, QAT _​Engine v 1.4.0, QAT Driver 20.l.1.1..20-00030, TLS 1.3 Webserver: ECDHE-X25519-RSA2K, tested by Intel October 2023. 8380: 1-node, Intel platform with 2x 3rd Gen Intel Xeon Scalable processor (40 cores), HT On, Turbo Off, SNC off, Total Memory 1024GB (16x64GB DDR4 3200), microcode 0xd0003a5, HT On, Turbo On, SNC Off, Ubuntu 22.04.3 LTS, 5.15.0-78-generic, 1x 1.7T SAMSUNG MZWLJ1T9HBJR-00007, 1x Intel® Ethernet Network Adapter E810-2CQDA2, 1x100GbE, NGINX Async v0.5.1, OpenSSL 3.1.3, IPP Crypto 2021.8, IPsec MB v 1.4, QAT _​Engine v 1.4.0, TLS 1.3 Webserver: ECDHE-X25519-RSA2K tested by Intel October 2023. 8180: 1-node, Intel platform with 2x 1st Gen Intel Xeon Scalable processor (28 cores), HT On, Turbo Off, SNC off, Total Memory 384GB (12x32GB DDR4 2666), microcode 0x2007006, Ubuntu 22.04.3 LTS, 5.15.0-78-generic, 1x 1.7T SAMSUNG MZWLJ1T9HBJR-00007, 1x Intel® Ethernet Network Adapter E810-2CQDA2, 1x100GbE, NGINX Async v0.5.1, OpenSSL 3.1.3, TLS 1.3 Webserver: ECDHE-X25519-RSA2K, tested by Intel October 2023. NGINX TLS Handshake with QAT Test by Intel October 2023
[N16] Up to 1.13x higher Perf/W for large packet sequential read with 5th Gen Intel Xeon Platinum 8592+ using integrated Intel DSA vs. 4th Gen Intel Xeon Platinum 8480+ using integrated Intel DSA

Up to 1.24x higher Perf/W for small packet random read with 5th Gen Intel Xeon Platinum 8592+ using integrated Intel DSA vs. 4th Gen Intel Xeon Platinum 8480+ using integrated Intel DSA

Up to 2.26x perf and 2.15x higher Perf/W for large packet sequential read with 5th Gen Intel Xeon Platinum 8592+ using integrated Intel DSA vs. oob

Up to 1.90x perf and 1.80x higher Perf/W for small packet random read with 5th Gen Intel Xeon Platinum 8592+ using integrated Intel DSA vs. oob

Up to 2.85x higher IOPs and up to 65% latency reduction for large packet sequential read with 5th Gen Intel Xeon Platinum 8592+ using integrated Intel DSA vs. 3rd Gen Intel Xeon Platinum 8380 oob

Up to 2.06x higher Perf/W for large packet sequential read with 5th Gen Intel Xeon Platinum 8592+ using integrated Intel DSA vs. 3rd Gen Intel Xeon Platinum 8380 oob

Up to 2.45x higher IOPs and up to 59% latency reduction for small packet random read with 5th Gen Intel Xeon Platinum 8592+ using integrated Intel DSA vs. 3rd Gen Intel Xeon Platinum 8380 oob

Up to 1.82x higher Perf/W for small packet random read with 5th Gen Intel Xeon Platinum 8592+ using integrated Intel DSA vs. 3rd Gen Intel Xeon Platinum 8380

Up to 3.52x higher IOPs and up to 71% latency reduction for large packet sequential read with 5th Gen Intel Xeon Platinum 8592+ using integrated Intel DSA vs. 1st Gen Intel Xeon Platinum 8180 oob

Up to 3.19x higher IOPs and up to 69% latency reduction for small packet random read with 5th Gen Intel Xeon Platinum 8592+ using integrated Intel DSA vs. 1st Gen Intel Xeon Platinum 8180 oob

Up to 2.09x higher Perf/W for large packet sequential read with 5th Gen Intel Xeon Platinum 8592+ using integrated Intel DSA vs. 1st Gen Intel Xeon Platinum 8180 oob

Up to 1.68x higher Perf/W for small packet random read with 5th Gen Intel Xeon Platinum 8592+ using integrated Intel DSA vs. 1st Gen Intel Xeon Platinum 8180 oob

5th Generation Intel® Xeon® Platinum processor 8592+: 1-node, 2x 5th Gen Intel Xeon Scalable processor (64 core) with integrated Intel Data Streaming Accelerator (Intel DSA), DSA device utilized=1(1 active socket), HT On, Turbo On, SNC Off, with 1024GB DDR5 memory (16x64 GB 5600), microcode 0x21000161, Ubuntu 22.04.3 LTS, 5.15.0-78-generic, 1x 894.3G Micron 7450, 4x 3.84TB Samsung PM1733, 1x Intel® Ethernet Network Adapter E810-2CQDA2, 2x100GbE, FIO v3.34, SPDK 22.05, tested by Intel October 2023. 8480+: 1-node, 2x 4th Gen Intel Xeon Scalable processor (56 core) with integrated Intel Data Streaming Accelerator (Intel DSA), DSA device utilized=1(1 active socket), HT On, Turbo On, SNC Off, with 1024GB DDR5 memory (16x64 GB 4800), microcode 0x2b0004d0, Ubuntu 22.04.3 LTS, 5.15.0-78-generic, 1x 894.3G Micron 7450, 4x 3.84TB Samsung PM1733, 1x Intel® Ethernet Network Adapter E810-2CQDA2, 2x100GbE, FIO v3.34, SPDK 22.05, tested by Intel October 2023. 8380: 1-node, Intel platform with 2x 3rd Gen Intel Xeon Scalable processor (40 cores), HT On, Turbo On, SNC off, Total Memory 1024GB (16x64GB DDR4 3200), microcode 0xd0003a5, HT On, Turbo On, SNC Off, Ubuntu 22.04.3 LTS, 5.15.0-78-generic, 1x 1x 1.7T Samsung PM9A3, 4x 3.84TB Samsung PM1733, 1x Intel® Ethernet Network Adapter E810-2CQDA2, 2x100GbE, 1x Ethernet Controller 10-Gigabit X540-AT2, FIO v3.34, SPDK 22.05, tested by Intel October 2023 8180: 1-node, Intel platform with 2x 1st Gen Intel Xeon Scalable processor (28 cores), HT On, Turbo On, SNC off, Total Memory 768GB (24x32GB DDR4 2666), microcode 0x2007006, HT On, Turbo On, SNC Off, Ubuntu 22.04.3 LTS, 5.15.0-78-generic, 1x 894.3G Micron 7450, 4x 3.84TB Samsung PM1733, 1x Intel® Ethernet Network Adapter E810-2CQDA2, 2x100GbE, 1x Ethernet Connection X722 for 10GBASE-T, FIO v3.34, SPDK 22.05, tested by Intel October 2023 SPDK NVMe-o-TCP with DSA Test by Intel October 2023
[N17] Up to 1.37x performance/watt improvement on the new 5th Gen Intel® Xeon® Platinum 8592+ processor with Intel Infrastructure Power Manager software for 5G UPF applications vs prior gen Intel Xeon Platinum 8470N 5th Generation Intel® Xeon® Platinum processor 8592+: 1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores, HT On, Turbo On, NUMA 2, Integrated Accelerators Available [used]: DLB 2 [0], DSA 2 [0], IAA 2 [0], QAT 2 [0], Total Memory 512GB (16x32GB DDR5 5600 MT/s [5600 MT/s]), BIOS EGSDCRB1.SYS.0105.D74.2308261933, microcode 0x21000161, 10x Ethernet Controller E810-C for QSFP, 1x Ethernet interface, 1x Ethernet Controller I225-LM, 1x 745.2G INTEL SSDSC2BA800G4, 1x 240M Disk, Ubuntu 22.04 LTS, 5.15.0-27-generic, upf-release-pma4,gcc (Ubuntu 11.2.0-19ubuntu1) 11.2.0, IPM v23.12-dev, score=767.3Test by Intel as of 09/26/23. 8470N: 1-node, 2x Intel(R) Xeon(R) Platinum 8470N, 52 cores, HT On, Turbo On, NUMA 2, Integrated Accelerators Available [used]: DLB 8 [0], DSA 8 [0], IAA 0 [0], QAT 8 [0], Total Memory 512GB (16x32GB DDR5 5600 MT/s [4800 MT/s]), BIOS EGSDCRB1.86B.0102.D37.2305081415, microcode 0xab0004b1, 1x Ethernet Controller I225-LM, 10x Ethernet Controller E810-C for QSFP, 1x Ethernet interface, 1x 745.2G INTEL SSDSC2BA800G4, 1x 240M Disk, Ubuntu 22.04 LTS, 5.15.0-27-generic, upf-release-pma4,gcc (Ubuntu 11.2.0-19ubuntu1) 11.2.0,IPM v23.12-dev, score=517.5GTest by Intel as of 09/28/23 5G User Plane Functions with IPM Test by Intel September 26, 2023, September 28, 2023
[N18] Up to 3.73x higher throughput with the new 5th Gen Intel® Xeon® Platinum 8592+ processor on VPP IPSec (1420B) with integrated QAT accelerator. 5th Generation Intel® Xeon® Platinum processor 8592+: 1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores, HT On, Turbo Off, NUMA 2, Integrated Accelerators Available [used]: DLB 8 [0], DSA 8 [0], IAA 2 [0], QAT 8 [0], Total Memory 512GB (16x32GB DDR5 5600 MT/s [5600 MT/s]), BIOS EGSDCRB1.SYS.0105.D74.2308261922, microcode 0x21000161, 1x Ethernet Controller I225-LM, 20x Ethernet Controller E810-C for QSFP, 1x 223.6G INTEL SSDSC2KB240G8, 1x 240M Disk, Ubuntu 22.04 LTS, 5.15.0-27-generic, Workload: VPP IPSec AES256-CBC-HMAC-SHA256-128 1420B packets 4c8t used. VPP Version 24.02-rc0~58-g6b027cfdb, no QAT offload, score=44Gb/s. Test by Intel as of 11/02/23 8592+: 1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores, HT On, Turbo Off, NUMA 2, Integrated Accelerators Available [used]: DLB 8 [0], DSA 8 [0], IAA 2 [0], QAT 8 [4], Total Memory 512GB (16x32GB DDR5 5600 MT/s [5600 MT/s]), BIOS EGSDCRB1.SYS.0105.D74.2308261922, microcode 0x21000161, 1x Ethernet Controller I225-LM, 20x Ethernet Controller E810-C for QSFP, 1x 223.6G INTEL SSDSC2KB240G8, 1x 240M Disk, Ubuntu 22.04 LTS, 5.15.0-27-generic, Workload: VPP IPSec AES256-CBC-HMAC-SHA256-128 1420B packets 4c8t used. VPP Version 24.02-rc0~58-g6b027cfdb, with QAT offload, score=164Gb/s. Test by Intel as of 11/02/23 VPP IPSEC with Integrated QAT HW using AES256 Test by Intel November 2,2023
[N19] Up to 1.31x higher performance/watt with the new 5th Gen Intel® Xeon® Platinum 8592+ processor compared to the previous gen processor 5th Generation Intel® Xeon® Platinum processor 8592+: 1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores, HT On, Turbo On, NUMA 2, Integrated Accelerators Available [used]: DLB 2 [0], DSA 2 [0], IAA 2 [0], QAT 2 [0], Total Memory 512GB (16x32GB DDR5 5600 MT/s [5600 MT/s]), BIOS EGSDCRB1.SYS.0105.D74.2308261933, microcode 0x21000161, 10x Ethernet Controller E810-C for QSFP, 1x Ethernet interface, 1x Ethernet Controller I225-LM, 1x 745.2G INTEL SSDSC2BA800G4, 1x 240M Disk, Ubuntu 22.04 LTS, 5.15.0-27-generic, upf-release-pma4,gcc (Ubuntu 11.2.0-19ubuntu1) 11.2.0,Test by Intel as of 09/26/23. 8470N: 1-node, 2x Intel(R) Xeon(R) Platinum 8470N, 52 cores, HT On, Turbo On, NUMA 2, Integrated Accelerators Available [used]: DLB 8 [0], DSA 8 [0], IAA 0 [0], QAT 8 [0], Total Memory 512GB (16x32GB DDR5 5600 MT/s [4800 MT/s]), BIOS EGSDCRB1.86B.0102.D37.2305081415, microcode 0xab0004b1, 1x Ethernet Controller I225-LM, 10x Ethernet Controller E810-C for QSFP, 1x Ethernet interface, 1x 745.2G INTEL SSDSC2BA800G4, 1x 240M Disk, Ubuntu 22.04 LTS, 5.15.0-27-generic, upf-release-pma4,gcc (Ubuntu 11.2.0-19ubuntu1) 11.2.0,Test by Intel as of 09/28/23. 5G UPF Perf/Watt without IPM Test by Intel September 26, 2023, September 28, 2023
[N20] Up to 31% Average CPU Power savings on the new 5th Gen Intel® Xeon® Platinum 8592+ processor with Intel Infrastructure Power Manager software enabled for 5G UPF applications vs without IPM 5th Generation Intel® Xeon® Platinum processor 8592+: 1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores, HT On, Turbo On, NUMA 2, Integrated Accelerators Available [used]: DLB 2 [0], DSA 2 [0], IAA 2 [0], QAT 2 [0], Total Memory 512GB (16x32GB DDR5 5600 MT/s [5600 MT/s]), BIOS EGSDCRB1.SYS.0105.D74.2308261933, microcode 0x21000161, 10x Ethernet Controller E810-C for QSFP, 1x Ethernet interface, 1x Ethernet Controller I225-LM, 1x 745.2G INTEL SSDSC2BA800G4, 1x 240M Disk, Ubuntu 22.04 LTS, 5.15.0-27-generic, upf-release-pma4,gcc (Ubuntu 11.2.0-19ubuntu1) 11.2.0, IPM v23.12-dev, score=767.3Test by Intel as of 09/26/23. 8470N: 1-node, 2x Intel(R) Xeon(R) Platinum 8470N, 52 cores, HT On, Turbo On, NUMA 2, Integrated Accelerators Available [used]: DLB 8 [0], DSA 8 [0], IAA 0 [0], QAT 8 [0], Total Memory 512GB (16x32GB DDR5 5600 MT/s [4800 MT/s]), BIOS EGSDCRB1.86B.0102.D37.2305081415, microcode 0xab0004b1, 1x Ethernet Controller I225-LM, 10x Ethernet Controller E810-C for QSFP, 1x Ethernet interface, 1x 745.2G INTEL SSDSC2BA800G4, 1x 240M Disk, Ubuntu 22.04 LTS, 5.15.0-27-generic, upf-release-pma4,gcc (Ubuntu 11.2.0-19ubuntu1) 11.2.0,IPM v23.12-dev, score=517.5GTest by Intel as of 09/28/23 5G UPF Perf/Watt with IPM on vs off Test by Intel September 26, 2023, September 28, 2023
[N21] Up to 3.39x higher throughput with the new 5th Gen Intel® Xeon® Platinum 8592+ processor on VPP WireGuard (1420B) with integrated QAT accelerator 5th Generation Intel® Xeon® Platinum processor 8592+: 1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores, HT On, Turbo Off, NUMA 2, Integrated Accelerators Available [used]: DLB 8 [0], DSA 8 [0], IAA 2 [0], QAT 8 [0], Total Memory 512GB (16x32GB DDR5 5600 MT/s [5600 MT/s]), BIOS EGSDCRB1.SYS.0105.D74.2308261922, microcode 0x21000161, 1x Ethernet Controller I225-LM, 20x Ethernet Controller E810-C for QSFP, 1x 223.6G INTEL SSDSC2KB240G8, 1x 240M Disk, Ubuntu 22.04 LTS, 5.15.0-27-generic, Workload: VPP WireGuard 1420B packets 4c8t used. VPP Version 24.02-rc0~58-g6b027cfdb, no QAT offload, score=56Gb/sTest by COMPANY as of 06/07/22. 8592+: 1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores, HT On, Turbo Off, NUMA 2, Integrated Accelerators Available [used]: DLB 8 [0], DSA 8 [0], IAA 2 [0], QAT 8 [4], Total Memory 512GB (16x32GB DDR5 5600 MT/s [5600 MT/s]), BIOS EGSDCRB1.SYS.0105.D74.2308261922, microcode 0x21000161, 1x Ethernet Controller I225-LM, 20x Ethernet Controller E810-C for QSFP, 1x 223.6G INTEL SSDSC2KB240G8, 1x 240M Disk, Ubuntu 22.04 LTS, 5.15.0-27-generic, Workload: VPP WireGuard 1420B packets 4c8t used. VPP Version 24.02-rc0~58-g6b027cfdb, with QAT offload, score=192Gb/sTest by COMPANY as of 06/07/22. VPP WireGuard with Integrated QAT accelerator Test by Intel June 7, 2022
[N22] Intel® VROC performance is consistently better than RAID HBA, delivering up to 165% more IOPS, up to 62% lower latency and up to 155% better power efficiency 5th Generation Intel® Xeon® Platinum processor 8592+- 1 node, 2x INTEL(R) XEON(R) PLATINUM 8592+ (QDF: Q3W7) (64 cores each) ,128GB RAM (8 x 16GB Hynix HMCG78AGBRA191N 5800 MT/s DDR5 Synchronous Registered (Buffered) DIMMs); BIOS Version: EGSDREL1.SYS.0105.D74.2308261931 ,Microcode revision: 0xa1000161,WorkloadConfiguration(I/O Sensitive), Hyperthreading (Enabled) OS: Red Hat Enterprise Linux 9.2 GA, Kernel: 5.14.0-284.11.1.el9_​2.x86_​64 Storage: VROC: 6 x 400GB Intel Optane P5810X PCIe Gen4 U.2 SSDs (Model: SSDPF21Q400GA, Firmware: L0310600) connected to backplane which is connected to a midplane switch via special Broadcom SlimSAS cables which is connected to CPU0 3A-D, 4A-D MCIO PCIe ports (NUMA Node 1, CPU 0); Trimode with Midplane switch: 6 x 400GB Intel Optane P5810X PCIe Gen4 U.2 SSDs (Model: SSDPF21Q400GA, Firmware: L0310600) connected to backplane which is connected to a midplane switch via special Broadcom SlimSAS cables which is connected to an Intel RS3P4TF160F (x8) (equivalent to Broadcom 9560-16i) card on Riser 1, PCIe slot 1 (NUMA Node 0, CPU0); Model: CYPSWITCHMP; Firmware package version: 4.6; Firmware version: 1.06.00.00; Firmware mode: HWRX12; OS is on NVMe 118GB Intel Optane P1600X M.2 SSDs (Model: SSDPEK1F118GA, Firmware: U50A0550) connected to M.2 sockets on the motherboard RAID Controller: Intel RS3P4TF160F (x8) (equivalent to Broadcom MegaRAID 9560-16i); Firmware Package Build = 52.25.0-4902; Firmware Version = 5.250.02-3847; megaraid_​sas driver version = 07.726.02.00; CLI Version = 007.2612.0000.0000 June 13, 2023; Added "scsi_​mod.use_​blk_​mq=y" to grub boot option for maximum throughput on the Broadcom card; When creating RAID volumes "pdcache=off, Write-Through, No Read Ahead, Direct I/O" OR Intel(R) VROC PreOS Version: 8.0.0.4006; mdadm version = mdadm-4.2-8.el9.x86_​64; vmd driver version = inbox; Added "pci=pcie_​bus_​perf" to grub boot option which sets MaxPayload to the maximum for each of the NVMe devices; VMD enabled on any applicable ports containing NVMe devices (with Intel(R) VROC Premium license) RAID Configurations: 6-Disk RAID0 with 4KB random 70/30 R/W workload using 16 Threads and 32 IODepth with Intel VROC and Intel RS3P4TF160F FIO version: Fio version: 3.35 Intel VROC Test by Intel October 25, 2023
[N23] Up to 400 Gb/s symmetric crypto with 5th Gen Intel Xeon processor with built-in Intel QuickAssist Technology accelerator 5th Generation Intel® Xeon® Platinum processor 1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores, HT On, Turbo Off, NUMA 2, Integrated Accelerators Available [used]: DLB 8 [0], DSA 8 [0], IAA 2 [0], QAT 8 [4], Total Memory 512GB (16x32GB DDR5 5600 MT/s [5600 MT/s]), BIOS EGSDCRB1.SYS.0105.D74.2308261933, microcode 0x21000161, 1x Ethernet Controller I225-LM, 1x 223.6G INTEL SSDSC2KB240G8, 1x 240M Disk, Ubuntu 22.04 LTS, 5.15.0-27-generic, QAT 2.0 L.1.1.20-00030, gcc 11.4.0, AES128-GCM AES-GCM, Packet Size: 8192B, 20C20T, 20 crypto instances (5x instances per QAT device). Test by Intel as of 10/02/23. Cryptographic Cipher Performance Test by Intel October 25, 2023
[N24] Up to 100K Ops/s public key encryption with 5th Gen Intel Xeon processor with built-in Intel QuickAssist Technology accelerator 5th Generation Intel® Xeon® Platinum processor 1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores, HT On, Turbo Off, NUMA 2, Integrated Accelerators Available [used]: DLB 8 [0], DSA 8 [0], IAA 2 [0], QAT 8 [4], Total Memory 512GB (16x32GB DDR5 5600 MT/s [5600 MT/s]), BIOS EGSDCRB1.SYS.0105.D74.2308261933, microcode 0x21000161, 1x Ethernet Controller I225-LM, 1x 223.6G INTEL SSDSC2KB240G8, 1x 240M Disk, Ubuntu 22.04 LTS, 5.15.0-27-generic, QAT 2.0 L.1.1.20-00030, gcc 11.4.0, ECDHE-P256-ECDSA-P256 (50%), 8C8T, 112 pke instances (28x instances per QAT device), Test by Intel as of 10/02/23. Public Key Encryption Performance Test by Intel October 25, 2023
[N25] Up to 160 Gb/s compression with 5th Gen Intel Xeon processor with built-in Intel QuickAssist Technology accelerator 5th Generation Intel® Xeon® Platinum processor 1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores, HT On, Turbo Off, NUMA 2, Integrated Accelerators Available [used]: DLB 8 [0], DSA 8 [0], IAA 2 [0], QAT 8 [4], Total Memory 512GB (16x32GB DDR5 5600 MT/s [5600 MT/s]), BIOS EGSDCRB1.SYS.0105.D74.2308261933, microcode 0x21000161, 1x Ethernet Controller I225-LM, 1x 223.6G INTEL SSDSC2KB240G8, 1x 240M Disk, Ubuntu 22.04 LTS, 5.15.0-27-generic, QAT 2.0 L.1.1.20-00030, gcc 11.4.0, Dynamic Compression Level1, Packet Size: 32KB, 16C16T, 16 compression instances (4x instances per QAT device), Test by Intel as of 10/02/23. Deflate Level 1 @32KB Compression Performance Test by Intel October 25, 2023
[N26] Up to 66.67% fewer cores with 5th Gen Intel® Xeon® Platinum 8592+ processor on NGINx TLS 1.3 ECDHE-X25519-RSA2K handshake with QAT hardware compared to Non-Optimized Software 5th Generation Intel® Xeon® Platinum processor 8592+ QATHW + QATSW:1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores, HT On, Turbo Off, NUMA 2, Integrated Accelerators Available [used]: DLB 8 [0], DSA 8 [0], IAA 2 [0], QAT 8 [0], Total Memory 512GB (16x32GB DDR5 5600 MT/s [5600 MT/s]), BIOS EGSDCRB1.SYS.0105.D74.2308261933, microcode 0x21000161, 10x Ethernet Controller E810-C for QSFP (only 8x Ethernet Controller E810-C for QSFP used), 1x Ethernet Controller I225-LM, 1x 240M Disk, 1x 223.6G INTEL SSDSC2KB240G8, Ubuntu 22.04 LTS, 5.15.0-27-generic, NGINx v0.5.1 TLSv1.3 Handshake, gcc 11.4.0, Openssl 3.1.3, QAT Enginev1.4 , IPPCP 2021.8, IPSec v1.4, QAT20.L.1.1.20-00030, Cipher: ECDHE-X25519-RSA2K, score=220742 cps. Test by Intel as of 11/01/2023. NGINX Webserver Handshake Core Savings TLS 1.3 ECDHE-X25519-RSA2K Test by Intel November 1, 2023
[N27] Less than 5% performance overhead running HashiCorp Vault with TDX VM vs. legacy VM. 5th Generation Intel® Xeon® Platinum processor 1-node,2x 5th Gen Intel Xeon Gold Processor, 32 cores, HT On, Turbo On, Total Memory 256 GB (16 slots/ 16 GB/ 4800 MT/s), 1x Ethernet Controller X710 for 10GBASE-T, 4x Ethernet Controller E810-C for QSFP, BIOS American Megatrends International, LLC. 3B05.TEL4P1, Ubuntu 22.04 LTS, kernel 5.19.17-mvp23v3+6-generic, gcc (GCC) 11.4.0, Hashicorp & TDX Test by Intel
[N201] Up to 2.51x higher IOPs and up to 60% latency reduction for large packet sequential read with 5th Gen Intel Xeon Platinum 8592+ using integrated Intel DSA vs. 4th Gen AMD EPYC 9554 oob.

Up to 2.17x higher IOPs and up to 54% latency reduction for small packet random read with 5th Gen Intel Xeon Platinum 8592+ using integrated Intel DSA vs. 4th Gen AMD EPYC 9554 oob.

Up to 1.92x higher Perf/W for large packet sequential read with 5th Gen Intel Xeon Platinum 8592+ using integrated Intel DSA vs. 4th Gen AMD EPYC 9554 oob.

Up to 1.75x higher Perf/W for small packet random read with 5th Gen Intel Xeon Platinum 8592+ using integrated Intel DSA vs. 4th Gen AMD EPYC 9554 oob.

5th Generation Intel® Xeon® Platinum processor 8592+: 1-node, 2x 5th Gen Intel Xeon Scalable processor (64 core) with integrated Intel Data Streaming Accelerator (Intel DSA), DSA device utilized=1(1 active socket), HT On, Turbo On, SNC Off, with 1024GB DDR5 memory (16x64 GB 5600), microcode 0x21000161, Ubuntu 22.04.3 LTS, 5.15.0-78-generic, 1x 894.3G Micron 7450, 4x 3.84TB Samsung PM1733, 1x Intel® Ethernet Network Adapter E810-2CQDA2, 2x100GbE, FIO v3.34, SPDK 22.05, tested by Intel October 2023. 9554: 1-node, AMD platform with 2x 4th Gen AMD EPYC processor (64 cores), SMT On, Core Performance Boost On, NPS2, Total Memory 1536GB (24x64GB DDR5 4800), microcode 0xa10113e, Ubuntu 22.04.3 LTS, 5.15.0-78-generic, 1x 1.7T Samsung PM9A3, 4x 3.84TB Samsung PM1733, 1x Intel® Ethernet Network Adapter E810-2CQDA2, 2x100GbE, 1x Ethernet Connection X550T for 10GBASE-T, FIO v3.34, SPDK 22.05, tested by Intel October 2023 SPDK NVMe TCP with DSA Test by Intel October, 2023
[N202] QAT SW Accelerator Up to 1.66x higher NGINX TLS Handshake performance with 5th Gen Intel Xeon Platinum 8592+ vs. 4th Gen AMD EPYC 9554 OOB QAT HW Accelerator

Up to 1.85x higher NGINX TLS Handshake performance per core with 5th Gen Intel Xeon Platinum 8592+ with integrated QAT vs. 4th Gen AMD EPYC 9554 OOB

5th Generation Intel® Xeon® Platinum processor 8592+: 1-node, 2x 5th Gen Intel Xeon Scalable processor (64 core) with integrated Intel Quick Assist Technology (Intel QAT), QAT device utilized=4 (1 active socket), HT On, Turbo Off, SNC On, with 1024GB DDR5 memory (16x64 GB 5600), microcode 0x21000161, Ubuntu 22.04.3 LTS, 5.15.0-78-generic, 1x 1.7T SAMSUNG MZ1L21T9HCLS-00A07, 1x Intel® Ethernet Network Adapter E810-2CQDA2, 1x100GbE, NGINX Async v0.5.1, OpenSSL 3.1.3, IPP Crypto 2021.8, IPsec MB v 1.4, QAT _​Engine v 1.4.0, QAT Driver 20.l.1.1..20-00030, TLS 1.3 Webserver: ECDHE-X25519-RSA2K, tested by Intel October 2023. 9554: 1-node, AMD platform with 2x 4th Gen AMD EPYC processor (64 cores), SMT On, Core Performance Boost Off, NPS1, Total Memory 1536GB (24x64GB DDR5 4800), microcode 0xa10113e, Ubuntu 22.04.3 LTS, 5.15.0-78-generic, 1x 1.7T SAMSUNG MZWLJ1T9HBJR-00007, 1x Intel® Ethernet Network Adapter E810-2CQDA2, 1x100GbE, NGINX Async v0.5.1, OpenSSL 3.1.3, TLS 1.3 Webserver: ECDHE-X25519-RSA2K,tested by Intel October 2023. NGINX Key Handshake w/ QAT Test by Intel October, 2023
[S1] 5th Gen Intel Xeon Scalable Processor with Intel TDX offers enhanced VM security with small ~3% performance overhead on key workloads

Up to 11% higher virtual machine performance on 5th Gen Intel Xeon Scalable platform with TDX vs. 4th Gen Intel Xeon Scalable platform (no TDX) on integer, floating point and BERT-large

5th Generation Intel® Xeon® Platinum processor Performance varies by use, configuration and other factors. Results may vary​. KVM Hosts : 8592+: 1-node, 2x Intel® 4th Gen Xeon® Platinum with 64 cores and 1TB (16x64GB DDR5 5600 MT/s ), 1DPC, HEMI total memory 1TB, ucode 0x21000190,, HT on, Turbo on, 2x Ethernet Controller E810-C for QSFP, 1x Ethernet Controller I225-LM (10G), 1x 894.3G INTEL SDSC2KG96 1x 700G INTEL MDTPE21K750GA , 2x 2TB INTEL SSDPE2KX020T8, EGSDCRB1.SYS.0105.D74.2308261931, CentOS Stream 9, 6.2.0-emr.bkc.6.2.14.1.45.x86_​64, test by Intel on Nov 2023 8480+ - 1-node, 2x Intel® 4th Gen Xeon® Platinum with 56 cores and 1TB (16x32GB DDR5 4800 MT/s ), 1DPC, QUAD total memory 512GB, ucode 0x2b000541,, HT on, Turbo on, 2x Ethernet Controller E810-C for QSFP, 1x Ethernet Controller I225-LM (10G), 1x 894.3G INTEL SSDSC2KG960G8 1x 1.7T INTEL SSDSC2KG019T8, 2x 1.8TB INTEL SSDPE2KX020T8, EGSDCRB1.SYS.0105.D59.2308191339, CentOS Stream 9, 6.2.0-emr.bkc.6.2.14.1.45.x86_​64, test by Intel on Nov 2023 Guests: Name:TD-ww35 , vCPUs / Memory : 8vCPUs - pinned to cores+HTs (i.e. 0~3,112~115); 16GB, OS : Ubuntu 22.04.2 LTS, Kernel: 5.19.17-mvp23v3+6-generic, Qemu :7.2.0-57.bkc_​emr_​v3.7, Libvirt: 9.1.0-2023.01.03.tdx.4, Shim : 15.4-10_​2021.11.22_​2.el8, tdx-seam-module TDX_​1.5.00.32.576. Integer, FP Throughput: HT on, Turbo on, est. SPEC CPU2017 v1.1.9, ICC2023.2.3 Tensorflow BERT-large, AMX-INT8 Confidential Computing with TDX Test by Intel November 2023
[T1] Up to 1.25x performance/watt improvement at ~40% load on power efficiency workload with 5th Gen Intel Xeon scalable Processors with OPM enabled vs. OPM disabled

Up to 1.17x higher performance/watt at 40% load and up to 1.11x higher performance/watt at max load on 5th Gen Intel Xeon Scalable processors with OPM compared to 4th Gen Intel Xeon with OPM on power efficiency workload

Up to 2.53x higher performance/watt at 40% load and up to 1.8x higher performance/watt at max load on 5th Gen Intel Xeon Scalable processors with OPM compared to 3rd Gen Intel Xeon on power efficiency workload

5th Generation Intel® Xeon® Platinum processor 8592+: 1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+,64 cores, HT On, Turbo On, SNC-On, Integrated Accelerators Available [used]: DLB 8 [0], DSA 8 [0], IAA 8 [0], QAT 8 [0], Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 2.0, microcode 0x21000161, 2x Ethernet Controller X710 for 10GBASE-T, 1x Ethernet interface, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 5.18.0-051800-generic, power efficiency workloadTest by Intel as of 10/12/23. 8480+:1-node, 2x Intel(R) Xeon(R) Platinum 8480+, 56 cores, HT On, Turbo On, SNC-On, Total Memory 1024GB (16x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 2.0, microcode 0x2b0004d0, 2x Ethernet Controller X710 for 10GBASE-T, 1x Ethernet interface, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 5.15.0-84-generic, JDK ver: Jdk-6u45-linux-x64.bin. Test by Intel as of 10/16/23. 8380+: 1-node, 2x Intel(R) Xeon(R) Platinum 8380, 40 cores, HT On, Turbo On, SNC-On, Total Memory 1024GB (16x64GB DDR4 3200 MT/s [3200 MT/s]), BIOS 1.5, microcode 0xd0003a5, 2x Ethernet Controller 10-Gigabit X540-AT2, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 5.18.0-051800-generic, power efficiency workload, Test by Intel as of 10/12/23. Power Efficiency Load Line Test by Intel October 12, 2023, October 16, 2023
[T2] Up to 1.14x performance/watt improvement at ~50% load on power efficiency workload with 5th Gen Intel Xeon scalable Processors with OPM enabled vs. OPM disabled

Up to 1.38x higher performance/watt at ~50% load and up to 1.26x higher performance/watt at max load on 5th Gen Intel Xeon Scalable processors with OPM compared to 4th Gen Intel Xeon with OPM

Up to 1.66x higher performance/watt at 50% load and up to 1.5x higher performance/watt at max load on 5th Gen Intel Xeon Scalable processors with OPM compared to 3rd Gen Intel Xeon on MySQL database

5th Generation Intel® Xeon® Platinum processor 8592+: 1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+,64 cores, HT On, Turbo On, SNC-Off, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 2.0, microcode 0x21000161, 2x Ethernet Controller X710 for 10GBASE-T, 1x Ethernet interface, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, 2x 1.7T SAMSUNG MZWLJ1T9HBJR-00007 Ubuntu 22.04.3 LTS, 5.18.0-051800-generic, Workload: HammerDB Multi Instance, Application-MySQL 8.0.33, Kubernetes v1.26.6, Containerd.io 1.6.15. Test by Intel as of 10/12/23. 8480+:1-node, 2x Intel(R) Xeon(R) Platinum 8480+, 56 cores, HT On, Turbo On, SNC-Off, Total Memory 1024GB (16x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 2.0, microcode 0x2b0004d0, 2x Ethernet Controller X710 for 10GBASE-T, 1x Ethernet interface, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, 2x 1.7T SAMSUNG MZWLJ1T9HBJR-00007 Ubuntu 22.04.3 LTS, 5.15.0-84-generic, Workload HammerDB Multi Instance, Application-MySQL 8.0.33, Kubernetes v1.26.6, Containerd.io 1.6.15. Test by Intel as of 10/16/23. 8380+: 1-node, 2x Intel(R) Xeon(R) Platinum 8380, 40 cores, HT On, Turbo On, SNC-Off, Integrated Accelerators Available [used]: DLB 0 [0], DSA 0 [0], IAA 0 [0], QAT 0 [0], Total Memory 1024GB (16x64GB DDR4 3200 MT/s [3200 MT/s]), BIOS 1.5, microcode 0xd0003a5, 2x Ethernet Controller 10-Gigabit X540-AT2, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 5.18.0-051800-generic, Workload: HammerDB Multi Instance, Application-MySQL 8.0.33, Kubernetes v1.26.6, Containerd.io 1.6.15. Test by Intel as of 10/12/23. MySQL Database Load Line Test by Intel October 12, 2023, October 16, 2023
[T3] At ~45% load, 5th Gen Intel Xeon scalable Processor show 1.09x improvement in Performance/Watt with OPM enabled vs. OPM disabled on ResNet50

Up to 1.41x higher performance/watt at ~45% load and up to 1.28x higher performance/watt at max load on 5th Gen Intel Xeon Scalable processors with OPM compared to 4th Gen Intel Xeon with OPM on ResNet50

Up to 4.4x higher performance/watt at 45% load and up to 3.4x higher performance/watt at max load on 5th Gen Intel Xeon Scalable processors with OPM compared to 3rd Gen Intel Xeon on MySQL database

5th Generation Intel® Xeon® Platinum processor 8592+: 1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+,64 cores, HT On, Turbo On, SNC-Off, Integrated Accelerators Available [used]: DLB 8 [0], DSA 8 [0], IAA 8 [0], QAT 8 [0], Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 2.0, microcode 0x21000161, 2x Ethernet Controller X710 for 10GBASE-T, 1x Ethernet interface, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 5.18.0-051800-generic, Workload: ResNet 50v1.5 Middleware, Framework, Runtimes - Intel TensorFlow 2.13. Test by Intel as of 10/12/23. 8480+:1-node, 2x Intel(R) Xeon(R) Platinum 8480+, 56 cores, HT On, Turbo On, SNC-Off, Integrated Accelerators Available [used]: DLB 8 [0], DSA 8 [0], IAA 8 [0], QAT 8 [0], Total Memory 1024GB (16x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 2.0, microcode 0x2b0004d0, 2x Ethernet Controller X710 for 10GBASE-T, 1x Ethernet interface, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 5.15.0-84-generic, Workload: ResNet 50v1.5, Intel TensorFlow 2.13, bs=n, Test by Intel as of 10/16/23. 8380+: 1-node, 2x Intel(R) Xeon(R) Platinum 8380, 40 cores, HT On, Turbo On, SNC-Off, Integrated Accelerators Available [used]: DLB 0 [0], DSA 0 [0], IAA 0 [0], QAT 0 [0], Total Memory 1024GB (16x64GB DDR4 3200 MT/s [3200 MT/s]), BIOS 1.5, microcode 0xd0003a5, 2x Ethernet Controller 10-Gigabit X540-AT2, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 5.18.0-051800-generic, Workload: ResNet 50v1.5 Middleware, Framework, Runtimes - Intel TensorFlow 2.13 .Test by Intel as of 10/12/23. AI (ResNet50) Load Line Test by Intel October 12, 2023, October 16, 2023
[T4] At ~50% load, 5th Gen Intel Xeon scalable Processor show 1.15x improvement in Performance/Watt with OPM enabled vs. OPM disabled on WordPress

Up to 1.18x higher performance/watt at ~50% load and up to 1.26x higher performance/watt at max load on 5th Gen Intel Xeon Scalable processors with OPM compared to 4th Gen Intel Xeon with OPM on WordPress

Up to 1.32x higher performance/watt at 50% load and up to 1.56x higher performance/watt at max load on 5th Gen Intel Xeon Scalable processors with OPM compared to 3rd Gen Intel Xeon on WordPress

5th Generation Intel® Xeon® Platinum processor 8592+: 1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores, HT On, Turbo On, SNC-Off, Integrated Accelerators Available [used]: DLB 8 [0], DSA 8 [0], IAA 8 [0], QAT 8 [0], Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 2.0, microcode 0x21000161, 2x Ethernet Controller 10-Gigabit X540-AT2, 1x Ethernet Controller E810-C for QSFP, 1x 3.5T INTEL SSDPF2KX038TZ, Ubuntu 22.04.3 LTS, 5.15.0-78-generic, Workload: Siege 2.78, Application - WordPress 5.6, Test by Intel as of 10/16/23 8480+: 1-node, 2x Intel(R) Xeon(R) Platinum 8480+, 56 cores, HT On, Turbo On, SNC-Off, Integrated Accelerators Available [used]: DLB 8 [0], DSA 8 [0], IAX 8 [0], QAT 8 [0], Total Memory 1024GB (16x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 1.3, microcode 0x2b000461, 2x Ethernet Controller 10-Gigabit X540-AT2, 1x 3.5T INTEL SSDPF2KX038TZ, Ubuntu 22.04.1 LTS, 5.15.0-78-generic, Workload: Siege 2.78, Application - WordPress 5.6, Test by Intel as of 3/12/23. 8380: 1-node, 2x Intel(R) Xeon(R) Platinum 8380 CPU @ 2.30GHz, 40 cores, HT On, Turbo On, SNC-Off, Total Memory 1024GB (16x64GB DDR4 3200 MT/s [3200 MT/s]), BIOS 1.5, microcode 0xd0003a5, 2x Ethernet Controller 10-Gigabit X540-AT2, 1x 3.5T INTEL SSDPF2KX038TZ, Ubuntu 22.04.3 LTS, 5.15.0-78-generic, Workload: Siege 2.78, Application - WordPress 5.6, Tested by Intel as of 8/30/23 WordPress Load Line Test by Intel March 12, 2023, August 30, 2023, October 16, 2023
[T5] DataServices - 28% lower TCO by refreshing 5-year platform with fewer 5th Gen Intel Xeon Scalable platforms to meet the same performance requirement. 5th Generation Intel® Xeon® Platinum processor Claim: 5th Gen Intel Xeon delivers up to 28% lower TCO than the 1st Gen Intel Xeon while running a RocksDB database workload. Based on 5th Gen Intel Xeon delivers up to a 5.68x faster than 1st Gen Intel Xeon while running a RocksDB database workload. This performance drives a fleet a reduction from 50 to 9 servers which, over 4 years, saves: 1191.5 MWH of energy, 505,136 kgCo2 emissions, and $192k of cost. 8592+: 1-node, 2x 5th Gen Intel Xeon Scalable processor 8592+ (64 cores) with integrated Intel In-Memory Analytics Accelerator (Intel IAA), Number of IAA device utilized=8(2 sockets active), HT On, Turbo On, SNC off, Total Memory 1024GB (16x64GB DDR5 5600), microcode 0x21000161, 2x Ethernet Controller 10-Gigabit X540-AT2, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 6.5.0-060500-generic, QPL v1.2.0, accel-config-v4.0, iaa_​compressor plugin v0.3.0, ZSTD v1.5.5, gcc 10.4.0, RocksDB v8.3.0 trunk (commit 62fc15f) (db_​bench), 4 threads per instance, 64 RocksDB instances, tested by Intel October 2023. 8180: 1-node, Intel platform with 2x 1st Gen Intel Xeon Scalable processor (28 cores), HT On, Turbo On, SNC off, Total Memory 768GB (12x64GB DDR4 2666), microcode 0x2007006, 2x Ethernet Connection X722 for 10GBASE-T, 1x 894.3G Micron_​7450_​MTFDKBA960TFR, Ubuntu 22.04.3 LTS, 6.5.0-060500-generic, ZSTD v1.5.5, gcc 10.4.0, RocksDB v8.3.0 trunk (commit 62fc15f) (db_​bench), 4 threads per instance, 28 RocksDB instances, tested by Intel October 2023. For a 50 server fleet of Intel Xeon 8180, estimated as of October 2023: CapEx costs: $0, existing servers OpEx costs (4 year, includes power and cooling utility costs, infrastructure and hardware maintenance costs): $685.6K Energy use in kWh (4 year, per server): 33,751, PUE 1.6 Other assumptions: utility cost $0.1/kWh, kWh to kg CO2 factor 0.42394 For a 9 server fleet of 5th Gen Xeon 8592+ as of October 2023 CapEx costs: $350.7K OpEx costs (4 year, includes power and cooling utility costs, infrastructure and hardware maintenance costs): $142.6K Energy use in kWh (4 year, per server): 55111, PUE 1.6 Other assumptions: utility cost $0.1/kWh, kWh to kg CO2 factor 0.42394 Costs based on Intel estimates and information from thinkmate.com as of October 2023. RocksDB Test by Intel October 2023
[T6] WEB - 40% lower TCO by refreshing 5-year platform with fewer 5th Gen Intel Xeon Scalable platforms to meet the same performance requirement. 5th Generation Intel® Xeon® Platinum processor Claim: 5th Gen Intel Xeon delivers up to 40% lower TCO than the 1st Gen Intel Xeon while running a NGINX TLS Handshake workload. Based on 5th Gen Intel Xeon delivers up to a 7.92x faster than the Gen 1st Gen Intel Xeon while running a NGINX TLS Handshake workload. This performance drives a fleet a reduction from 50 to 7 servers which, over 4 years, saves: 843.5 MWH of energy, 357,586 kgCo2 emissions, and $254.4k of cost. 8592+: 1-node, 2x 5th Gen Intel Xeon Scalable processor (64 core) with integrated Intel Quick Assist Technology (Intel QAT), HT On, Turbo Off, SNC On, with 1024GB DDR5 memory (16x64 GB 5600), microcode 0x21000161, Ubuntu 22.04.3 LTS, 5.15.0-78-generic, 1x 1.7T SAMSUNG MZWLJ1T9HBJR-00007, 1x Intel® Ethernet Network Adapter E810-2CQDA2, 1x100GbE, NGINX Async v0.5.1, OpenSSL 3.1.3, IPP Crypto 2021.8, IPsec MB v 1.4, QAT _​Engine v 1.4.0, QAT Driver 20.l.1.1..20-00030, TLS 1.3 Webserver: ECDHE-X25519-RSA2K, tested by Intel October 2023. 8180: 1-node, Intel platform with 2x 1st Gen Intel Xeon Scalable processor (28 cores), HT On, Turbo Off, SNC off, Total Memory 768GB (12x64GB DDR4 2666), microcode 0x2007006, Ubuntu 22.04.3 LTS, 5.15.0-78-generic, 1x 1.7T SAMSUNG MZWLJ1T9HBJR-00007, 1x Intel® Ethernet Network Adapter E810-2CQDA2, 1x100GbE, NGINX Async v0.5.1, OpenSSL 3.1.3, TLS 1.3 Webserver: ECDHE-X25519-RSA2K, tested by Intel October 2023. For a 50 server fleet of Intel Xeon 8180, estimated as of October 2023: CapEx costs: $0, existing servers OpEx costs (4 year, includes power and cooling utility costs, infrastructure and hardware maintenance costs): $631.2K Energy use in kWh (4 year, per server): 22874, PUE 1.6 Other assumptions: utility cost $0.1/kWh, kWh to kg CO2 factor 0.42394 For a 7 server fleet of 5th Gen Xeon 8592+ as of October 2023 CapEx costs: $1.21M OpEx costs (4 year, includes power and cooling utility costs, infrastructure and hardware maintenance costs): $102.4K Energy use in kWh (4 year, per server): 42889, PUE 1.6 Other assumptions: utility cost $0.1/kWh, kWh to kg CO2 factor 0.42394 Costs based on Intel estimates and information from thinkmate.com as of October 2023. NGINX TLS Handshake Test by Intel October 2023
[T7] AI NLP - 77% lower TCO by refreshing 5-year platform with fewer 5th Gen Intel Xeon Scalable platforms to meet the same performance requirement. 5th Generation Intel® Xeon® Platinum processor Claim: 5th Gen Intel Xeon delivers up to 77% lower TCO than the 1st Gen Intel Xeon while running a batched Natural Language Processing inference (BERT-Large) workload. Based on 5th Gen Intel Xeon delivers up to a 24.2x faster than the Intel Xeon while running a batched Natural Language Processing inference (BERT-Large) workload. This performance drives a fleet a reduction from 50 to 3 servers which, over 4 years, saves: 1697.1 MWH of energy, 719,458 kgCo2 emissions, and $541.0k of cost. 8592+: 1-node, 2x Intel(R) Xeon(R) Platinum 8592+, 64 cores, HT On, Turbo On, NUMA 2, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 2.0, microcode 0x21000161, 2x Ethernet Controller X710 for 10GBASE-T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.2 LTS, 5.15.0-78-generic. Framework=Pytorch 2.0, IPEX=2.0, Python 3.8, AI Model=BERT Large(https://github.com/IntelAI/models/) , Batched Results: best scores achieved using BFloat16, INT8-AMX (BS >1), Test by INTEL as of 10/10/2023. 8180: 1-node, Intel platform with 2x 1st Gen Intel Xeon Scalable processor (28 cores), HT On, Turbo On, NUMA 2, Total Memory 768GB (12x64GB DDR4 2666), BIOS 3.8b, microcode 0x2007006, 2x Ethernet Controller X710 for 10GBASE-T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.2 LTS, 5.15.0-78-generic. Framework=Pytorch 2.0, IPEX=2.0, Python 3.8, AI Model=BERT Large(https://github.com/IntelAI/models/) , Batched Results: best scores achieved using BS >1, Test by INTEL as of 10/10/2023. For a 50 server fleet of Intel Xeon 8180, estimated as of October 2023: CapEx costs: $0, existing servers OpEx costs (4 year, includes power and cooling utility costs, infrastructure and hardware maintenance costs): $705.2K Energy use in kWh (4 year, per server): 37675, PUE 1.6 Other assumptions: utility cost $0.1/kWh, kWh to kg CO2 factor 0.42394 For a 21 server fleet of 5th Gen Xeon 8592+ as of October 2023 CapEx costs: $114.5K OpEx costs (4 year, includes power and cooling utility costs, infrastructure and hardware maintenance costs): $49.7K Energy use in kWh (4 year, per server): 62225, PUE 1.6 Other assumptions: utility cost $0.1/kWh, kWh to kg CO2 factor 0.42394 Costs based on Intel estimates and information from thinkmate.com as of October 2023. Natural Language Processing inference (BERT-Large) Test by Intel October 2023
[T8] AI Recommender- 67% lower TCO by refreshing 5-year platform with fewer 5th Gen Intel Xeon Scalable platforms to meet the same performance requirement. 5th Generation Intel® Xeon® Platinum processor Claim: 5th Gen Intel Xeon delivers up to 67% lower TCO than the 1st Gen Intel Xeon while running batched AI Recommender (DLRM) workload. Based on 5th Gen Intel Xeon delivers up to a 15.4x faster than the 1st Gen Intel Xeon while running a batched AI Recommender (DLRM) workload. This performance drives a fleet a reduction from 50 to 4 servers which, over 4 years, saves: 1259.2 MWH of energy, 533,822 kgCo2 emissions, and $448.7k of cost. 8592+: 1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores, HT On, Turbo On, NUMA 2, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 2.0, microcode 0x21000161, 2x Ethernet Controller X710 for 10GBASE-T, 1x Ethernet interface, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.2 LTS, 5.15.0-78-generic, Test by Intel as of 10/10/23. Software configuration: DLRM, Intel Model Zoo:DLBoost package - WW35 release, gcc=12.3, OneDNN3.2, Python 3.8, PyTorch2.1, IPEX2.1, physical cores only.BS=N. Batched Results: best scores achieved using BFloat16, INT8-AMX (BS >1). 8180: 1-node, Intel platform with 2x 1st Gen Intel Xeon Scalable processor (28 cores), HT On, Turbo On, NUMA 2, Total Memory 768GB (12x64GB DDR4 2666), BIOS 3.8b, microcode 0x2007006, 2x Ethernet Controller X710 for 10GBASE-T, 1x Ethernet interface, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.2 LTS, 5.15.0-78-generic, Test by COMPANY as of 10/10/23. Software configuration: DLRM, Intel Model Zoo:DLBoost package - WW35 release, gcc=12.3, OneDNN3.2, Python 3.8, PyTorch2.1, IPEX2.1, physical cores only.BS=N. Batched Results: best scores achieved using BS >1. For a 50 server fleet of Intel Xeon 8180, estimated as of October 2023: CapEx costs: $0, existing servers OpEx costs (4 year, includes power and cooling utility costs, infrastructure and hardware maintenance costs): $666.1K Energy use in kWh (4 year, per server): 29865, PUE 1.6 Other assumptions: utility cost $0.1/kWh, kWh to kg CO2 factor 0.42394 For a 4 server fleet of 5th Gen Xeon 8592+ as of October 2023 CapEx costs: $152.6K OpEx costs (4 year, includes power and cooling utility costs, infrastructure and hardware maintenance costs): $64.8K Energy use in kWh (4 year, per server): 58517, PUE 1.6 Other assumptions: utility cost $0.1/kWh, kWh to kg CO2 factor 0.42394 Costs based on Intel estimates and information from thinkmate.com as of October 2023. AI Recommender (DLRM) Test by Intel October 2023
[T9] DataServices - 61% lower TCO by deploying fewer 5th Gen Intel® Xeon® processor-based servers to meet the same performance requirement. 5th Generation Intel® Xeon® Platinum processor Claim: 5th Gen Intel Xeon delivers up to 61% lower TCO than the 3rd Gen Intel Xeon while running a RocksDB database workload. Based on 5th Gen Intel Xeon delivers up to a 3.76x faster than 3rd Gen Intel Xeon while running a RocksDB database workload. This performance drives a fleet a reduction from 50 to 14 servers which, over 4 years, saves: 1482.2 MWH of energy, 628,372 kgCo2 emissions, and $1,197.6k of cost. 8592+: 1-node, 2x 5th Gen Intel Xeon Scalable processor 8592+ (64 cores) with integrated Intel In-Memory Analytics Accelerator (Intel IAA), Number of IAA device utilized=8(2 sockets active), HT On, Turbo On, SNC off, Total Memory 1024GB (16x64GB DDR5 5600), microcode 0x21000161, 2x Ethernet Controller 10-Gigabit X540-AT2, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 6.5.0-060500-generic, QPL v1.2.0, accel-config-v4.0, iaa_​compressor plugin v0.3.0, ZSTD v1.5.5, gcc 10.4.0, RocksDB v8.3.0 trunk (commit 62fc15f) (db_​bench), 4 threads per instance, 64 RocksDB instances, tested by Intel October 2023. 8380: 1-node, Production Intel platform with 2x 3rd Gen Intel Xeon Scalable processor (40 cores) withHT On, Turbo On, SNC off, Total Memory 1024GB (16x64GB DDR5 3200), microcode 0xd0003a5, 2x Ethernet Controller 10-Gigabit X540-AT2, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 6.5.0-060500-generic, ZSTD v1.5.5, gcc 10.4.0, RocksDB v8.3.0 trunk (commit 62fc15f) (db_​bench), 4 threads per instance, 40 RocksDB instances, tested by Intel October 2023. For a 50 server fleet of Intel Xeon 8380, estimated as of October 2023: CapEx costs: $1,222.8K OpEx costs (4 year, includes power and cooling utility costs, infrastructure and hardware maintenance costs): $742.2K Energy use in kWh (4 year, per server): 45075, PUE 1.6 Other assumptions: utility cost $0.1/kWh, kWh to kg CO2 factor 0.42394 For a 14 server fleet of 5th Gen Xeon 8592+ as of October 2023 CapEx costs: $545.5K OpEx costs (4 year, includes power and cooling utility costs, infrastructure and hardware maintenance costs): $221.9K Energy use in kWh (4 year, per server): 55111, PUE 1.6 Other assumptions: utility cost $0.1/kWh, kWh to kg CO2 factor 0.42394 Costs based on Intel estimates and information from thinkmate.com as of October 2023. RocksDB Test by Intel October 2023
[T10] WEB - 22% lower TCO by deploying fewer 5th Gen Intel® Xeon® processor-based servers to meet the same performance requirement. 5th Generation Intel® Xeon® Platinum processor Claim: 5th Gen Intel Xeon delivers up to 22% lower TCO than the 3rd Gen Intel Xeon while running a NGINX TLS Handshake workload. Based on 5th Gen Intel Xeon delivers up to a 1.73x faster than the Gen 3rd Gen Intel Xeon while running a NGINX TLS Handshake workload. This performance drives a fleet a reduction from 50 to 29 servers which, over 4 years, saves: 869.8 MWH of energy, 368,757 kgCo2 emissions, and $441.9k of cost. 8592+: 1-node, 2x 5th Gen Intel Xeon Scalable processor (64 core) with integrated Intel Quick Assist Technology (Intel QAT), HT On, Turbo Off, SNC On, with 1024GB DDR5 memory (16x64 GB 5600), microcode 0x21000161, Ubuntu 22.04.3 LTS, 5.15.0-78-generic, 1x 1.7T SAMSUNG MZWLJ1T9HBJR-00007, 1x Intel® Ethernet Network Adapter E810-2CQDA2, 1x100GbE, NGINX Async v0.5.1, OpenSSL 3.1.3, IPP Crypto 2021.8, IPsec MB v 1.4, QAT _​Engine v 1.4.0, QAT Driver 20.l.1.1..20-00030, TLS 1.3 Webserver: ECDHE-X25519-RSA2K, tested by Intel October 2023. 8380: 1-node, Intel platform with 2x 3rd Gen Intel Xeon Scalable processor (40 cores), HT On, Turbo Off, SNC off, Total Memory 1024GB (16x64GB DDR4 3200), microcode 0xd0003a5, HT On, Turbo On, SNC Off, Ubuntu 22.04.3 LTS, 5.15.0-78-generic, 1x 1.7T SAMSUNG MZWLJ1T9HBJR-00007, 1x Intel® Ethernet Network Adapter E810-2CQDA2, 1x100GbE, NGINX Async v0.5.1, OpenSSL 3.1.3, IPP Crypto 2021.8, IPsec MB v 1.4, QAT _​Engine v 1.4.0, TLS 1.3 Webserver: ECDHE-X25519-RSA2K tested by Intel October 2023. For a 50 server fleet of Intel Xeon 8380, estimated as of October 2023: CapEx costs: $1,274.7K OpEx costs (4 year, includes power and cooling utility costs, infrastructure and hardware maintenance costs): $728.2K Energy use in kWh (4 year, per server): 42272, PUE 1.6 Other assumptions: utility cost $0.1/kWh, kWh to kg CO2 factor 0.42394 For a 29 server fleet of 5th Gen Xeon 8592+ as of October 2023 CapEx costs: $1,136.8K OpEx costs (4 year, includes power and cooling utility costs, infrastructure and hardware maintenance costs): $424.1K Energy use in kWh (4 year, per server): 42889, PUE 1.6 Other assumptions: utility cost $0.1/kWh, kWh to kg CO2 factor 0.42394 Costs based on Intel estimates and information from thinkmate.com as of October 2023. NGINX TLS Handshake Test by Intel October 2023
[T11] AI NLP - 64% lower TCO by deploying fewer 5th Gen Intel® Xeon® processor-based servers to meet the same performance requirement. 5th Generation Intel® Xeon® Platinum processor Claim: 5th Gen Intel Xeon delivers up to 64% lower TCO than the 3rd Gen Intel Xeon while running a batched Natural Language Processing inference (BERT-Large) workload. Based on 5th Gen Intel Xeon delivers up to a 3.88x faster than the 3rd Gen Xeon while running a batched Natural Language Processing inference (BERT-Large) workload. This performance drives a fleet a reduction from 50 to 13 servers which, over 4 years, saves: 1,643.6 MWH of energy, 696,768 kgCo2 emissions, and $1,273.4K of cost. 8592+: 1-node, 2x Intel(R) Xeon(R) Platinum 8592+, 64 cores, HT On, Turbo On, NUMA 2, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 2.0, microcode 0x21000161, 2x Ethernet Controller X710 for 10GBASE-T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.2 LTS, 5.15.0-78-generic. Framework=Pytorch 2.0, IPEX=2.0, Python 3.8, AI Model=BERT Large(https://github.com/IntelAI/models/) , Batched Results: best scores achieved using BFloat16, INT8-AMX (BS >1), Test by INTEL as of 10/10/2023. 8380: 1-node, Intel platform with 2x 3rd Gen Intel Xeon Scalable processor (40 cores), HT On, Turbo On, SNC off, Total Memory 1024GB (16x64GB DDR4 3200), BIOS 1.5, microcode 0xd0003a5, 2x Ethernet Controller X710 for 10GBASE-T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.2 LTS, 5.15.0-78-generic. Framework=Pytorch 2.0, IPEX=2.0, Python 3.8, AI Model=BERT Large(https://github.com/IntelAI/models/) , Batched Results: best scores achieved using BFloat16, INT8-AMX (BSN >1), Test by INTEL as of 10/10/2023. For a 50 server fleet of Intel Xeon 8380, estimated as of October 2023: CapEx costs: $1,222.8K OpEx costs (4 year, includes power and cooling utility costs, infrastructure and hardware maintenance costs): $762.0K Energy use in kWh (4 year, per server): 49050, PUE 1.6 Other assumptions: utility cost $0.1/kWh, kWh to kg CO2 factor 0.42394 For a 13 server fleet of 5th Gen Xeon 8592+ as of October 2023 CapEx costs: $496.1K OpEx costs (4 year, includes power and cooling utility costs, infrastructure and hardware maintenance costs): $215.3K Energy use in kWh (4 year, per server): 62225, PUE 1.6 Other assumptions: utility cost $0.1/kWh, kWh to kg CO2 factor 0.42394 Costs based on Intel estimates and information from thinkmate.com as of October 2023. Natural Language Processing inference (BERT-Large) Test by Intel October 2023
[T12] 5th Gen Intel Xeon delivers up to 72% lower TCO than the 3rd Gen Intel Xeon while running batched AI Recommender (DLRM) workload. 5th Generation Intel® Xeon® Platinum processor Claim: 5th Gen Intel Xeon delivers up to 72% lower TCO than the 3rd Gen Intel Xeon while running batched AI Recommender (DLRM) workload. Based on 5th Gen Intel Xeon delivers up to a 5.12x faster than the 3rd Gen Intel Xeon while running a batched AI Recommender (DLRM) workload. This performance drives a fleet a reduction from 50 to 10 servers which, over 4 years, saves: 1704.5 MWH of energy, 722,607 kgCo2 emissions, and $1,425.0k of cost. 8592+: 1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores, HT On, Turbo On, NUMA 2, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 2.0, microcode 0x21000161, 2x Ethernet Controller X710 for 10GBASE-T, 1x Ethernet interface, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.2 LTS, 5.15.0-78-generic, Test by Intel as of 10/10/23. Software configuration: DLRM, Intel Model Zoo:DLBoost package - WW35 release, gcc=12.3, OneDNN3.2, Python 3.8, PyTorch2.1, IPEX2.1, physical cores only.BS=N. Batched Results: best scores achieved using BS>1, Precision=INT8-AMX. 8380: 1-node, Intel platform with 2x 3rd Gen Intel Xeon Scalable processor (40 cores), HT On, Turbo On, SNC off, Total Memory 1024GB (16x64GB DDR4 3200), BIOS 1.5, microcode 0xd0003a5, 2x Ethernet Controller X710 for 10GBASE-T, 1x Ethernet interface, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.2 LTS, 5.15.0-78-generic, Test by Intel as of 10/10/23. Software configuration: DLRM, Intel Model Zoo:DLBoost package - WW35 release, gcc=12.3, OneDNN3.2, Python 3.8, PyTorch2.1, IPEX2.1, physical cores only.BS=N. Batched Results: best scores achieved using BS>1. For a 50 server fleet of Intel Xeon 8380, estimated as of October 2023: CapEx costs: $1,222.8K OpEx costs (4 year, includes power and cooling utility costs, infrastructure and hardware maintenance costs): $745.8K Energy use in kWh (4 year, per server): 45794, PUE 1.6 Other assumptions: utility cost $0.1/kWh, kWh to kg CO2 factor 0.42394 For a 10 server fleet of 5th Gen Xeon 8592+ as of October 2023 CapEx costs: $381.6K OpEx costs (4 year, includes power and cooling utility costs, infrastructure and hardware maintenance costs): $161.9K Energy use in kWh (4 year, per server): 58517, PUE 1.6 Other assumptions: utility cost $0.1/kWh, kWh to kg CO2 factor 0.42394 Costs based on Intel estimates and information from thinkmate.com as of October 2023. AI Recommender (DLRM) Test by Intel October 2023
[T13] 1.36x higher average performance/watt across workloads with 5th Gen Intel Xeon Scalable processor vs. 4th Gen Intel Xeon Scalable processor 5th Generation Intel® Xeon® Platinum processor Geomean of "DeathStar Bench- Social Network, MySQL Database, OpenFOAM, ResNet34 Inference, VPP-FIB This offering is not approved or endorsed by OpenCFD Limited, producer and distributor of the OpenFOAM software via www.openfoam.com, and owner of the OPENFOAM® and OpenCFD® trademark. Deathstar Bench Social Network: 8592+:1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores, HT On, Turbo On, NUMA 4, Integrated Accelerators Available [used]: DLB 2 [0], DSA 2 [0], IAA 2 [0], QAT 2 [0], Total Memory 1024GB (32x32GB DDR5 4800 MT/s [4400 MT/s]), BIOS EGSDCRB1.86B.0105.D74.2308261927, microcode 0xa1000161, 1x Ethernet Controller I225-LM, 2x Ethernet Controller E810-C for QSFP, 2x Ethernet Controller XXV710 for 25GbE SFP28, 1x 1.8T INTEL SSDPELKX020T8, Ubuntu 22.04.2 LTS, 5.15.0-86-generic, DeathStarBench socialNetwork, image: deathstarbench/social-network-microservices:0.0.8, load generaor: open-loop wrk2 within DeathStarBench . Test by Intel as of 10/19/23. 8480+:1-node, 2x Intel(R) Xeon(R) Platinum 8480+, 56 cores, HT On, Turbo On, NUMA 2, Integrated Accelerators Available [used]: DLB 2 [0], DSA 2 [0], IAA 2 [0], QAT 2 [0], Total Memory 1024GB (32x32GB DDR5 4800 MT/s [4400 MT/s]), BIOS EGSDCRB1.SYS.0370.P01.2306190739, microcode 0xab0004e0, 1x Ethernet Controller I225-LM, 2x Ethernet Controller E810-C for QSFP, 2x Ethernet Controller XXV710 for 25GbE SFP28, 1x 931.5G INTEL SSDPELKX010T8, Ubuntu 22.04.1 LTS, 5.15.0-86-generic, DeathStarBench socialNetwork, image: deathstarbench/social-network-microservices:0.0.8, load generaor: open-loop wrk2 within DeathStarBench Test by Intel as of 10/06/23. https://github.com/delimitrou/DeathStarBench#publications HammerDB-MySQL: 8592+: 1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores, HT On, Turbo On, NUMA 2, Integrated Accelerators Available [used]: DLB 8 [0], DSA 8 [0], IAX 8 [0], QAT 8 [0], Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 2.0, microcode 0x21000161, 2x Ethernet Controller X710 for 10GBASE-T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, 2x 1.7T SAMSUNG MZWLJ1T9HBJR-00007, Ubuntu 22.04.3 LTS, 5.15.0-84-generic, HammerDB Multi Instance, MySQL 8.0.33. Test by Intel as of 10/04/23. 8480+: 1-node, 2x Intel(R) Xeon(R) Platinum 8480+, 56 cores, HT On, Turbo On, NUMA 2, Integrated Accelerators Available [used]: DLB 8 [0], DSA 8 [0], IAX 8 [0], QAT 8 [0], Total Memory 1024GB (16x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 2.0, microcode 0x2b0004d0, 2x Ethernet Controller X710 for 10GBASE-T, 2x 1.7T SAMSUNG MZWLJ1T9HBJR-00007, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 5.15.0-84-generic, HammerDB Multi Instance, MySQL 8.0.33, Test by Intel as of 09/30/23. OpenFOAM (Geomean of MotorBike 20M, MotorBike 42M) Intel Xeon 8380: 1-node, 2x 3rd Gen Intel Xeon 8380, HT On, Turbo On, SNC2, 1024 GB DDR4-3200, ucode=0xd0003a5, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_​7.x86_​64, OpenFOAM v8, ifort:2023.2.0 icc:2023.2.0, impi:2021.10.0. Test by Intel as of October 2023. Intel Xeon 8490H: 1-node, 2x 4th Gen Intel Xeon 8490H, HT On, Turbo On, SNC4, 1024 GB DDR4-4800, ucode=0x2b0004d0, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_​7.x86_​64, OpenFOAM v8, ifort:2023.2.0 icc:2023.2.0, impi:2021.10.0. Test by Intel as of March 2023. This offering is not approved or endorsed by OpenCFD Limited, producer and distributor of the OpenFOAM software via www.openfoam.com, and owner of the OPENFOAM® and OpenCFD® trademark PyTorch SSD-RN34 Inference: 8592+: 1-node, 2x Intel(R) Xeon(R) Platinum 8592+, 64 cores, HT On, Turbo On, NUMA 4, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS EGSDCRB1.SYS.0105.D74.2308261933, microcode 0x21000161, 1x Ethernet Controller I225-LM, 1x 3.6T INTEL SSDPE2KX040T8, 1x 931.5G INTEL, CentOS Stream 9, 6.2.0-emr.bkc.6.2.3.6.31.x86_​64. PyTorch: torch:2.1.0.dev20230825+cpu, oneDNN:v3.2.1 IPEX:2.1.0+git31b5ee1, Test by INTEL as of 09/07/2023. 8480+: 1-node, 2x Intel(R) Xeon(R) Platinum 8480+, 56 cores, HT On, Turbo On, NUMA 2, Total Memory 1024GB (16x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS EGSDCRB1.SYS.0102.D37.2305081420, microcode 0x2b0004b1, 1x Ethernet Controller I225-LM, 1x 7.2G Cruzer Blade, 2x 3.7T INTEL SSDPE2KX040T8, 1x 894.3G INTEL SSDSC2KG96, CentOS Stream 8, 5.15.0-spr.bkc.pc.16.4.24.x86_​64. PyTorch: torch:2.1.0.dev20230825+cpu oneDNN:v3.2.1 IPEX:2.1.0+git31b5ee1. Test by INTEL as of 09/05/2023. SSD-ResNet34​, BS=x: 1 instance/ numa node; SSD-Resnet34 coco 2017 (1200 x1200) VPP IPv4 FIB: 8592+: 1-node, 2x Xeon(R) Platinum 8592+, 64 cores, HT On, Turbo Off, NUMA 2, Total Memory 512GB (16x32GB DDR5 5600 MT/s [5600 MT/s]), BIOS EGSDCRB1.SYS.0105.D74.2308261933, microcode 0x21000161, 1x Ethernet Controller I225-LM, 1x 223.6G INTEL SSDSC2KB240G8, 1x 240M Disk, Ubuntu 22.04 LTS, 5.15.0-27-generic, VPP ipv4 FIB, 23.10-rc0~0-ga7dd04d73, gcc (Ubuntu 9.4.0-5ubuntu1) 9.4.0 ,.Test by Intel as of 09/25/23. 8470N: 1-node, 2x Intel(R) Xeon(R) Platinum 8470N, 52 cores, HT On, Turbo Off, NUMA 2, Integrated Accelerators Available [used]: DLB 8 [0], DSA 8 [0], IAA 0 [0], QAT 8 [0], Total Memory 512GB (16x32GB DDR5 5600 MT/s [4800 MT/s]), BIOS EGSDCRB1.SYS.0102.D37.2305081420, microcode 0x2b0004b1, 1x Ethernet Controller I225-LM, 1x 223.6G INTEL SSDSC2KB240G8, Ubuntu 22.04 LTS, 5.15.0-27-generic, VPP ipv4 FIB, 23.10-rc0~0-ga7dd04d73, gcc (Ubuntu 9.4.0-5ubuntu1) 9.4.0,Test by Intel as of 10/02/23. Summary Perf/Watt across workloads Test by Intel March and October 2023
[T201] 5th Gen Intel Xeon delivers up to 24% lower TCO than the 4th Gen AMD EPYC while running a HammerDB MySQL OLTP database workload. 5th Generation Intel® Xeon® Platinum processor Claim: 5th Gen Intel Xeon delivers up to 24% lower TCO than the 4th Gen AMD Epyc while running a HammerDB MySQL OLTP database workload. Based on 5th Gen Intel Xeon delivers up to a 1.70x faster than the 4th Gen AMD Epyc while running a HammerDB MySQL OLTP workload. This performance drives a fleet reduction from 50 to 30 servers which, over 4 years, saves: 684.0 MWH of energy, 289,967 kgCo2 emissions, and $508.9k of cost. 1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores, HT On, Turbo On, NUMA 2, Integrated Accelerators Available [used]: DLB 8 [0], DSA 8 [0], IAX 8 [0], QAT 8 [0], Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 2.0, microcode 0x21000161, 2x Ethernet Controller X710 for 10GBASE-T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, 2x 1.7T SAMSUNG MZWLJ1T9HBJR-00007, Ubuntu 22.04.3 LTS, 5.15.0-84-generic, HammerDB Mv4.4, MySQL 8.0.33. Test by Intel as of 10/04/23. 1-node, 2x AMD EPYC 9554 64-Core Processor, 64 cores, HT On, Turbo On, NUMA 2, Integrated Accelerators Available [used]: DLB 0 [0], DSA 0 [0], IAX 0 [0], QAT 0 [0], Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 1.5, microcode 0xa10113e, 2x Ethernet Controller X710 for 10GBASE-T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, 2x 1.7T SAMSUNG MZWLJ1T9HBJR-00007, Ubuntu 22.04.3 LTS, 5.15.125-0515125-generic, HammerDB v4.4, MySQL 8.0.33. Test by Intel as of 10/05/23. For a 50 server fleet of AMD EPYC 9554, estimated as of October 2023: CapEx costs: $1.40M OpEx costs (4 year, includes power and cooling utility costs, infrastructure and hardware maintenance costs): $755.1K Energy use in kWh (4 year, per server): 47654, PUE 1.6 Other assumptions: utility cost $0.1/kWh, kWh to kg CO2 factor 0.42394 For a 30 server fleet of 5th Gen Xeon 8592+ as of October 2023 CapEx costs: $1.17M OpEx costs (4 year, includes power and cooling utility costs, infrastructure and hardware maintenance costs): $480.0K Energy use in kWh (4 year, per server): 58625, PUE 1.6 Other assumptions: utility cost $0.1/kWh, kWh to kg CO2 factor 0.42394 Costs based on Intel estimates and information from thinkmate.com as of October 2023. TCO savings on HammerDB MySQL Test by Intel October 2023
[T202] 5th Gen Intel Xeon delivers up to 22% lower TCO than the 4th Gen AMD EPYC while running a RocksDB database workload. 5th Generation Intel® Xeon® Platinum processor Claim: 5th Gen Intel Xeon delivers up to 22% lower TCO than the 4th Gen AMD Epyc while running a RocksDB database workload. Based on 5th Gen Intel Xeon delivers up to a 1.62x faster than the 4th Gen AMD Epyc while running a RocksDB database workload. This performance drives a fleet a reduction from 50 to 31 servers which, over 4 years, saves: 1,218 MWH of energy, 516,402 kgCo2 emissions, and $471.8k of cost. 8592+: 1-node, 2x 5th Gen Intel Xeon Scalable processor 8592+ (64 cores) with integrated Intel In-Memory Analytics Accelerator (Intel IAA), Number of IAA device utilized=8(2 sockets active), HT On, Turbo On, SNC off, Total Memory 1024GB (16x64GB DDR5 5600), microcode 0x21000161, 2x Ethernet Controller 10-Gigabit X540-AT2, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 6.5.0-060500-generic, QPL v1.2.0, accel-config-v4.0, iaa_​compressor plugin v0.3.0, ZSTD v1.5.5, gcc 10.4.0, RocksDB v8.3.0 trunk (commit 62fc15f) (db_​bench), 4 threads per instance, 64 RocksDB instances, tested by Intel October 2023. 9554: 1-node, AMD platform with 2x 4th Gen AMD EPYC processor (64 cores), SMT On, Core Performance Boost On, NPS1, Total Memory 1024GB (16x64GB DDR5 4800), microcode 0xa10113e, 2x Ethernet Controller 10G X550T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 6.5.0-060500-generic, ZSTD v1.5.5, gcc 10.4.0, RocksDB v8.3.0 trunk (commit 62fc15f) (db_​bench), 4 threads per instance, 28 RocksDB instances, tested by Intel October 2023. For a 50 server fleet of AMD EPYC 9554, estimated as of October 2023: CapEx costs: $1.36M OpEx costs (4 year, includes power and cooling utility costs, infrastructure and hardware maintenance costs): $809.5K Energy use in kWh (4 year, per server): 58531, PUE 1.6 Other assumptions: utility cost $0.1/kWh, kWh to kg CO2 factor 0.42394 For a 31 server fleet of 5th Gen Xeon 8592+ as of October 2023 CapEx costs: $1.21M OpEx costs (4 year, includes power and cooling utility costs, infrastructure and hardware maintenance costs): $491.3K Energy use in kWh (4 year, per server): 55111, PUE 1.6 Other assumptions: utility cost $0.1/kWh, kWh to kg CO2 factor 0.42394 Costs based on Intel estimates and information from thinkmate.com as of October 2023. TCO savings on RocksDB Test by Intel October 2023
[T203] 5th Gen Intel Xeon delivers up to 21% lower TCO than the 4th Gen AMD EPYC while running a NGINX TLS Handshake workload. 5th Generation Intel® Xeon® Platinum processor Claim: 5th Gen Intel Xeon delivers up to 21% lower TCO than the 4th Gen AMD Epyc while running a NGINX TLS Handshake workload. Based on 5th Gen Intel Xeon delivers up to a 1.66x faster than the 4th Gen AMD Epyc while running a NGINX TLS Handshake workload. This performance drives a fleet a reduction from 50 to 31 servers which, over 4 years, saves: 489.7 MWH of energy, 207,611 kgCo2 emissions, and $443.5k of cost. 8592+: 1-node, 2x 5th Gen Intel Xeon Scalable processor (64 core) with integrated Intel Quick Assist Technology (Intel QAT), Integrated Accelerators Available [used]: DLB 2 [0], DSA 2 [0], IAA 2 [0], QAT 2 [0], HT On, Turbo Off, SNC On, with 1024GB DDR5 memory (16x64 GB 5600), microcode 0x21000161, Ubuntu 22.04.3 LTS, 5.15.0-78-generic, 1x 1.7T SAMSUNG MZWLJ1T9HBJR-00007, 1x Intel® Ethernet Network Adapter E810-2CQDA2, 1x100GbE, NGINX Async v0.5.1, OpenSSL 3.1.3, IPP Crypto 2021.8, IPsec MB v 1.4, QAT _​Engine v 1.4.0, QAT Driver 20.l.1.1..20-00030, TLS 1.3 Webserver: ECDHE-X25519-RSA2K, tested by Intel October 2023. 9554: 1-node, AMD platform with 2x 4th Gen AMD EPYC processor (64 cores), SMT On, Core Performance Boost Off, NPS1, Total Memory 1536GB (24x64GB DDR5 4800), microcode 0xa10113e, Ubuntu 22.04.3 LTS, 5.15.0-78-generic, 1x 1.7T SAMSUNG MZWLJ1T9HBJR-00007, 1x Intel® Ethernet Network Adapter E810-2CQDA2, 1x100GbE, NGINX Async v0.5.1, OpenSSL 3.1.3, TLS 1.3 Webserver: ECDHE-X25519-RSA2K,tested by Intel October 2023. For a 50 server fleet of AMD EPYC 9554, estimated as of October 2023: CapEx costs: $1.41M OpEx costs (4 year, includes power and cooling utility costs, infrastructure and hardware maintenance costs): $698.7K Energy use in kWh (4 year, per server): 36386, PUE 1.6 Other assumptions: utility cost $0.1/kWh, kWh to kg CO2 factor 0.42394 For a 31 server fleet of 5th Gen Xeon 8592+ as of October 2023 CapEx costs: $1.21M OpEx costs (4 year, includes power and cooling utility costs, infrastructure and hardware maintenance costs): $453.4K Energy use in kWh (4 year, per server): 42889, PUE 1.6 Other assumptions: utility cost $0.1/kWh, kWh to kg CO2 factor 0.42394 Costs based on Intel estimates and information from thinkmate.com as of October 2023. TCO savings on NGINX TLS Handshake Test by Intel October 2023
[T204] 5th Gen Intel Xeon delivers up to 27% lower TCO than the 4th Gen AMD EPYC while running Monte Carlo workload. 5th Generation Intel® Xeon® Platinum processor Claim: 5th Gen Intel Xeon delivers up to 27% lower TCO than the 4th Gen AMD Epyc while running Monte Carlo workload. Based on 5th Gen Intel Xeon delivers up to a 1.83x faster than the 4th Gen AMD Epyc while running a Monte Carlo workload. This performance drives a fleet a reduction from 50 to 28 servers which, over 4 years, saves: 585.8 MWH of energy, 248,352 kgCo2 emissions, and $561.0k of cost. 8592+: 1-node 2x Intel Xeon 8592+, HT On, Turbo On, SNC2, 1024 GB DDR5-5600, ucode 0x21000161, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_​7.x86_​64, Monte Carlo v1.2, cmkl:2023.2.0 icc:2023.2.0 tbb:2021.10.0. Test by Intel as of October 2023. AMD EPYC 9554: 1-node, 2x AMD EPYC 9554, SMT On, Turbo On, CTDP=360W, NPS=4, 1536GB DDR5-4800, ucode= 0xa101111, Red Hat Enterprise Linux 8.7, Kernel 4.18,Monte Carlo v1.2, cmkl:2023.2.0 icc:2023.2.0 tbb:2021.10.0. Test by Intel as of March 2023 For a 50 server fleet of AMD EPYC 9554, estimated as of October 2023: CapEx costs: $1.36M OpEx costs (4 year, includes power and cooling utility costs, infrastructure and hardware maintenance costs): $739.3K Energy use in kWh (4 year, per server): 44505, PUE 1.6 Other assumptions: utility cost $0.1/kWh, kWh to kg CO2 factor 0.42394 For a 28 server fleet of 5th Gen Xeon 8592+ as of October 2023 CapEx costs: $1.09M OpEx costs (4 year, includes power and cooling utility costs, infrastructure and hardware maintenance costs): $453.3K Energy use in kWh (4 year, per server): 58550, PUE 1.6 Other assumptions: utility cost $0.1/kWh, kWh to kg CO2 factor 0.42394 Costs based on Intel estimates and information from thinkmate.com as of October 2023. TCO savings on Monte Carlo Test by Intel October 2023
[T205] 5th Gen Intel Xeon delivers up to 41% lower TCO than the 4th Gen AMD EPYC while running a real-time Natural Language Processing inference (BERT-Large) workload. 5th Generation Intel® Xeon® Platinum processor

Claim: 5th Gen Intel Xeon delivers up to 41% lower TCO than the 4th Gen AMD Epyc while running a real-time Natural Language Processing inference (BERT-Large) workload.

Based on 5th Gen Intel Xeon delivers up to a 2.22x faster than the 4th Gen AMD Epyc while running a real-time Natural Language Processing inference (BERT-Large) workload. This performance drives a fleet a reduction from 50 to 23 servers which, over 4 years, saves: 1205.2 MWH of energy, 510,912 kgCo2 emissions, and $883k of cost.

Intel Xeon 8592+: 1-node, 2x Intel(R) Xeon(R) Platinum 8592+, 64 cores, HT On, Turbo On, NUMA 2, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 2.0, microcode 0x21000161, 2x Ethernet Controller X710 for 10GBASE-T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.2 LTS, 5.15.0-78-generic. Framework=Pytorch 2.0, IPEX=2.0, Python 3.8, AI Model=BERT Large(https://github.com/IntelAI/models/) , INT8-AMX , Real Time (BS=1) results while maintaining 130ms latency SLA, Test by INTEL as of 10/10/2023.

1-node, 2x AMD EPYC 9554 64-Core Processor, 64 cores, SMT On, Turbo On, NUMA 2, Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 1.5, microcode 0xa10113e, 2x Ethernet Controller 10G X550T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 5.15.125-0515125-generic, Framework=Pytorch 2.0, IPEX=2.0, Python 3.8, AI Model=DistilBERT Large(https://github.com/IntelAI/models/) , INT8, Real Time (BS=1) results while maintaining 5ms latency SLA. Test by INTEL as of 09/11/23.

For a 50 server fleet of AMD EPYC 9554, estimated as of October 2023:

CapEx costs: $1.36M

OpEx costs (4 year, includes power and cooling utility costs, infrastructure and hardware maintenance costs): $766.9K

Energy use in kWh (4 year, per server): 50021, PUE 1.6

Other assumptions: utility cost $0.1/kWh, kWh to kg CO2 factor 0.42394

For a 23 server fleet of 5th Gen Xeon 8592+ as of October 2023

CapEx costs: $878K

OpEx costs (4 year, includes power and cooling utility costs, infrastructure and hardware maintenance costs): $367.3K

Energy use in kWh (4 year, per server): 56344, PUE 1.6

Other assumptions: utility cost $0.1/kWh, kWh to kg CO2 factor 0.42394

Costs based on Intel estimates and information from thinkmate.com as of October 2023.

TCO savings on Bert Large Test by Intel October 2023
[T206] 5th Gen Intel Xeon delivers up to 62% lower TCO than the 4th Gen AMD EPYC while running real-time Natural Language Processing inference (DistilBERT) workload. 5th Generation Intel® Xeon® Platinum processor Claim: 5th Gen Intel Xeon delivers up to 62% lower TCO than the 4th Gen AMD Epyc while running real-time Natural Language Processing inference (DistilBERT) workload. Based on 5th Gen Intel Xeon delivers up to a 3.49x faster than the 4th Gen AMD Epyc while running a real-time Natural Language Processing inference (DistilBERT) workload. This performance drives a fleet a reduction from 50 to 15 servers which, over 4 years, saves: 1496.5 MWH of energy, 634,428 kgCo2 emissions, and $1,300k of cost. 1-node, 2x Intel(R) Xeon(R) Platinum 8592+, 64 cores, HT On, Turbo On, NUMA 2, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 2.0, microcode 0x21000161, 2x Ethernet Controller X710 for 10GBASE-T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.2 LTS, 5.15.0-78-generic. Framework=Pytorch 2.0, IPEX=2.0, Python 3.8, AI Model=DistilBERT (https://github.com/IntelAI/models/) , INT8-AMX, Real Time (BS=1) results while maintaining 5ms latency SLA, Test by INTEL as of 10/10/2023. 1-node, 2x AMD EPYC 9554 64-Core Processor, 64 cores, SMT On, Turbo On, NUMA 2, Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 1.5, microcode 0xa10113e, 2x Ethernet Controller 10G X550T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 5.15.125-0515125-generic, Framework=Pytorch 2.0, IPEX=2.0, Python 3.8, AI Model=DistilBERT Large(https://github.com/IntelAI/models/) , INT8, Real Time (BS=1) results while maintaining 5ms latency SLA. Test by INTEL as of 09/11/23. For a 50 server fleet of AMD EPYC 9554, estimated as of October 2023: CapEx costs: $1.36 OpEx costs (4 year, includes power and cooling utility costs, infrastructure and hardware maintenance costs): $749.7K Energy use in kWh (4 year, per server): 46573, PUE 1.6 Other assumptions: utility cost $0.1/kWh, kWh to kg CO2 factor 0.42394 For a 15 server fleet of 5th Gen Xeon 8592+ as of October 2023 CapEx costs: $572K OpEx costs (4 year, includes power and cooling utility costs, infrastructure and hardware maintenance costs): $238.3K Energy use in kWh (4 year, per server): 55475, PUE 1.6 Other assumptions: utility cost $0.1/kWh, kWh to kg CO2 factor 0.42394 Costs based on Intel estimates and information from thinkmate.com as of October 2023. TCO savings on DistilBERT Test by Intel October 2023
[W1] Up to 1.33x higher performance and 1.36x higher performance/watt with the 5th Gen Intel Xeon Scalable Processor vs. prior generation on DeathStarBench - Social Network Microservices workload (Read Home Timeline) with 100ms SLA 5th Generation Intel® Xeon® Platinum processor 8592+:1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores, HT On, Turbo On, NUMA 4, Integrated Accelerators Available [used]: DLB 2 [0], DSA 2 [0], IAA 2 [0], QAT 2 [0], Total Memory 1024GB (32x32GB DDR5 4800 MT/s [4400 MT/s]), BIOS EGSDCRB1.86B.0105.D74.2308261927, microcode 0xa1000161, 1x Ethernet Controller I225-LM, 2x Ethernet Controller E810-C for QSFP, 2x Ethernet Controller XXV710 for 25GbE SFP28, 1x 1.8T INTEL SSDPELKX020T8, Ubuntu 22.04.2 LTS, 5.15.0-86-generic, DeathStarBench socialNetwork, image: deathstarbench/social-network-microservices:0.0.8, load generaor: open-loop wrk2 within DeathStarBench . Test by Intel as of 10/19/23. 8480+:1-node, 2x Intel(R) Xeon(R) Platinum 8480+, 56 cores, HT On, Turbo On, NUMA 2, Integrated Accelerators Available [used]: DLB 2 [0], DSA 2 [0], IAA 2 [0], QAT 2 [0], Total Memory 1024GB (32x32GB DDR5 4800 MT/s [4400 MT/s]), BIOS EGSDCRB1.SYS.0370.P01.2306190739, microcode 0xab0004e0, 1x Ethernet Controller I225-LM, 2x Ethernet Controller E810-C for QSFP, 2x Ethernet Controller XXV710 for 25GbE SFP28, 1x 931.5G INTEL SSDPELKX010T8, Ubuntu 22.04.1 LTS, 5.15.0-86-generic, DeathStarBench socialNetwork, image: deathstarbench/social-network-microservices:0.0.8, load generaor: open-loop wrk2 within DeathStarBench Test by Intel as of 10/06/23. https://github.com/delimitrou/DeathStarBench#publications Death Star Bench - Social Network Test by Intel October 19, 2023 , october 6, 2023
[W2] Up to 1.2x higher performance and 1.2x higher performance/watt with the 5th Gen Intel Xeon Scalable Processor vs. prior generation on DeathStarBench - Hotel Reservation Microservices workload 5th Generation Intel® Xeon® Platinum processor 8592+: 1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores, HT On, Turbo On, NUMA 4, Integrated Accelerators Available [used]: DLB 2 [0], DSA 2 [0], IAA 2 [0], QAT 2 [0], Total Memory 1024GB (32x32GB DDR5 4800 MT/s [4400 MT/s]), BIOS EGSDCRB1.86B.0105.D74.2308261927, microcode 0xa1000161, 1x Ethernet Controller I225-LM, 2x Ethernet Controller E810-C for QSFP, 2x Ethernet Controller XXV710 for 25GbE SFP28, 1x 1.8T INTEL SSDPELKX020T8, Ubuntu 22.04.2 LTS, 5.15.0-86-generic, DeathStarBench hotelReservation 1.0 ,"image: lianhao/dsbpp_​hotel_​reserve:1.0,replica #: 6,instance #: 4", load generaor: open-loop wrk2 within DeathStarBench, Test by Intel as of 10/19/23. 8480+: 1-node, 2x Intel(R) Xeon(R) Platinum 8480+, 56 cores, HT On, Turbo On, NUMA 2, Integrated Accelerators Available [used]: DLB 2 [0], DSA 2 [0], IAA 2 [0], QAT 2 [0], Total Memory 1024GB (32x32GB DDR5 4800 MT/s [4400 MT/s]), BIOS EGSDCRB1.SYS.0370.P01.2306190739, microcode 0xab0004e0, 1x Ethernet Controller I225-LM, 2x Ethernet Controller E810-C for QSFP, 2x Ethernet Controller XXV710 for 25GbE SFP28, 1x 931.5G INTEL SSDPELKX010T8, Ubuntu 22.04.1 LTS, 5.15.0-86-generic, DeathStarBench hotelReservation 1.0 ,"image: lianhao/dsbpp_​hotel_​reserve:1.0,replica #: 6,instance #: 4", load generaor: open-loop wrk2 within DeathStarBench, Test by Intel as of 10/06/23. https://github.com/delimitrou/DeathStarBench#publications Death Star Bench - Hotel Reservation Test by Intel October 19, 2023 october 6, 2023
[W3] Up to 1.19x higher Java Throughput with 5th Gen Intel Xeon Platinum 8592+ processor vs prior generation

Up to 1.3x higher Java Throughput within a given SLA with 5th Gen Intel Xeon Platinum 8592+ processor vs prior generation

Up to 1.18x higher Java Performance per watt with 5th Gen Intel Xeon Platinum 8592+ processor vs prior generation

Up to 1.33x higher Java Performance per watt within a given SLA with 5th Gen Intel Xeon Platinum 8592+ processor vs prior generation

Up to 1.85x higher Java Throughput with 5th Gen Intel Xeon Platinum 8592+ processor 3-year refresh platform

Up to 2x higher Java Throughput within a given SLA with 5th Gen Intel Xeon Platinum 8592+ processor vs 3-year refresh platform

Up to 1.54x higher Java Performance per watt with 5th Gen Intel Xeon Platinum 8592+ processor 3-year refresh platform

Up to 1.64x higher Java Performance per watt within a given SLA with 5th Gen Intel Xeon Platinum 8592+ processor vs 3-year refresh platform

Up to 2.9x higher Java Throughput with 5th Gen Intel Xeon Platinum 8592+ processor vs 5-year refresh platform

Up to 3x higher Java Throughput within a given SLA with 5th Gen Intel Xeon Platinum 8592+ processor vs 5-year refresh platform

Up to 1.8x higher Java Performance per watt with 5th Gen Intel Xeon Platinum 8592+ processor vs 5-year refresh platform

Up to 1.97x higher Java Performance per watt within a given SLA with 5th Gen Intel Xeon Platinum 8592+ processor vs 5-year refresh platform

5th Generation Intel® Xeon® Platinum processor 8592+: 1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores, HT On, Turbo On, NUMA 4, Integrated Accelerators Available [used]: DLB 2 [0], DSA 2 [0], IAA 2 [0], QAT 2 [0], Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 3B05.TEL4P1, microcode 0x21000161, 2x Ethernet Controller X710 for 10GBASE-T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.1 LTS, 5.15.0-78-generic, Server Side Java , JDK21, Test by Intel as of 10/05/23. Server-Side Java, JDK21, Test by Intel as of 10/05/23. 8480+: 1-node, 2x Intel(R) Xeon(R) Platinum 8480+, 56 cores, HT On, Turbo On, NUMA 8, Integrated Accelerators Available [used]: DLB 2 [0], DSA 2 [0], IAA 2 [0], QAT 2 [0], Total Memory 1024GB (16x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 3B05.TEL4P1, microcode 0x2b0004b1, 2x Ethernet Controller X710 for 10GBASE-T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.1 LTS, 5.15.0-78-generic,Server Side Java , JDK21, Test by Intel as of 10/20/23. 8380: 1-node, 2x Intel(R) Xeon(R) Platinum 8380 CPU @ 2.30GHz, 40 cores, HT On, Turbo On, NUMA 4, Integrated Accelerators Available [used]: DLB 0 [0], DSA 0 [0], IAA 0 [0], QAT 0 [0], Total Memory 1024GB (16x64GB DDR4 3200 MT/s [3200 MT/s]), BIOS 1.5, microcode 0xd0003a5, 2x Ethernet Controller 10-Gigabit X540-AT2, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 5.15.0-78-generic,Server Side , JDK21, Test by Intel as of 10/13/23 8180: 1-node, 2x Intel(R) Xeon(R) Platinum 8180M CPU @ 2.50GHz, 28 cores, HT On, Turbo On, NUMA 4, Integrated Accelerators Available [used]: DLB 0 [0], DSA 0 [0], IAA 0 [0], QAT 0 [0], Total Memory 768GB (12x64GB DDR4 2666 MT/s [2666 MT/s]), BIOS 3.8b, microcode 0x2007006, 2x Ethernet Connection X722 for 10GBASE-T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.2 LTS, 5.15.0-78-generic, Server Side Java, JDK21, Test by Intel as of 10/13/23. Server Side Java Test by Intel October 5, 2023, October 20, 2023, October 13, 2023
[W4] Up to 1.13x higher performance on cloud native benchmark [CloudXPRT Web Microservices] with 5th gen Intel Xeon Platinum 8592+ processor vs. prior gen.

Up to 1.75x higher performance on cloud native benchmark [CloudXPRT Web Microservices] with 5th gen Intel Xeon Platinum 8592+ processor vs. 3-year-old platform.

Up to 2.93x higher performance on cloud native benchmark [CloudXPRT Web Microservices] with 5th gen Intel Xeon Platinum 8592+ processor vs. 5-year-old platform.

Up to 1.04x higher performance-per-watt on cloud native benchmark [CloudXPRT Web Microservices] with 5th gen Intel Xeon Platinum 8592+ processor vs. prior gen.

Up to 1.09x higher performance-per-watt on cloud native benchmark [CloudXPRT Web Microservices] with 5th gen Intel Xeon Platinum 8592+ processor vs. 3-year-old platform.

Up to 1.6x higher performance-per-watt on cloud native benchmark [CloudXPRT Web Microservices] with 5th gen Intel Xeon Platinum 8592+ processor vs. 5-year-old platform.

5th Generation Intel® Xeon® Platinum processor 8592+: 1-node, 2x Intel® Xeon® Platinum 8592+, 64 cores, HT On, Turbo On, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS EGSDCRB1.SYS.0105.D74.2308261931, microcode 0x21000161, 1x Ethernet Controller I225-LM, 1x 3.5T INTEL SSDPF2KX038TZ, Ubuntu 22.04.3 LTS, 5.15.0-84-generic, Workload & version​-CloudXPRT v1.20,kubernetes​-v1.16.3​,Golang​-v1.13.1​,Ubuntu (Docker image)​-20.04​,Redis (Docker image)​-5.0.8-buster​,Cassandra (Docker image)​-3.11.6​,Nginx (Docker image)​-v1.17​, Test by Intel as of 10/08/23 8480+: 1-node, 2x Intel(R) Xeon(R) Platinum 8480+, 56 cores, HT On, Turbo On, Total Memory 512GB (16x32GB DDR5 4800 MT/s [4800 MT/s]), BIOS EGSDCRB1.SYS.0370.P03.2308250800, microcode 0x2b0004d0, 1x Ethernet Controller I225-LM, 1x 3.5T INTEL SSDPF2KX038TZ, Ubuntu 22.04.3 LTS, 5.15.0-84-generic ,Workload & version​-CloudXPRT v1.20,kubernetes​-v1.16.3​,Golang​-v1.13.1​,Ubuntu (Docker image)​-20.04​,Redis (Docker image)​-5.0.8-buster​,Cassandra (Docker image)​-3.11.6​,Nginx (Docker image)​-v1.17, Test by Intel as of 09/20/23 8380: 1-node, 2x Intel(R) Xeon(R) Platinum 8380 CPU @ 2.30GHz, 40 cores, HT On, Turbo On, Total Memory 512GB (16x32GB DDR4 3200 MT/s [3200 MT/s]), BIOS SE5C620.86B.01.01.0008.2305172341, microcode 0xd0003a5, 2x Ethernet Controller X710 for 10GBASE-T, 1x 57.3G Ultra USB 3.0, 1x 7T INTEL SSDPF2KX076TZ, Ubuntu 22.04.3 LTS, 5.15.0-84-generic, Workload & version​-CloudXPRT v1.20,kubernetes​-v1.16.3​,Golang​-v1.13.1​,Ubuntu (Docker image)​-20.04​,Redis (Docker image)​-5.0.8-buster​,Cassandra (Docker image)​-3.11.6​,Nginx (Docker image)​-v1.17, Test by Intel as of 09/25/23 8180: 1-node, 2x Intel(R) Xeon(R) Platinum 8180 CPU @ 2.50GHz, 28 cores, HT On, Turbo On, Total Memory 384GB (12x32GB DDR4 2666 MT/s [2666 MT/s]), BIOS SE5C620.86B.0X.02.0284.101020201654, microcode 0x2007006, 2x Ethernet Connection X722 for 10GBASE-T, 1x 7T INTEL SSDPF2KX076TZ, Ubuntu 22.04.3 LTS, 5.15.0-86-generic, Workload & version​-CloudXPRT v1.20,kubernetes​-v1.16.3​,Golang​-v1.13.1​,Ubuntu (Docker image)​-20.04​,Redis (Docker image)​-5.0.8-buster​,Cassandra (Docker image)​-3.11.6​,Nginx (Docker image)​-v1.17, Test by Intel as of 10/12/23 Intel contributes to the development of benchmarks by participating in, sponsoring, and/or contributing technical support to various benchmarking groups, including the BenchmarkXPRT Development Community administered by Principled Technologies. CloudXPRT - Web Microservices Test by Intel between September to October 2023
[W5] 5th Gen Intel Xeon Platinum 8592+ can process up to 1.22x higher transactions per second vs. prior generation platform on Wordpress TLS 1.3 with CryptoNI

5th Gen Intel Xeon Platinum 8592+ can process up to 1.76x higher transactions per second vs. 3rd Gen on Wordpress TLS 1.3 with CryptoNI

5th Gen Intel Xeon Platinum 8592+ can process up to 3.4x higher transactions per second vs. 5-year refresh platform on Wordpress TLS 1.3 with CryptoNI

5th Generation Intel® Xeon® Platinum processor 8592+:1-node, 2x Intel® Xeon® Platinum 8592+, 64 cores, HT On, Turbo On, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS EGSDCRB1.SYS.0105.D74.2308261931, microcode 0x21000161, 1x Ethernet Controller I225-LM, 1x 3.5T INTEL SSDPF2KX038TZ, Ubuntu 22.04.3 LTS, 5.15.0-84-generic, Benchmark Version-pkb-1.25.0-wp5.6-php8.0.18-optjit:v1.0,Wordpress-5.6,PHP-PHP 8.0.18 (fpm-fcgi),Ubuntu (docker image) 20.04, MySQL Server (docker image)-mysqld Ver 10.3.37-MariaDB for Linux on x86_​64,Siege (docker image)-SIEGE 2.78, hhvm-perf (docker image)-v2.0.0, nginx (docker image)-1.20.1,, Test by Intel as of 09/25/23 . 8480+: 1-node, 2x Intel(R) Xeon(R) Platinum 8480+, 56 cores, HT On, Turbo On, Total Memory 512GB (16x32GB DDR5 4800 MT/s [4800 MT/s]), BIOS EGSDCRB1.SYS.0370.P03.2308250800, microcode 0x2b0004d0, 1x Ethernet Controller I225-LM, 1x 3.5T INTEL SSDPF2KX038TZ, Ubuntu 22.04.3 LTS, 5.15.0-84-generic, Benchmark Version-pkb-1.25.0-wp5.6-php8.0.18-optjit:v1.0,Wordpress-5.6,PHP-PHP 8.0.18 (fpm-fcgi),Ubuntu (docker image) 20.04, MySQL Server (docker image)-mysqld Ver 10.3.37-MariaDB for Linux on x86_​64,Siege (docker image)-SIEGE 2.78, hhvm-perf (docker image)-v2.0.0, nginx (docker image)-1.20.1,Test by Intel as of 09/20/23 8380: 1-node, 2x Intel(R) Xeon(R) Platinum 8380 CPU @ 2.30GHz, 40 cores, HT On, Turbo On, Total Memory 512GB (16x32GB DDR4 3200 MT/s [3200 MT/s]), BIOS SE5C620.86B.01.01.0008.2305172341, microcode 0xd0003a5, 2x Ethernet Controller X710 for 10GBASE-T, 1x 57.3G Ultra USB 3.0, 1x 7T INTEL SSDPF2KX076TZ, Ubuntu 22.04.3 LTS, 5.15.0-84-generic, Benchmark Version-pkb-1.25.0-wp5.6-php8.0.18-optjit:v1.0,Wordpress-5.6,PHP-PHP 8.0.18 (fpm-fcgi),Ubuntu (docker image) 20.04, MySQL Server (docker image)-mysqld Ver 10.3.37-MariaDB for Linux on x86_​64,Siege (docker image)-SIEGE 2.78, hhvm-perf (docker image)-v2.0.0, nginx (docker image)-1.20. Test by Intel as of 09/25/23 8180: 1-node, 2x Intel(R) Xeon(R) Platinum 8180 CPU @ 2.50GHz, 28 cores, HT On, Turbo On, Total Memory 384GB (12x32GB DDR4 2666 MT/s [2666 MT/s]), BIOS SE5C620.86B.0X.02.0284.101020201654, microcode 0x2007006, 2x Ethernet Connection X722 for 10GBASE-T, 1x 7T INTEL SSDPF2KX076TZ, Ubuntu 22.04.3 LTS, 5.15.0-86-generic, Benchmark Version-pkb-1.25.0-wp5.6-php8.0.18-optjit:v1.0,Wordpress-5.6,PHP-PHP 8.0.18 (fpm-fcgi),Ubuntu (docker image) 20.04, MySQL Server (docker image)-mysqld Ver 10.3.37-MariaDB for Linux on x86_​64,Siege (docker image)-SIEGE 2.78, hhvm-perf (docker image)-v2.0.0, nginx (docker image)-1.20. Test by Intel as of 10/12/23. WordPress Test by Intel September 25, 2023, September 20, 2023, October 12 , 2023
[W6] 1.14x higher average media transcode performance on 5th Gen Intel Xeon Platinum 8592+ vs. prior generation 5th Generation Intel® Xeon® Platinum processor Geomean of AVC-1080p-fast-avx2, AVC-1080p-medium-avx2, AVC-1080p-veryslow-avx2, SVT-AV1-1080p-12-avx2, SVT-AV1-1080p-12-avx3, SVT-AV1-1080p-5-avx2, SVT-AV1-1080p-5-avx3, SVT-AV1-1080p-8-avx2, SVT-AV1-1080p-8-avx3, SVT-AV1-4k-12-avx2, SVT-AV1-4k-12-avx3, SVT-AV1-4k-8-avx2, SVT-AV1-4k-8-avx3, SVT-HEVC-1080p-preset1-avx2, SVT-HEVC-1080p-preset5-avx2, SVT-HEVC-1080p-preset5-avx3, SVT-HEVC-1080p-preset9-avx2, SVT-HEVC-4k-preset1-avx3, SVT-HEVC-4k-preset5-avx3, SVT-HEVC-4k-preset9-avx2, SVT-HEVC-4k-preset9-avx3, x265-1080p-medium-avx2, x265-1080p-medium-avx3, x265-4k-veryslow-avx2 8592+: 1-node, 2x Intel® Xeon® Platinum 8592+, 64 cores, HT On, Turbo On, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS EGSDCRB1.SYS.0105.D74.2308261931, microcode 0x21000161, 1x Ethernet Controller I225-LM, 1x 3.5T INTEL SSDPF2KX038TZ, Ubuntu 22.04.3 LTS, 5.15.0-84-generic, x264 Version-0.164.x,x265 Version-Release_​3.5,SVT-HEVC Version-v1.3.0,SVT-AV1 Version-v0.8.7, Test by Intel as of 09/25/23 8480+: 1-node, 2x Intel(R) Xeon(R) Platinum 8480+, 56 cores, HT On, Turbo On, Total Memory 512GB (16x32GB DDR5 4800 MT/s [4800 MT/s]), BIOS EGSDCRB1.SYS.0370.P03.2308250800, microcode 0x2b0004d0, 1x Ethernet Controller I225-LM, 1x 3.5T INTEL SSDPF2KX038TZ, Ubuntu 22.04.3 LTS, 5.15.0-84-generic, x264 Version-0.164.x,x265 Version-Release_​3.5,SVT-HEVC Version-v1.3.0,SVT-AV1 Version-v0.8.7, Test by Intel as of 09/20/23. Media Transcode Test by Intel September 25, 2023 September 20, 2023
[W7] 1.81x higher average media transcode performance on 5th Gen Intel Xeon Platinum 8592+ vs. 3-year refresh platform 5th Generation Intel® Xeon® Platinum processor Performance varies by use, configuration and other factors. Results may vary​​. Geomean of AVC-1080p-fast-avx2, AVC-1080p-medium-avx2, AVC-1080p-veryslow-avx2, SVT-AV1-1080p-12-avx2, SVT-AV1-1080p-12-avx3, SVT-AV1-1080p-5-avx2, SVT-AV1-1080p-5-avx3, SVT-AV1-1080p-8-avx2, SVT-AV1-1080p-8-avx3, SVT-AV1-4k-12-avx2, SVT-AV1-4k-12-avx3, SVT-AV1-4k-8-avx2, SVT-AV1-4k-8-avx3, SVT-HEVC-1080p-preset1-avx2, SVT-HEVC-1080p-preset5-avx2, SVT-HEVC-1080p-preset5-avx3, SVT-HEVC-1080p-preset9-avx2, SVT-HEVC-4k-preset1-avx3, SVT-HEVC-4k-preset5-avx3, SVT-HEVC-4k-preset9-avx2, SVT-HEVC-4k-preset9-avx3, x265-1080p-medium-avx2, x265-1080p-medium-avx3, x265-4k-veryslow-avx2 8592+: 1-node, 2x Intel® Xeon® Platinum 8592+, 64 cores, HT On, Turbo On, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS EGSDCRB1.SYS.0105.D74.2308261931, microcode 0x21000161, 1x Ethernet Controller I225-LM, 1x 3.5T INTEL SSDPF2KX038TZ, Ubuntu 22.04.3 LTS, 5.15.0-84-generic, x264 Version-0.164.x,x265 Version-Release_​3.5,SVT-HEVC Version-v1.3.0,SVT-AV1 Version-v0.8.7, Test by Intel as of 09/25/23 8380:. 1-node, 2x Intel(R) Xeon(R) Platinum 8380, 40 cores, HT On, Turbo On, Total Memory 512GB (16x32GB DDR4 3200 MT/s [3200 MT/s]), BIOS SE5C620.86B.01.01.0008.2305172341, microcode 0xd0003a5, 2x Ethernet Controller X710 for 10GBASE-T, 1x 57.3G Ultra USB 3.0, 1x 7T INTEL SSDPF2KX076TZ, Ubuntu 22.04.3 LTS, 5.15.0-84-generic, x264 Version-0.164.x,x265 Version-Release_​3.5,SVT-HEVC Version-v1.3.0,SVT-AV1 Version-v0.8.7, Test by Intel as of 09/25/23 Media Transcode - 3-Year Refresh Test by Intel September 25, 2023
[W8] 3x higher average media transcode performance on 5th Gen Intel Xeon Platinum 8592+ vs. 5-year refresh platform 5th Generation Intel® Xeon® Platinum processor Geomean of AVC-1080p-fast-avx2, AVC-1080p-medium-avx2, AVC-1080p-veryslow-avx2, SVT-AV1-1080p-12-avx2, SVT-AV1-1080p-12-avx3, SVT-AV1-1080p-5-avx2, SVT-AV1-1080p-5-avx3, SVT-AV1-1080p-8-avx2, SVT-AV1-1080p-8-avx3, SVT-AV1-4k-12-avx2, SVT-AV1-4k-12-avx3, SVT-AV1-4k-8-avx2, SVT-AV1-4k-8-avx3, SVT-HEVC-1080p-preset1-avx2, SVT-HEVC-1080p-preset5-avx2, SVT-HEVC-1080p-preset5-avx3, SVT-HEVC-1080p-preset9-avx2, SVT-HEVC-4k-preset1-avx3, SVT-HEVC-4k-preset5-avx3, SVT-HEVC-4k-preset9-avx2, SVT-HEVC-4k-preset9-avx3, x265-1080p-medium-avx2, x265-1080p-medium-avx3, x265-4k-veryslow-avx2 8592+: 1-node, 2x Intel® Xeon® Platinum 8592+, 64 cores, HT On, Turbo On, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS EGSDCRB1.SYS.0105.D74.2308261931, microcode 0x21000161, 1x Ethernet Controller I225-LM, 1x 3.5T INTEL SSDPF2KX038TZ, Ubuntu 22.04.3 LTS, 5.15.0-84-generic, x264 Version-0.164.x,x265 Version-Release_​3.5,SVT-HEVC Version-v1.3.0,SVT-AV1 Version-v0.8.7, Test by Intel as of 09/25/23 8180: 1-node, 2x Intel(R) Xeon(R) Platinum 8180, 28 cores, HT On, Turbo On, Total Memory 384GB (12x32GB DDR4 2666 MT/s [2666 MT/s]), BIOS SE5C620.86B.0X.02.0284.101020201654, microcode 0x2007006, 2x Ethernet Connection X722 for 10GBASE-T, 1x 7T INTEL SSDPF2KX076TZ, Ubuntu 22.04.3 LTS, 5.15.0-86-generic, x264 Version-0.164.x,x265 Version-Release_​3.5,SVT-HEVC Version-v1.3.0,SVT-AV1 Version-v0.8.7, Test by Intel as of 10/12/23 Media Transcode - 5-Year Refresh Test by Intel September 25, 2023 October 12 , 2023
[W9] Up to 1.29x higher virtualization performance with the 5th Gen Intel® Xeon® Platinum 8592+ processor vs. prior generation platform

Up to 1.73x higher virtualization performance with the 5th Gen Intel® Xeon® Platinum 8592+ processor vs. 3-year refresh platform

5th Generation Intel® Xeon® Platinum processor 8592+: 1-node, 2x Intel® Xeon® Platinum 8592+, 64 cores, HT On, Turbo On, NUMA 2, Integrated Accelerators Available [used]: DLB 2 [0], DSA 2 [0], IAA 2 [0], QAT 2 [0], Total Memory 4096GB (32x128GB DDR5 4800 MT/s [4400 MT/s]), BIOS EGSDCRB1.SYS.0105.D74.2308261931, microcode 0x21000161, 1x Ethernet Controller I225-LM, 4x Ethernet Controller E810-C for QSFP, 25x Ethernet Adaptive Virtual Function, 1x 3.5T INTEL SSDPF2KX038TZ, 9x 2.9T INTEL SSDPF21Q032TB, Red Hat Enterprise Linux 8.6 (Ootpa), 4.18.0-372.9.1.el8.x86_​64, qemu-kvm-6.2.0-11, Test by Intel as of 09/24/23. 8480+: 1-node, 2x Intel(R) Xeon(R) Platinum 8480+, 56 cores, HT On, Turbo On, NUMA 2, Integrated Accelerators Available [used]: DLB 2 [0], DSA 2 [0], IAA 2 [0], QAT 2 [0], Total Memory 4096GB (32x128GB DDR5 4800 MT/s [4400 MT/s]), BIOS EGSDCRB1.SYS.0370.P03.2308250800, microcode 0x2b0004d0, 4x Ethernet Controller E810-C for QSFP, 107x Ethernet Adaptive Virtual Function, 1x Ethernet Controller I225-LM, 8x 2.9T INTEL SSDPF21Q032TB, 1x 3.5T INTEL SSDPF2KX038TZ, Red Hat Enterprise Linux 8.6 (Ootpa), 4.18.0-372.9.1.el8.x86_​64, qemu-kvm-6.2.0-11,Test by Intel as of 09/10/23. 8380: 1-node, 2x Intel(R) Xeon(R) Platinum 8380 CPU @ 2.30GHz, 40 cores, HT On, Turbo On, NUMA 2, Integrated Accelerators Available [used]: DLB 0 [0], DSA 0 [0], IAA 0 [0], QAT 0 [0], Total Memory 2048GB (32x64GB DDR4 3200 MT/s [3200 MT/s]), BIOS SE5C620.86B.01.01.0008.2305172341, microcode 0xd0003a5, 73x Ethernet Adaptive Virtual Function, 2x Ethernet Controller 10G X550T, 4x Ethernet Controller E810-C for QSFP, 4x 3.5T INTEL SSDPF2KX038TZ, 1x 5.8T INTEL SSDPE2KE064T8, 1x 894.3G INTEL SSDSC2KG96, 2x 447.1G INTEL SSDSC2KG48, 1x 7.3G Transcend 8GB, Red Hat Enterprise Linux 8.6 (Ootpa), 4.18.0-372.9.1.el8.x86_​64, qemu-kvm-6.2.0-11,Test by Intel as of 09/20/23. Virtualization Test by Intel September 24, 2023, September 10, 2023 , September 20, 2023
[W201] Up to 1.06x higher Server Side Java SLA throughput performance with 5th Gen Intel Xeon Platinum 8592+ vs. 4th Gen AMD EPYC 9554.

Up to 1.08x higher Server Side Java SLA throughput Perf/W with 5th Gen Intel Xeon Platinum 8592+ vs. 4th Gen AMD EPYC 9554.

5th Generation Intel® Xeon® Platinum processor 8592+: 1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores, HT On, Turbo On, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 3B05.TEL4P1, microcode 0x21000161, 2x Ethernet Controller X710 for 10GBASE-T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.1 LTS, 5.15.0-78-generic, Server-side Java* SLA throughput. Test by Intel as of 10/06/23. 9554: 1-node, 2x AMD EPYC 9554 64-Core Processor, 64 cores, HT On, Turbo On, , Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 1.5, microcode 0xa10113e, 2x Ethernet Controller 10G X550T, 1x 1.7T SAMSUNG MZ1L21T9HCLS-00A07, Ubuntu 22.04.3 LTS, 5.15.0-78-generic, Server-side Java*SLA throughput. Test by Intel as of 10/24/23. Server Side Java SLA throughput Test by Intel October 6, 2023 October 24, 2023