Performance Index
Intel® Xeon® 6
Performance varies by use, configuration and other factors.
Performance results are based on testing as of dates shown in configurations and may not reflect all publicly available updates. See configuration disclosure for details. No product or component can be absolutely secure.
Availability of accelerators varies depending on SKU. Visit the Intel Product Specifications page for additional product details.
Intel optimizations, for Intel compilers or other products, may not optimize to the same degree for non-Intel products.
Estimates of SPECrate®2017_int_base and SPECrate®2017_fp_base based on Intel internal measurements. SPEC®, SPECrate® and SPEC CPU® are registered trademarks of the Standard Performance Evaluation Corporation. See www.spec.org for more information.
| Claim | Processor Series | System Configuration | Measurement | Measurement Period |
|---|---|---|---|---|
| [9D7] Up to 8.2x better performance on Intel® Scalable Vector Search compared to HNSWlib for vector search with 45 million vector embeddings with 1536 dimension on Intel® Xeon® 6972P Processor (96C). | Intel® Xeon® 6972P Processor (96C) | 6972P: 1-node, 1x Intel(R) Xeon(R) 6972P, 96 cores, 500W TDP, HT On, Turbo On, NUMA 1, Integrated Accelerators Available [used]: DLB 4 [0], DSA 4 [0], IAA 4 [0], QAT 4 [0], Total Memory 768GB (12x64GB DDR5 6400 MT/s [6400 MT/s]), BIOS BHSDCRB1.IPC.0034.D82.2408060239, microcode 0x10002d0, 1x I210 Gigabit Network Connection, 1x 7T INTEL SSDPE2NV076T8, 1x 894.3G SAMSUNG MZ1L2960HCJR-00A07, Ubuntu 24.04 LTS, 6.8.0-41-generic. Software: HNSWLib commit id d331eb1, . Test by Intel as of 10/04/24. 6972P: 1-node, 1x Intel(R) Xeon(R) 6972P, 96 cores, 500W TDP, HT On, Turbo On, NUMA 1, Integrated Accelerators Available [used]: DLB 4 [0], DSA 4 [0], IAA 4 [0], QAT 4 [0], Total Memory 768GB (12x64GB DDR5 6400 MT/s [6400 MT/s]), BIOS BHSDCRB1.IPC.0034.D82.2408060239, microcode 0x10002d0, 1x I210 Gigabit Network Connection, 1x 7T INTEL SSDPE2NV076T8, 1x 894.3G SAMSUNG MZ1L2960HCJR-00A07, Ubuntu 24.04 LTS, 6.8.0-41-generic. Software: Intel(R) Scalable Vector Search commit id 3f35108 , Test by Intel as of 10/03/24. | Results from Intel® Scalable Vector Search (SVS) compared to HNSWlib using HNSWlib as baseline (1.0), libraries found at https://github.com/intel/ScalableVectorSearch, https://github.com/nmslib/hnswlib | Oct-24 |
| [9D6] Up to 6.8x better performance on Intel® Xeon® 6972P Processor (96C) compared to AMD EPYC 9654 Processor (96c) using Intel® Scalable Vector Search for vector search with 45 million vector embeddings with 1536 dimensions. | Intel® Xeon® 6972P Processor (96C) AMD* EPYC* 9654 Processor (96c) | AMD EPYC 9654: 1-node, 1x AMD EPYC 9654 96-Core Processor, 96 cores, TDP, HT On, Turbo On, NUMA 1, Integrated Accelerators Available [used]: DLB 0 [0], DSA 0 [0], IAA 0 [0], QAT 0 [0], Total Memory 768GB (12x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 1.9, microcode 0xa101148, 2x BCM57416 NetXtreme-E Dual-Media 10G RDMA Ethernet Controller, 1x 7T INTEL SSDPE2NV076T8, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 24.04 LTS, 6.8.0-41-generic. Software: Intel(R) Scalable Vector Search commit id 3f35108. Test by Intel as of 10/03/24. 6972P: 1-node, 1x Intel(R) Xeon(R) 6972P, 96 cores, 500W TDP, HT On, Turbo On, NUMA 1, Integrated Accelerators Available [used]: DLB 4 [0], DSA 4 [0], IAA 4 [0], QAT 4 [0], Total Memory 768GB (12x64GB DDR5 6400 MT/s [6400 MT/s]), BIOS BHSDCRB1.IPC.0034.D82.2408060239, microcode 0x10002d0, 1x I210 Gigabit Network Connection, 1x 7T INTEL SSDPE2NV076T8, 1x 894.3G SAMSUNG MZ1L2960HCJR-00A07, Ubuntu 24.04 LTS, 6.8.0-41-generic. Software: Intel(R) Scalable Vector Search commit id 3f35108. Test by Intel as of 10/04/24. | Results from Intel® Scalable Vector Search (SVS), Intel® Xeon® 6972P Processor (96C) compared to AMD* EPYC* 9654 Processor (96c), library found at https://github.com/intel/ScalableVectorSearch | Oct-24 |
| [9A2] Up to 2.3x higher chatbot performance with Intel® Xeon® 6972P [MRDIMM] vs. prior generation (Llama3-8B - int8) Up to 2.4x higher summarization performance and 1.68x perf/watt with Intel® Xeon® 6972P [MRDIMM] vs. prior generation (Llama3-8B - int8) Up to 3.08x higher summarization performance and 2.16x perf/watt with Intel® Xeon® 6972P [MRDIMM] vs. prior generation (Llama2-7B - int8) | Intel® Xeon® 6900-series with P-cores | 6972P w/MRDIMM:1-node, pre-production platform, 2x Intel® Xeon® 6972P, 96 cores, 500W TDP, HT On, Turbo On, Total Memory 1536GB (24x64GB MRDIMM 8800MT/s [8800 MT/s]), BIOS BHSDCRB1.IPC.0033.D57.2406240014, microcode 0x11000290, 2x Ethernet Controller 10-Gigabit X540-AT2, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 24.04 LTS, 6.8.0-31-generic. Test by Intel as of 07/10/24. 8592+: 1-node, 2x Intel® Xeon® PLATINUM 8592+, 64 cores, 350W TDP, HT On, Turbo On, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 3B07.TEL2P1, microcode 0x21000200, 1x Ethernet interface, 2x Ethernet Controller 10-Gigabit X540-AT2, 1x 3.5T Micron_7450_MTFDKCB3T8TFR, Ubuntu 24.04 LTS, 6.8.0-31-generic. Test by Intel as of 07/11/24. Llama2-7B: int8, bf16 bs=x (128/128), bs=x (1024/128), PyTorch:2.4.0, IPEX: 2.4.0, OneDNN: v3.4.2, Modelzoo:https://github.com/intel/ai-reference-models, p90 latency <=100ms. Llama3-8B: int8, bf16 bs=x (128/128), bs=x (1024/128), PyTorch:2.3.0, IPEX: 2.3.0, OneDNN: v3.4.2, Modelzoo: https://github.com/intel/ai-reference-models, p90 latency <=100ms. | Generative AI (LLM Performance) | Test by Intel as of 07/10/24. |
| [9A3] Up to 1.78x (int8) and 1.85 (bf16) higher BERT-Large Real-Time Inference performance with the new Intel® Xeon® 6980P [MRDIMM] vs. prior generation Up to 1.86x (int8) and 1.82x (bf16) higher ResNet-50 Real-Time Inference performance with the new Intel® Xeon® 6980P [MRDIMM] vs. prior generation Up to 1.88x (int8) and 1.93x (bf16) higher BERT-Large batch Inference performance with the new Intel® Xeon® 6980P [MRDIMM] vs. prior generation Up to 1.83x (int8) and 1.7x (bf16) higher ResNet-50 batch Inference performance with the new Intel® Xeon® 6980P [MRDIMM] vs. prior generation Up to 16.7x (int8) higher BERT-Large real-time Inference performance with the new Intel® Xeon® 6980P [MRDIMM] vs. Intel Xeon 8280 Up to 13.7x (int8) higher ResNet-50 real-time Inference performance with the new Intel® Xeon® 6980P [MRDIMM] vs. Intel Xeon 8280 Up to 13.6x (int8) higher BERT-Large batch Inference performance with the new Intel® Xeon® 6980P [MRDIMM] vs. Intel Xeon 8280 Up to 17.4x (int8) higher ResNet-50 batch Inference performance with the new Intel® Xeon® 6980P [MRDIMM] vs. Intel Xeon 8280 Up to 14x (int8) higher DLRM batch Inference performance with the new Intel® Xeon® 6980P [MRDIMM] vs. Intel Xeon 8280 Up to 4.29x (int8) higher BERT-Large batch inference performance with the new Intel Xeon 6980P [MRDIMM] vs. AMD EPYC 9654 Up to 5.5x (int8) higher ResNet-50 batch Inference performance with the new Intel® Xeon® 6980P [MRDIMM] vs. AMD EPYC 9654 Up to 3.99x (int8) higher DLRM batch Inference performance with the new Intel® Xeon® 6980P [MRDIMM] vs. AMD EPYC 9654 | Intel® Xeon® 6900-series with P-cores | 6980P w/MRDIMM: 1-node, pre-production platform, 2x Intel(R) 6980P, 128 cores, 500W TDP, HT On, Turbo On, Total Memory 1536GB (24x64GB MRDIMM 8800MT/s [8800 MT/s]), BIOS BHSDCRB1.IPC.0033.D57.2406240014, microcode 0x11000290, 2x Ethernet Controller X550, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 24.04 LTS, 6.8.0-31-generic. Test by Intel as of 08/20/24. 8592+: 1-node, 2x Intel® Xeon® PLATINUM 8592+, 64 cores, 350W TDP, HT On, Turbo On, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 3B07.TEL2P1, microcode 0x21000230, 2x Ethernet Controller X710 for 10GBASE-T, 1x Ethernet interface, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 24.04 LTS, 6.8.0-31-generic. Test by Intel as of 08/05/24. 8280: 1-node, 2x Intel® Xeon® Platinum 8280L CPU @ 2.70GHz, 28 cores, 205W TDP, HT On, Turbo On, Total Memory 768GB (12x64GB DDR4 3200 MT/s [2934 MT/s]), BIOS SE5C620.86B.02.01.0017.110620230543, microcode 0x5003605, 2x Ethernet Connection X722 for 10GBASE-T, 1x 1.7T SAMSUNG MZWLR1T9HBJR-00007, Ubuntu 24.04 LTS, 6.8.0-31-generic. Test by Intel as of 08/06/24. Software: Bert Large: BERT-large, Inference: int8, bs=1 (sla=130ms), bs=x, Dataset: SQuAD1.1, Framework: PyTorch:2.4.0, IPEX: 2.4.0, OneDNN: v3.4.2, Modelzoo: https://github.com/intel/ai-reference-models ResNet50 PT: ResNet50 v1.5, Inference: int8, bs=1 (sla=15ms), bs=x, Dataset: ImageNet, Framework: PyTorch:2.4.0, IPEX: 2.4.0, OneDNN: v3.4.2, Modelzoo: https://github.com/intel/ai-reference-models DLRM : DLRMv2, Inference: int8, bs=128, Dataset: Criteo Terabyte, Framework: PyTorch:2.4.0, IPEX: 2.4.0, OneDNN: v3.4.2, Modelzoo: https://github.com/intel/ai-reference-models | AI Inference (BERT-Large, ResNet-50, DLRM) | Test by Intel as of 08/20/24. |
| [9A5] Up to 2x (int8) and 1.8x (bf16) higher LCM Inference performance with the new Intel® Xeon® 6980P [MRDIMM] vs. prior generation Up to 1.9x (int8) and 1.83x (bf16) higher Stable Diffusion Inference performance with the new Intel® Xeon® 6980P [MRDIMM] vs. prior generation Up to 1.72x (int8) and 1.8x (bf16) higher real-time Vision-Transformer performance and 1.6x (int8) and 1.9x (bf16) higher batched Vision-transformer Inference performance with the new Intel® Xeon® 6980P [MRDIMM] vs. prior generation Up to 2x (int8) and 1.5x (bf16) higher real-time YOLO-v7 performance and 1.61x (int8) and 1.95x (bf16) higher batched YOLO-v7 Inference performance with the new Intel® Xeon® 6980P [MRDIMM] vs. prior generation | Intel® Xeon® 6900-series with P-cores | 6980P w/MRDIMM: 1-node, pre-production platform, 2x Intel® Xeon® 6980P, 128 cores, HT On, Turbo On, Total Memory 1536GB (24x64GB MRDIMM 8800 MT/s [8800 MT/s]), BIOS BHSDCRB1.IPC.0033.D57.2406240014, microcode 0x81000290, 1x Ethernet Controller I225-LM, 1x 3.5T INTEL SSDPF2KX038TZ, 1x 894.3G Micron_7450_MTFDKBG960TFR, CentOS Stream 9, 6.6.43 ,Test by INTEL as of Jul 31 2024 8592+: 1-node, 2x Intel® Xeon® PLATINUM 8592+, 64 cores, HT On, Turbo On, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS EGSDCRB1.SYS.0109.D34.2402031438, microcode 0x21000230, 1xEthernet Controller I225-LM , 1x 3.6T INTEL SSDPE2KX040T8, 1x 931.5G INTEL, CentOS Stream 9, 6.2.0-emr.bkc.6.2.3.6.31.x86_64. Test by INTEL as of Thu Aug 22 2024. Software: PyTorch , pytorch: 2.5.0.dev20240619+cpu, ipex: 2.5.0+gita6fd719, oneDNN: v3.5.0, https://github.com/intel-innersource/frameworks.ai.infrastructure.dlboost.pytorch/blob/master/docs/readme/2024/ww27-ww32/Readme_Pytorch.md Inference (Vision-Transformer, LCM, Stable-Diffusion, YOLO-v7) BS=1, 4cores/instance BS=x, 1 instance/ numa node | AI Inference (LCM, Stable Diffusion, Vision-Transformer, YOLO-v7) | Test by INTEL as of Jul 31 2 |
| [9A6] Up to 2x higher BERT-large training (bf16) performance with the new Intel® Xeon® 6980P vs. prior generation Up to 2.3x higher Llama-2-7B training (bf16) performance with the new Intel® Xeon® 6980P vs. prior generation | Intel® Xeon® 6900-series with P-cores | 6980P w/MRDIMM: 1-node, pre-production platform, 2x (1x used) Intel® Xeon® 6980P, 128 cores, HT On, Turbo On, Total Memory 1536GB (24x64GB MRDIMM 8800 MT/s [8800 MT/s]), BIOS BHSDCRB1.IPC.0033.D57.2406240014, microcode 0x81000290, 1x Ethernet Controller I225-LM, 1x 3.5T INTEL SSDPF2KX038TZ, 1x 894.3G Micron_7450_MTFDKBG960TFR, CentOS Stream 9, 6.6.43 ,Test by Intel as of Jul 31 2024 8592+: 1-node, 2x (1x used) Intel® Xeon® PLATINUM 8592+, 64 cores, HT On, Turbo On, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS EGSDCRB1.SYS.0109.D34.2402031438, microcode 0x21000230, 1xEthernet Controller I225-LM , 1x 3.6T INTEL SSDPE2KX040T8, 1x 931.5G INTEL, CentOS Stream 9, 6.2.0-emr.bkc.6.2.3.6.31.x86_64. Test by Intel as of Aug 22 2024. Software: PyTorch , PyTorch , pytorch: 2.5.0.dev20240619+cpu, ipex: 2.5.0+gita6fd719, oneDNN: v3.5.0, https://github.com/intel-innersource/frameworks.ai.infrastructure.dlboost.pytorch/blob/master/docs/readme/2024/ww27-ww32/Readme_Pytorch.md Performance Training(BERT-LARGE, LLaMA-2-7B) BS=x, 1 instance/ numa node [Using only one socket] | AI Training (BERT-Large, LLaMA-2-7B) | Test by Intel as of Jul 31 20 |
| [9A7] Up to 3.7x higher batched GPT-J-6B Chatbot (int8) with the new Intel® Xeon® 6972P vs. AMD EPYC 9654 Up to 3.0x higher batched Llama2-7B inference (int8) with the new Intel® Xeon® 6972P vs. AMD EPYC 9654 Up to 4.0x higher batched LLama3-8B inference (int8) with the new Intel® Xeon® 6972P vs. AMD EPYC 9654 Up to 2.36x higher batched GPT-J-6B LLM Sumarization (1024/128, int8) with the new Intel® Xeon® 6972P vs. AMD EPYC 9654 Up to 2.40x higher batched Llama2-7B LLM Sumarization (1024/128, int8) with the new Intel® Xeon® 6972P vs. AMD EPYC 9654 Up to 3.56x higher batched Llama3-8B LLM Sumarization (1024/128, int8) with the new Intel® Xeon® 6972P vs. AMD EPYC 9654 | Intel® Xeon® 6900-series with P-cores | 6972P w/MRDIMM:1-node, pre-production platform, 2x Intel® Xeon® 6972P, 96 cores, 500W TDP, HT On, Turbo On, Total Memory 1536GB (24x64GB MRDIMM 8800MT/s [8800 MT/s]), BIOS BHSDCRB1.IPC.0033.D57.2406240014, microcode 0x11000290, 2x Ethernet Controller 10-Gigabit X540-AT2, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 24.04 LTS, 6.8.0-31-generic. Test by Intel as of 07/10/24. 8592+: 1-node, 2x Intel Xeon Platinum 8592+, 64 cores, 350W TDP, HT On, Turbo On, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 3B07.TEL2P1, microcode 0x21000200, 1x Ethernet interface, 2x Ethernet Controller 10-Gigabit X540-AT2, 1x 3.5T Micron_7450_MTFDKCB3T8TFR, Ubuntu 24.04 LTS, 6.8.0-31-generic. Test by Intel as of 07/11/24. AMD EPYC 9654: 1-node, 2x AMD EPYC 9654, 96 cores, 360W TDP, SMT On, Boost On, Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 1.6, microcode 0xa101144, 2x Ethernet Controller X550, 1x 3.5T SAMSUNG MZWLJ3T8HBLS-00007, Ubuntu 24.04 LTS, 6.8.0-31-generic. Test by Intel as of 07/09/24. GPT-J 6B: int8, P90<=100ms, bs=x (128/128), bs=x (1024/128), PyTorch:2.4.0, IPEX: 2.4.0, OneDNN: v3.4.2, Modelzoo: https://github.com/intel/ai-reference-models Llama2 7B: int8, P90<=100ms, bs=x (128/128), bs=x (1024/128), PyTorch:2.4.0, IPEX: 2.4.0, OneDNN: v3.4.2, Modelzoo:https://github.com/intel/ai-reference-models Llama2 13B: int8, P90<=100ms, bs=x (128/128), bs=x (1024/128), PyTorch:2.4.0, IPEX: 2.4.0, OneDNN: v3.4.2, Modelzoo:https://github.com/intel/ai-reference-models | AI Inference batched GPT-J, LLaMa-2, LLaMa-3 | Test by Intel as of 07/10/24. |
| [9A10] Up to 2x higher GPT-J-6B (BF16) performance with Intel® Xeon® 6980P vs. Intel Xeon 8592+. Up to 2x higher Llama-13B (BF16) performance with Intel® Xeon® 6980P vs. Intel Xeon 8592+. | Intel® Xeon® 6900-series with P-cores | Pre-production Intel Xeon 6 with P-cores: 1-node, pre-production platform, 2x Intel Xeon 6 with P cores, 128 cores, HT On, Turbo On, Total Memory 1536GB (24x64GB MCR 8800), microcode 0x110001c0, 2x Ethernet Controller 10G X550T, 1x 3.5T Micron_7450_MTFDKCB3T8TFR, Ubuntu 22.04.4 LTS, 6.5.0-26-generic, Test by Intel as of 04/13/24. 8592+: 1-node, 2x Intel® Xeon® PLATINUM 8592+, 64 cores, HT On, Turbo On, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), microcode 0x21000200, 2x Ethernet Controller 10-Gigabit X540-AT2, 1x 1.7T SAMSUNG MZWLJ1T9HBJR-00007, Ubuntu 22.04.4 LTS, 6.5.0-26-generic, Test by Intel as of 04/05/24. GPT-J-6B : Intel Model Zoo:DLBoost package, WW16-2024 release, PyTorch: 2.3.0a0+gita21b84e, intel-extension-for-pytorch 2.3.0+gitbce9c58, OneDNN=3.3, WW16 DLBoost package release; (input_token / output_token), BF16. Llama-13B : Intel Model Zoo:DLBoost package, WW16-2024 release, PyTorch: 2.3.0a0+gita21b84e, intel-extension-for-pytorch 2.3.0+gitbce9c58, OneDNN=3.3, WW16 DLBoost package release; (input_token / output_token), BF16. | GPT-J, LLaMa-2 | Test by Intel as of 04/13/24. |
| [9A210] Up to 3.7x AI inferencing performance vs. AMD EPYC | Intel® Xeon® 6900-series with P-cores | Pre-production Intel Xeon 6 with P-cores: 1-node, pre-production platform, 2x Intel Xeon 6 with P cores, 128 cores, HT On, Turbo On, Total Memory 1536GB (24x64GB MCR 8800), microcode 0x110001c0, 2x Ethernet Controller 10G X550T, 1x 3.5T Micron_7450_MTFDKCB3T8TFR, Ubuntu 22.04.4 LTS, 6.5.0-26-generic, Test by Intel as of 04/13/24. 9654: 1-node, 2x AMD EPYC 9654 96-Core Processor, 96 cores, SMT On, Turbo On, Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800 MT/s]), microcode 0xa10113e, 2x Ethernet Controller 10G X550T, 1x 3.5T SAMSUNG MZWLJ3T8HBLS-00007, Ubuntu 22.04.4 LTS, 6.5.0-26-generic, Test by Intel as of 04/03/24. Software: BertLarge - Bert-Large, "Intel Model Zoo: DLBoost package, WW10-2024 release", OneDNN=3.3 ,Pytorch 2.3.0+gitbce9c58, physical cores only, BS=32 | PT: BERT-Large | Test by Intel as of 04/13/24. |
| [9D1] Up to 2.14x higher HammerDB MySQL OLTP performance and 1.5x perf/watt with the new Intel® Xeon® 6980P [DDR] vs. Intel® Xeon® 8592+ Up to 7x higher HammerDB MySQL OLTP performance with the new Intel® Xeon® 6980P vs. Intel® Xeon® 8280 Up to 1.72x higher HammerDB MySQL OLTP performance with the new Intel® Xeon® 6980P vs. AMD EPYC 9654. Up to 1.40x higher HammerDB MySQL OLTP performance with the new Intel® Xeon® 6980P vs. AMD EPYC 9754. | Intel® Xeon® 6900-series with P-cores | 6980P: 1-node, pre-production platform, 2x (1x used) Intel® Xeon® 6980P, 128 cores, HT On, Turbo On, Total Memory 1536GB (24x64GB DDR5 6400 MT/s [6400 MT/s]), BIOS BHSDCRB1.IPC.0033.D57.2406240014, microcode 0x11000290, 2x Ethernet Controller 10-Gigabit X540-AT2, 2x Ethernet Controller E810-C for QSFP, 4x 3.5T KIOXIA KCD8XPUG3T84, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.1 LTS, 6.5.0-21-generic. Test by Intel as of 07/17/24. 8592+: 1-node, 2x (1x used) Intel® Xeon® PLATINUM 8592+, 64 cores, HT On, Turbo On, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 2.0, microcode 0x21000230, 2x Ethernet Controller X710 for 10GBASE-T, 2x Ethernet Controller E810-C for QSFP, 1x Ethernet interface, 1x 1.7T SAMSUNG MZ1L21T9HCLS-00A07, Ubuntu 22.04.4 LTS, 6.5.0-21-generic. Test by Intel as of 07/29/24. 8280: 1-node, 2x (1x used) Intel® Xeon® Platinum 8280L CPU @ 2.70GHz, 28 cores, HT On, Turbo On, Total Memory 768GB (12x64GB DDR4 3200 MT/s [2934 MT/s]), BIOS SE5C620.86B.02.01.0017.110620230543, microcode 0x5003605, 2x Ethernet Controller E810-C for QSFP, 2x Ethernet Connection X722 for 10GBASE-T, 1x 3.5T SAMSUNG MZ7LH3T8, 4x 3.5T KIOXIA KCD8XPUG3T84, Ubuntu 22.04.4 LTS, 6.5.0-21-generic. Test by Intel as of 07/16/24. AMD EPYC 9654: 1-node, 2x (1x used) AMD EPYC 9654 96-Core Processor, 96 cores, SMT On, Boost On,, Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 1.6, microcode 0xa10113e, 2x Ethernet Controller E810-C for QSFP, 2x Ethernet Controller 10G X550T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.4 LTS, 6.5.0-21-generic. Test by Intel as of 07/29/24. AMD EPYC 9754: 1-node, 2x (1x used) AMD EPYC 9754 128-Core Processor, 128 cores, SMT On, Boost On, Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 1.6, microcode 0xaa00212, 1x Ethernet Controller E810-C for QSFP, 2x Ethernet Controller 10G X550T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, 4x 3.5T KIOXIA KCD8XPUG3T84, Ubuntu 22.04.4 LTS, 6.5.0-21-generic. Test by Intel as of 07/16/24. Software: TPROC-C on MySQL 8033, HammerDB 4.7, multi-instance. | Up to 2.14x higher HammerDB MySQL OLTP performance and 1.5x perf/watt with the new Intel® Xeon® 6980P [DDR] vs. Intel® Xeon® 8592+ Up to 7x higher HammerDB MySQL OLTP performance with the new Intel® Xeon® 6980P vs. Intel® Xeon® 8280 Up to 1.72x higher HammerDB MySQL OLTP performance with the new Intel® Xeon® 6980P vs. AMD EPYC 9654. Up to 1.40x higher HammerDB MySQL OLTP performance with the new Intel® Xeon® 6980P vs. AMD EPYC 9754. | Test by Intel as of 07/17/24. |
| [9D2] Up to 2.05x higher MongoDB performance and 1.43x perf/watt with the new Intel® Xeon® 6980P [DDR] vs. Intel® Xeon® 8592+ Up to 8x higher MongoDB performance with the new Intel® Xeon® 6980P vs. Intel® Xeon® 8280 Up to 2.38x higher MongoDB performance with the new Intel® Xeon® 6980P vs. AMD EPYC 9654 Up to 2.0x higher MongoDB performance with the new Intel® Xeon® 6980P vs. AMD EPYC 9754 | Intel® Xeon® 6900-series with P-cores | Pre-production Intel Xeon 6 with P-cores: 1-node, 2x (1x used) Genuine Intel(R) 6980P, 128 cores, 500W TDP, HT On, Turbo On, NUMA 6, Total Memory 1536GB (24x64GB MRDIMM 8800 MT/s [8800 MT/s]), BIOS BHSDCRB1.IPC.0033.D57.2406240014, microcode 0x81000290, 2x Ethernet Controller E810-C for QSFP, 2x (1x used) Ethernet Controller 10G X550T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, 4x 3.5T KIOXIA KCD8XPUG3T84, Ubuntu 22.04.4 LTS, 6.5.0-21-generic. Test by Intel as of 07/25/24. 6980P: 1-node pre-production platform, 2x (1x used) Intel(r) Xeon(r) 6980P, 128 cores, HT On, Turbo On, NUMA 6, Total Memory 1536GB (24x64GB DDR5 6400 MT/s [6400 MT/s]), BIOS BHSDCRB1.IPC.0033.D57.2406240014, microcode 0x11000290, 2x Ethernet Controller 10-Gigabit X540-AT2, 2x Ethernet Controller E810-C for QSFP, 4x 3.5T KIOXIA KCD8XPUG3T84, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.1 LTS, 6.5.0-21-generic. Test by Intel as of 07/17/24. 8592+:1-node, 2x (1x used) INTEL(R) XEON(R) PLATINUM 8592+, 64 cores, HT On, Turbo On, NUMA 4, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 2.0, microcode 0x21000230, 1x Ethernet Controller E810-C for QSFP, 1x Ethernet interface, 2x Ethernet Controller X710 for 10GBASE-T, 1x 1.7T SAMSUNG MZ1L21T9HCLS-00A07, 4x 3.5T KIOXIA KCD8XPUG3T84, Ubuntu 22.04.4 LTS, 6.5.0-21-generic. Test by Intel as of 07/16/24. Software: MongoDB 6.0.4, YCSB, multi-instance, read/update 90/10. Pre-production Intel Xeon 6 with P-cores: 1-node, 2x (1x used) Intel(R) Xeon(R) 6972P, 96 cores, HT On, Turbo On, NUMA 6, Total Memory 1536GB (24x64GB DDR5 6400 MT/s [6400 MT/s]), BIOS BHSDCRB1.IPC.0033.D57.2406240014, microcode 0x11000290, 2x Ethernet Controller 10-Gigabit X540-AT2, 2x Ethernet Controller E810-C for QSFP, 1x 1.7T Micron_7400_MTFDKCC1T9TDZ, 4x 3.5T KIOXIA KCD8XPUG3T84, Ubuntu 22.04.4 LTS, 6.5.0-21-generic. Test by Intel as of 07/16/24. 8592+:1-node, 2x (1x used) INTEL(R) XEON(R) PLATINUM 8592+, 64 cores, HT On, Turbo On, NUMA 4, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 2.0, microcode 0x21000230, 1x Ethernet Controller E810-C for QSFP, 1x Ethernet interface, 2x Ethernet Controller X710 for 10GBASE-T, 1x 1.7T SAMSUNG MZ1L21T9HCLS-00A07, 4x 3.5T KIOXIA KCD8XPUG3T84, Ubuntu 22.04.4 LTS, 6.5.0-21-generic. Test by Intel as of 07/16/24. 8280: 1-node, 2x (1x used) Intel(R) Xeon(R) Platinum 8280L CPU @ 2.70GHz, 28 cores, HT On, Turbo On, NUMA 2, Total Memory 768GB (12x64GB DDR4 3200 MT/s [2934 MT/s]), BIOS SE5C620.86B.02.01.0017.110620230543, microcode 0x5003605, 2x Ethernet Controller E810-C for QSFP, 2x Ethernet Connection X722 for 10GBASE-T, 1x 3.5T SAMSUNG MZ7LH3T8, 4x 3.5T KIOXIA KCD8XPUG3T84, Ubuntu 22.04.4 LTS, 6.5.0-21-generic. Test by Intel as of 07/16/24. AMD EPYC 9654: 1-node, 2x (1x used) AMD EPYC 9654 96-Core Processor, 96 cores, SMT On, Boost On, NPS 1, Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 1.6, microcode 0xa10113e, 2x Ethernet Controller E810-C for QSFP, 2x Ethernet Controller 10G X550T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.4 LTS, 6.5.0-21-generic. Test by Intel as of 07/29/24. AMD EPYC 9754: 1-node, 2x (1x used) AMD EPYC 9754 128-Core Processor, 128 cores, SMT On, Boost On, NPS 1, Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 1.6, microcode 0xaa00212, 1x Ethernet Controller E810-C for QSFP, 2x Ethernet Controller 10G X550T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, 4x 3.5T KIOXIA KCD8XPUG3T84, Ubuntu 22.04.4 LTS, 6.5.0-21-generic. Test by Intel as of 07/16/24. Software: MongoDB 6.0.4 | MongoDB | Test by Intel as of 07/25/24. |
| [9D3] Up to 2.32x higher Redis VectorDB Similarity search performance and 1.63x perf/watt with the new Intel® Xeon® 6980P [MRDIMM] vs. Intel® Xeon® 8592+ Up to 1.72x higher Redis VectorDB Similarity search performance with the new Intel® Xeon® 6980P [MRDIMM] vs. AMD EPYC 9654 Up to 1.67x higher Redis VectorDB Similarity search performance with the new Intel® Xeon® 6980P [MRDIMM] vs. AMD EPYC 9754 | Intel® Xeon® 6900-series with P-cores | 6980P w/MRDIMM: 1-node pre-production platform, 2x Intel® Xeon® 6980P, 128 cores, 500W TDP, HT On, Turbo On, NUMA 6, Total Memory 1536GB (24x64GB MRDIMM 8800 MT/s [8800 MT/s]), BIOS BHSDCRB1.IPC.0033.D57.2406240014, microcode 0x81000290, 2x Ethernet Controller E810-C for QSFP, 2x Ethernet Controller 10G X550T, 1x 1.7T KIOXIA KCD8XPUG1T92, 1x 1.7T SAMSUNG MZWLJ1T9HBJR-00007, 3x 1.7T KIOXIA KCD81PUG1T92, Ubuntu 22.04.4 LTS, 6.5.0-21-generic. Test by Intel as of 07/15/24. 6980P: Pre-production Intel® Xeon® 6 with P-cores: 1-node, 2x Genuine Intel(R) 6980P, 128 cores, 500W TDP, HT On, Turbo On, NUMA 6, Total Memory 1536GB (24x64GB DDR5 6400 MT/s [6400 MT/s]), BIOS BHSDCRB1.IPC.0033.D57.2406240014, microcode 0x11000290, 2x Ethernet Controller 10-Gigabit X540-AT2, 2x Ethernet Controller E810-C for QSFP, 1x 1.7T SAMSUNG MZWLJ1T9HBJR-00007, Ubuntu 22.04.4 LTS, 6.5.0-21-generic. Test by Intel as of 08/07/24. 6972P: Pre-production Intel® Xeon® 6 with P-cores: 1-node, 2x Intel® Xeon® 6972P, 96 cores, 500W TDP, HT On, Turbo On, NUMA 6, Total Memory 1536GB (24x64GB MRDIMM 8800 MT/s [8800 MT/s]), BIOS BHSDCRB1.IPC.0033.D57.2406240014, microcode 0x11000290, 2x Ethernet Controller E810-C for QSFP, 2x BCM57416 NetXtreme-E Dual-Media 10G RDMA Ethernet Controller, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.4 LTS, 6.5.0-21-generic. Test by Intel as of 07/29/24. 8592+:1-node, 2x Intel® Xeon® PLATINUM 8592+, 64 cores, 350W TDP, HT On, Turbo On, NUMA 4, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 2.0, microcode 0x21000230, 2x Ethernet Controller X710 for 10GBASE-T, 2x Ethernet Controller E810-C for QSFP, 1x Ethernet interface, 1x 1.7T SAMSUNG MZ1L21T9HCLS-00A07, Ubuntu 22.04.4 LTS, 6.5.0-21-generic. Test by Intel as of 07/30/24. Software: Redis: 7.2 Redisearch=v2.8.11 vector-db-benchmark GCC 12.3.0, multi-instance AMD EPYC 9654: 1-node, 2x AMD EPYC 9654 96-Core Processor, 96 cores, 360W TDP, SMT On, Boost On, NPS 1, Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 1.6, microcode 0xa10113e, 2x Ethernet Controller E810-C for QSFP, 2x Ethernet Controller 10G X550T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.4 LTS, 6.5.0-21-generic. Test by Intel as of 07/22/24. AMD EPYC 9754:1-node, 2x AMD EPYC 9754 128-Core Processor, 128 cores, 360W TDP, SMT On, Boost On, NPS 1, Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 1.6, microcode 0xa10113e, 2x Ethernet Controller E810-C for QSFP, 2x Ethernet Controller 10G X550T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.4 LTS, 6.5.0-21-generic. Test by Intel as of 07/22/24. Software: VectorDB , Redis | Redis Vector Similarity Search | Test by Intel as of 07/15/24. |
| [9D4] Up to 1.8x higher Redis Memtier performance with the new Intel® Xeon® 6980P [DDR] vs. Intel® Xeon® 8592+ Up to 5.6x higher Redis Memtier performance with the new Intel® Xeon® 6980P [DDR] vs. Intel® Xeon® 8280 Up to 1.71x higher Redis Memtier performance with the new Intel® Xeon® 6980P [DDR] vs. AMD EPYC 9654 Up to 1.92x higher Redis Memtier performance with the new Intel® Xeon® 6980P [DDR] vs. AMD EPYC 9754 | Intel® Xeon® 6900-series with P-cores | 6980P: Pre-production Intel® Xeon® 6 with P-cores: 1-node, 2x (1x used) Genuine Intel(R) 6980P, 128 cores, 500W TDP, HT On, Turbo On, Total Memory 1536GB (24x64GB DDR5 6400 MT/s [6400 MT/s]), BIOS BHSDCRB1.IPC.0033.D57.2406240014, microcode 0x11000290, 2x Ethernet Controller E810-C for QSFP, 2x Ethernet Controller 10-Gigabit X540-AT2, 1x 1.7T SAMSUNG MZWLJ1T9HBJR-00007, Ubuntu 22.04.4 LTS, 6.5.0-21-generic. Test by Intel as of 08/14/24. 6972P: Pre-production Intel® Xeon® 6 with P-cores: 1-node, 2x (1x used) Intel® Xeon® 6972P, 96 cores, 500W TDP, HT On, Turbo On, Total Memory 1536GB (24x64GB DDR5 6400 MT/s [6400 MT/s]), BIOS BHSDCRB1.IPC.0033.D57.2406240014, microcode 0x11000290, 2x Ethernet Controller 10-Gigabit X540-AT2, 2x Ethernet Controller E810-C for QSFP, 1x 1.7T Micron_7400_MTFDKCC1T9TDZ, Ubuntu 22.04.4 LTS, 6.5.0-21-generic. Test by Intel as of 08/11/24. 8592+:1-node, 2x (1x used) Intel® Xeon® PLATINUM 8592+, 64 cores, 350W TDP, HT On, Turbo On, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 2.0, microcode 0x21000230, 2x Ethernet Controller E810-C for QSFP, 1x Ethernet interface, 2x Ethernet Controller X710 for 10GBASE-T, 1x 1.7T SAMSUNG MZ1L21T9HCLS-00A07, Ubuntu 22.04.4 LTS, 6.5.0-21-generic. Test by Intel as of 08/12/24. 8280: 1-node, 2x (1x used) Intel® Xeon® Platinum 8280L CPU @ 2.70GHz, 28 cores, 205W TDP, HT On, Turbo On, Total Memory 768GB (12x64GB DDR4 3200 MT/s [2934 MT/s]), BIOS SE5C620.86B.02.01.0017.110620230543, microcode 0x5003605, 2x Ethernet Controller E810-C for QSFP, 2x Ethernet Connection X722 for 10GBASE-T, 1x 3.5T SAMSUNG MZ7LH3T8, Ubuntu 22.04.4 LTS, 6.5.0-21-generic. Test by Intel as of 08/12/24. AMD EPYC 9654:1-node, 2x (1x used) AMD EPYC 9654 96-Core Processor, 96 cores, 360W TDP, SMT On, Boost On, NPS 1, Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 1.6, microcode 0xa10113e, 2x Ethernet Controller E810-C for QSFP, 2x Ethernet Controller 10G X550T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.4 LTS, 6.5.0-21-generic. Test by Intel as of 08/13/24. AMD EPYC 9754:1-node, 2x (1x used) AMD EPYC 9754 128-Core Processor, 128 cores, 360W TDP, SMT On, Boost On, NPS 1, Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 1.6, microcode 0xa10113e, 2x Ethernet Controller E810-C for QSFP, 2x Ethernet Controller 10G X550T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.4 LTS, 6.5.0-21-generic. Test by Intel as of 08/13/24. Software: Redis memtier: Redis: 7.0.5 Memtier: 1.4.0, multi-instance. | Redis Memtier | Test by Intel as of 08/14/24. |
| [9D5] Slight degradation (3%) in performance in exchange for repurposing the DRAM with Intel® Xeon® 6 with P-cores using Compute Express Link (CXL) - Large In-Memory Database running in Flat Memory Mode | Intel® Xeon® 6900-series with P-cores | 1LM : 1-node, pre-production platform, 2x Intel® Xeon® with 120 cores/550W, HT on, Turbo On, NUMA off, Total Memory 2304GB (24x96GB DDR5 6400 MT/s [6400 MT/s]), BIOS BHSDCRB1.IPC.3398.D01.2407102228, microcode 0x1000260, 1x I210 Gigabit Network Connection, 2x Ethernet Controller E810-XXV for SFP, 2x 7T SAMSUNG MZQL27T6HBLA-00A07, 1x 1.7T Micron_7450_MTFDKBG1T9TFR, SUSE Linux Enterprise Server 15 SP6, 6.4.0-150600.21-default. Test by Intel Sept 2024 Flat2LM: 1-node, pre-production platform, 2x Intel® Xeon® with 120 cores/550W, HT on, Turbo On, NUMA off, Total Memory 2304GB (24x64GB DDR5 6400 MT/s + 6x Montage Gen1 CXL DDR4 3200 MT/s [12x DDR4 64GB]), BIOS BHSDCRB1.IPC.3398.D01.2407102228, microcode 0x1000260, 1x I210 Gigabit Network Connection, 2x Ethernet Controller E810-XXV for SFP, 2x 7T SAMSUNG MZQL27T6HBLA-00A07, 1x 1.7T Micron_7450_MTFDKBG1T9TFR, SUSE Linux Enterprise Server 15 SP6, 6.4.0-150600.21-default, Test by Intel Sept 2024 Software: Montage Gen1 FW 12.40.1.060f.00.bin | CXL and Montage DB | Test by Intel Sept 2024 Flat |
| [9D6] Up to 1.5x higher CassandraDB Performance with the new Intel® Xeon® 6980P [DDR] at 10ms P99 SLA vs. AMD EPYC 9654 Up to 1.45x higher CassandraDB performance with the new Intel® Xeon® 6980P [DDR] at 10ms P99 SLA vs. AMD EPYC 9754 | Intel® Xeon® 6900-series with P-cores | 6980P: 1-node, pre-production platform, 2x (1x used) Genuine Intel(R) 6980P, 128 cores, HT On, Turbo On, NUMA 6 Total Memory 1536GB (24x64GB DDR5 6400 MT/s [6400 MT/s]), BIOS BHSDCRB1.IPC.0034.D82.2408060239, microcode 0x10002d0, 1x I210 Gigabit Network Connection, 1x 894.3G Micron_7450_MTFDKBG960TFR, 8x 3.5T SAMSUNG MZQL23T8HCLS-00A07, Ubuntu 24.04 LTS, 6.8.0-41-generic. Test by Intel as of 08/26/24. AMD EPYC 9654: 1-node, 2x (1x used) AMD EPYC 9654 96-Core Processor, 96 cores, SMT On, Boost On, NPS2, Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 1.6, microcode 0xa101144, 2x Ethernet Controller X550, 6x 3.5T SAMSUNG MZQL23T8HCLS-00A07, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 24.04.1 LTS, 6.8.0-41-generic. Test by Intel as of 09/09/24. AMD EPYC 9754: 1-node, 2x (1x used) AMD EPYC 9754 128-Core Processor, 128 cores, SMT On, Boost On, NPS2, Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 1.6, microcode 0xaa00213, 2x Ethernet Controller X550, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, 6x 3.5T SAMSUNG MZQL23T8HCLS-00A07, Ubuntu 24.04.1 LTS, 6.8.0-41-generic. Test by Intel as of 07/16/24. Software Config: Multi instance, Mix (80:20 Read:Write) at 10ms 99th SLA Apache Cassandra, Cassandra-Stress, Middleware, Framework and Runtimes: "openjdk version " Framework : "11.0.24"" 2024-07-16 OpenJDK Runtime Environment (build 11.0.24+8-post-Ubuntu-1ubuntu324.04.1) OpenJDK 64-Bit Server VM (build 11.0.24+8-post-Ubuntu-1ubuntu324.04.1, mixed mode, sharin". | Apache Cassandra | Test by Intel as of 08/26/24. |
| [9G1] 2.1x average general compute performance gain with new Intel® Xeon® 6980P over prior generation Intel® Xeon® Platinum 8592+ 5.6x average general compute performance gain with new Intel® Xeon® 6980P over 2nd Gen Intel® Xeon® Platinum 8280 Up to 2.06x higher integer throughput performance and up to 1.44x higher integer throughput performance/watt (CPU TDP) with new Intel® Xeon® 6980P [MRDIMM] over prior generation Intel® Xeon® Platinum 8592+ Up to 2.07x higher floating point throughput performance and up to 1.45x higher floating point throughput performance/watt (CPU TDP) with new Intel® Xeon® 6980P [MRDIMM] over prior generation Intel® Xeon® Platinum 8592+ Up to 2.14x higher memory bandwidth and up to 1.5x higher memory bandwidth performance/watt (CPU TDP) with new Intel® Xeon® 6980P [MRDIMM] over prior generation Intel® Xeon® Platinum 8592+ Up to 2.05x higher LINPACK performance and up to 1.44x higher LINPACK performance/watt (CPU TDP) with new Intel® Xeon® 6980P [DDR] over prior generation Intel® Xeon® Platinum 8592+ | Intel® Xeon® 6900-series with P-cores | 6980P: 1-node pre-production platform, 2x Intel® Xeon® 6 with P cores, 128 cores, 500W, HT On [Off Linpack, Stream], Turbo On, Total Memory 1536GB [Linpack (24x 64GB DDR5 6400), Others (24x64GB MRDIMM 8800)], BIOS version(), microcode 0x81000290, 1x I210 Gigabit Network Connection, 1x 1.5T INTEL SSDPF21Q016TB, Ubuntu 24.04 LTS, 6.8.0-39-generic, Test by Intel as of 08/15/24. 8592+:1-node, 2x Intel® Xeon® PLATINUM 8592+, 64 cores, HT On [Off Linpack, Stream], Turbo On,Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS version(), microcode 0x21000200, 2x Ethernet Controller X710 for 10GBASE-T, 1x 1.5T INTEL SSDPF21Q016TB, Ubuntu 22.04.1 LTS, 6.5.0-27-generic, Test by Intel as of 04/17/24. 8280: 1-node, 2x Intel® Xeon® Platinum 8280 CPU @ 2.70GHz, 28 cores, 205W, HT On [Off Linpack, Stream], Turbo On, S2600WFD, Total Memory 384GB (12x32GB DDR4 2933 MT/s [2933 MT/s]), microcode 0x5003604, 2x Ethernet Connection X722 for 10GBASE-T, 2x Ethernet Controller E810-C for QSFP, 1x 1.7T INTEL SSDPF2KX019T1M, Ubuntu 22.04.3 LTS, 6.5.0-27-generic, Test by Intel as of 04/11/24. Software: est. SPECcpu 2017 int/fprate: gcc13.1; LINPACK: HPLinpack 2.3, OneAPI 2023.2; Stream Triad: STREAM 5.10, OneAPI2024.2. *Average is the geomean of Integer throughput, floating point throughput, memory bandwidth and LINPACK. | Geomean SPECcpu rate (est), STREAM Triad, LINPACK | Test by Intel as of 08/15/24. |
| [9G2] Up to 1.9x higher performance/watt* with Intel® Xeon® 6980P processor [DDR] vs. prior generation 8592+ at a typical 40% server utilization point | Intel® Xeon® 6900-series with P-cores | 6980P [DDR]: Pre-production Intel® Xeon® 6 with P-cores: 1-node pre-production platform, 2x Intel® Xeon® 6980P, 128 cores, HT On, Turbo On, NUMA 6, Total Memory 1536GB (24x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS BHSDCRB1.IPC.0033.D57.2406240014, microcode 0x81000290, 1x I210 Gigabit Network Connection, 1x 894.3G Micron_7450_MTFDKBG960TFR, CentOS Stream 9, 6.6.0-gnr.bkc.6.6.26.5.40.x86_64, Test by Intel as of 08/07/24 8592+: 1-node, 2x Intel® Xeon® PLATINUM 8592+, 64 cores, HT On, Turbo On, NUMA 4, Integrated Accelerators Available [used]: DLB 2 [0], DSA 2 [0], IAA 2 [0], QAT 2 [0], Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS EGSDCRB1.SYS.0111.D23.2405061937, microcode 0x21000283, 2x Ethernet Controller I225-LM, 1x 447.1G SAMSUNG MZ7LH480HAHQ-00005, CentOS Stream 9, 6.2.0-emr.bkc.6.2.19.2.52.x86_64. Test by Intel as of 08/07/24 *Package power = measured 2 socket power during workload execution Software Config: Power Efficiency workload, OpenJDK11.28 | Energy Efficiency Server Load Line | Test by Intel as of 08/07/24 |
| [9G3] For Intel® Xeon® 6 P-core processors with DDR5 vs. MRDIMM, the memory bandwidth improvements range from 1.07x - 1.33x across eight workloads. | Intel® Xeon® 6900-series with P-cores | MRDIMMs Excel for Bandwidth Intensive Workloads a) Ansys Fluent (aircraft_wing_14m, aircraft_wing_2m, combustor_12m, combustor_16m, combustor_71m, exhaust_system_33m, fluidized_bed_2m, ice_2m, landing_gear_15m, oil_rig_7m, pump_2m, rotor_3m, sedan_4m) 6980P, MRDIMM: Test by Intel as of July 2024, 1 node, 2x Intel® Xeon® 6980P, HT On, Turbo On, SNC3, 1536 GB MRDIMM-8800, BIOS BHSDREL1.86B.0033.D40.2406180419, ucode=0x11000280, Ubuntu 24.04, Kernel 6.8.0, Ansys Fluent 2024R1 6980P, DDR5: Test by Intel as of July 2024, 1 node, 2x Intel® Xeon® 6980P, HT On, Turbo On, SNC3, 1536 GB DDR5-6400, BIOS BHSDREL1.86B.0033.D40.2406180419, ucode=0x11000280, Ubuntu 24.04, Kernel 6.8.0, Ansys Fluent 2024R1 b) WRF (CONUS-12km, CONUS-2.5km) 6980P, MRDIMM : Test by Intel as of July 2024, 1 node, 2x Intel® Xeon® 6980P, HT On, Turbo On, SNC3, 1536 GB MRDIMM-8800, BIOS BHSDREL1.86B.0033.D40.2406180419, ucode=0x11000280, Ubuntu 24.04, Kernel 6.8.0, WRF v4.5.2, 6980P, DDR5: Test by Intel as of July 2024, 1 node, 2x Intel® Xeon® 6980P, HT On, Turbo On, SNC3, 1536 GB DDR5-6400, BIOS BHSDREL1.86B.0033.D40.2406180419, ucode=0x11000280, Ubuntu 24.04, Kernel 6.8.0, WRF v4.5.2, c) OpenFOAM (motorbike-20m, motorbike-42m) 6980P, MRDIMM: 1 node, 2x Intel® Xeon® 6980P, HT On, Turbo On, SNC3, 1536 GB MRDIMM-8800, BIOS BHSDREL1.86B.0033.D40.2406180419, ucode=0x11000280, Ubuntu 24.04, Kernel 6.8.0, Test by Intel as of July 2024. 6980P, DDR5: 1 node, 2x Intel® Xeon® 6980P, HT On, Turbo On, SNC3, 1536 GB DDR5-6400, BIOS BHSDREL1.86B.0033.D40.2406180419, ucode=0x11000280, Ubuntu 24.04, Kernel 6.8.0, Test by Intel as of July 2024. Software: OpenFOAM v2312, This offering is not approved or endorsed by OpenCFD Limited, producer and distributor of the OpenFOAM software via www.openfoam.com, and owner of the OPENFOAM® and OpenCFD® trademark. d) STREAM Triad Intel® Xeon® 6980P with DDR5: Test by Intel as of July 2024, 1 node, 2x Intel® Xeon® 6980P, HT On, Turbo On, SNC3, 1536 GB DDR5-6400, BIOS BHSDREL1.86B.0033.D40.2406180419, ucode=0x11000280, Ubuntu 24.04, Kernel 6.8.0, App Version: v5.10 Intel® Xeon® 6980P with MCR : Test by Intel as of July 2024, 1 node, 2x Intel® Xeon® 6980P, HT On, Turbo On, SNC3, 1536 GB MRDIMM-8800, BIOS BHSDREL1.86B.0033.D40.2406180419, ucode=0x11000280, Ubuntu 24.04, Kernel 6.8.0, App Version: v5.10 e) HPCG 6980P, MRDIMM : 1 node, 2x Intel® Xeon® 6980P, HT On, Turbo On, SNC3, 1536 GB MRDIMM-8800, BIOS BHSDREL1.86B.0033.D40.2406180419, ucode=0x11000280, Ubuntu 24.04, Kernel 6.8.0, HPCG from Intel_Optimized_MKL_v2024.1, Test by Intel as of July 2024. 6980P, DDR5: 1 node, 2x Intel® Xeon® 6980P, HT On, Turbo On, SNC3, 1536 GB DDR5-6400, BIOS BHSDREL1.86B.0033.D40.2406180419, ucode=0x11000280, Ubuntu 24.04, Kernel 6.8.0, Test by Intel as of July 2024. Software: HPCG from Intel_Optimized_MKL_v2024.1 f) ResNet-50 6980P, MRDIMM: 1-node, pre-production platform, 2x Intel(R) 6980P, 128 cores, 500W TDP, HT On, Turbo On, NUMA 6,Total Memory 1536GB (24x64GB MRDIMM 8800MT/s [8800 MT/s]), BIOS BHSDCRB1.IPC.0033.D57.2406240014, microcode 0x11000290, 2x Ethernet Controller X550, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 24.04 LTS, 6.8.0-31-generic. Test by Intel as of 08/20/24. 6980P, DDR: 1-node, pre-production platform, 2x Intel® Xeon® 6972P, 96 cores, 500W TDP, HT On, Turbo On, NUMA 2,Total Memory 1536GB (24x64GB DDR5 6400 MT/s [6400 MT/s]), BIOS BHSDCRB1.IPC.0033.D57.2406240014, microcode 0x11000290, 2x Dual-Media 10G RDMA Ethernet Controller, 2x Ethernet Controller E810-C for QSFP, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 24.04 LTS, 6.8.0-31-generic. Test by Intel as of 08/05/24. Software: ResNet50 v1.5, Inference: int8, bs=1 (sla=15ms), bs=x, Dataset: ImageNet, Framework: PyTorch:2.4.0, IPEX: 2.4.0, OneDNN: v3.4.2, Modelzoo: https://github.com/intel/ai-reference-models g/h) Gen AI - LLM (bs=1,bs=x): 6980P, MRDIMM: 1-node, 2x Intel® Xeon® 6980P, 128 cores, 500W TDP, HT On, Turbo On, Total Memory 1536GB (24x64GB MRDIMM 8800 MT/s [8800 MT/s]), BIOS BHSDCRB1.IPC.0033.D57.2406240014, microcode 0x11000290, 2x Ethernet Controller X710 for 10GBASE-T, 1x 1.7T Micron_7400_MTFDKCC1T9TDZ, Ubuntu 24.04 LTS, 6.8.0-31-generic. Test by Intel as of 07/11/24. 6980P, DDR: 1-node, 2x Intel® Xeon® 6980P, 128 cores, 500W TDP, HT On, Turbo On, Total Memory 1536GB (24x64GB DDR5 6400 MT/s [6400 MT/s]), BIOS BHSDCRB1.IPC.0033.D57.2406240014, microcode 0x11000290, 2x Ethernet Controller 10-Gigabit X540-AT2, 1x 3.5T Micron_7450_MTFDKCB3T8TFR, Ubuntu 24.04 LTS, 6.8.0-31-generic. Test by Intel as of 07/23/24. Software: Llama3 7B: int8, Framework: PyTorch:2.3.0, IPEX: 2.3.0, OneDNN: v3.4.2, Modelzoo: https://github.com/intel/ai-reference-models, Model instances=2, bs=16 (128/128), bs=2 (2048/2048), bs=7 (1024/128) | Memory Bandwidth Intenstive Workloads (Ansys Fluent, WRF, OpenFOAM, STREAM Triad, HPCG, ResNet-50, Llama-3 8B Summarization) | Test by Intel as of July 2024 |
| [9G4] Up to 1.2x higher average performance per core vs. 5th Gen Intel Xeon Up to 1.6x higher performance average per watt vs. 5th Gen Intel Xeon | Intel® Xeon® 6900-series with P-cores | a) Integer Throughput, FP Throughput, Memory Bandwidth, LINPACK 6980P: 1-node pre-production platform, 2x Intel® Xeon® 6 with P cores, 128 cores, 500W, HT On [Off Linpack, Stream], Turbo On, Total Memory 1536GB [Linpack (24x 64GB DDR5 6400), Others (24x64GB MRDIMM 8800)],microcode 0x81000290, 1x I210 Gigabit Network Connection, 1x 1.5T INTEL SSDPF21Q016TB, Ubuntu 24.04 LTS, 6.8.0-39-generic, Test by Intel as of 08/15/24. 8592+:1-node, 2x Intel® Xeon® Platinum 8592+, 64 cores, HT On [Off Linpack, Stream], Turbo On,Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), microcode 0x21000200, 2x Ethernet Controller X710 for 10GBASE-T, 1x 1.5T INTEL SSDPF21Q016TB, Ubuntu 22.04.1 LTS, 6.5.0-27-generic, Test by Intel as of 04/17/24. Software: (est.) SPECcpu 2017 int/fp rate: gcc13.1; STREAM Triad: STREAM 5.10, OneAPI2024.2, LINPACK: HPLinpack 2.3, OneAPI 2023.2. b) MongoDB (1S): 6980P: 1-node pre-production platform, 2x (1x used) Intel® Xeon® 6980P, 128 cores, HT On, Turbo On, Total Memory 1536GB (24x64GB DDR5 6400 MT/s [6400 MT/s]), BIOS BHSDCRB1.IPC.0033.D57.2406240014, microcode 0x11000290, 2x Ethernet Controller 10-Gigabit X540-AT2, 2x Ethernet Controller E810-C for QSFP, 4x 3.5T KIOXIA KCD8XPUG3T84, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.1 LTS, 6.5.0-21-generic. Test by Intel as of 07/17/24. 8592+:1-node, 2x (1x used) Intel® Xeon® Platinum 8592+, 64 cores, HT On, Turbo On, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 2.0, microcode 0x21000230, 1x Ethernet Controller E810-C for QSFP, 1x Ethernet interface, 2x Ethernet Controller X710 for 10GBASE-T, 1x 1.7T SAMSUNG MZ1L21T9HCLS-00A07, 4x 3.5T KIOXIA KCD8XPUG3T84, Ubuntu 22.04.4 LTS, 6.5.0-21-generic. Test by Intel as of 07/16/24. Software: MongoDB 6.0.4, YCSB, multi-instance, read/update 90/10. c) HammerDB MySQL (1S): 6980P: 1-node pre-production platform, 2x (1x used) Intel® Xeon® 6980P, 128 cores, HT On, Turbo On, Total Memory 1536GB (24x64GB DDR5 6400 MT/s [6400 MT/s]), BIOS BHSDCRB1.IPC.0033.D57.2406240014, microcode 0x11000290, 2x Ethernet Controller 10-Gigabit X540-AT2, 2x Ethernet Controller E810-C for QSFP, 4x 3.5T KIOXIA KCD8XPUG3T84, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.1 LTS, 6.5.0-21-generic. Test by Intel as of 07/17/24. 8592+: 1-node, 2x (1x used) Intel® Xeon® Platinum 8592+, 64 cores, HT On, Turbo On, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 2.0, microcode 0x21000230, 2x Ethernet Controller X710 for 10GBASE-T, 2x Ethernet Controller E810-C for QSFP, 1x Ethernet interface, 1x 1.7T SAMSUNG MZ1L21T9HCLS-00A07, Ubuntu 22.04.4 LTS, 6.5.0-21-generic. Test by Intel as of 07/29/24. Software: TPROC-C on MySQL 8033, HammerDB 4.7, multi-instance. d) Redis Vector Similarity Search 6980P w/MRDIMM: 1-node pre-production platform, 2x Intel® Xeon® 6980P, 128 cores, 500W TDP, HT On, Turbo On, Total Memory 1536GB (24x64GB MRDIMM 8800 MT/s [8800 MT/s]), BIOS BHSDCRB1.IPC.0033.D57.2406240014, microcode 0x81000290, 2x Ethernet Controller E810-C for QSFP, 2x Ethernet Controller 10G X550T, 1x 1.7T KIOXIA KCD8XPUG1T92, 1x 1.7T SAMSUNG MZWLJ1T9HBJR-00007, 3x 1.7T KIOXIA KCD81PUG1T92, Ubuntu 22.04.4 LTS, 6.5.0-21-generic. Test by Intel as of 07/15/24. 8592+:1-node, 2x Intel® Xeon® PLATINUM 8592+, 64 cores, 350W TDP, HT On, Turbo On, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 2.0, microcode 0x21000230, 2x Ethernet Controller X710 for 10GBASE-T, 2x Ethernet Controller E810-C for QSFP, 1x Ethernet interface, 1x 1.7T SAMSUNG MZ1L21T9HCLS-00A07, Ubuntu 22.04.4 LTS, 6.5.0-21-generic. Test by Intel as of 07/30/24. Software: Redis: 7.2 Redisearch=v2.8.11 vector-db-benchmark GCC 12.3.0, multi-instance e) ClickHouse OLAP 6972P: 1-node pre-production platform, 2x Intel® Xeon® 6972P, 96 cores, 500W TDP, HT On, Turbo On, Total Memory 1536GB (24x64GB DDR5 6400 MT/s [6400 MT/s]), BIOS BHSDCRB1.IPC.0033.D57.2406240014, microcode 0x11000290, 2x Ethernet Controller 10-Gigabit X540-AT2, 2x Ethernet Controller E810-C for QSFP, 1x 1.7T Micron_7400_MTFDKCC1T9TDZ, Ubuntu 22.04.4 LTS, 6.5.0-21-generic. Test by Intel as of 08/15/24. 8592+: 1-node, 2x Intel® Xeon® Platinum 8592+, 64 cores, HT On, Turbo On, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 3B08.TEL3P1, microcode 0x21000240, 2x Ethernet Controller 10-Gigabit X540-AT2, 2x Ethernet Controller E810-C for QSFP, 1x Ethernet interface, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.4 LTS, 6.5.0-21-generic. Test by Intel as of 08/15/24. Software : Star Schema Benchmark, ClickHouse, Clang 18, v24.7.3.42-stable, lz4. Geomean of Q1.1, Q2.1, Q2.2, Q2.3, Q3.1, Q3.2, Q3.3, Q4.1, Q4.2, Q4.3, multi-instance f) NEMO (BENCH ORCA-1, GYRE_PISCES_25) 6980P w/MRDIMM: 1 node, 2x Intel® Xeon® 6980P, HT On, Turbo On, SNC3, 1536 GB MRDIMM-8800, BIOS BHSDREL1.86B.0033.D40.2406180419, ucode=0x11000280, Ubuntu 24.04, Kernel 6.8.0, NEMO v4.2, Test by Intel as of July 2024. 8592+: 1 node, 2x Intel® Xeon® 8592+, HT On, Turbo On, SNC2, 1024GB DDR5-5600, BIOS EGSDCRB1.SYS.0105.D74.2308261931, ucode 0x21000161, Ubuntu 22.04.1 LTS, Kernel 5.15.0, Test by Intel as of July 2024. Software: NEMO v4.2 g) OpenFOAM (motorbike-20m, motorbike-42m) 6980P w/MRDIMM: Test by Intel as of July 2024, 1 node, 2x Intel® Xeon® 6980P, HT On, Turbo On, SNC3, 1536 GB MRDIMM-8800, BIOS BHSDREL1.86B.0033.D40.2406180419, ucode=0x11000280, Ubuntu 24.04, Kernel 6.8.0, Test by Intel as of March 2024. 8592+: 1 node, 2x Intel® Xeon® 8592+, HT On, Turbo On, SNC2, 512GB DDR5-5600, BIOS 3B07.TEL2P1, ucode 0x21000200, Ubuntu 23.10, Kernel 6.5.0, Test by Intel as of March 2024. Software: OpenFOAM v2312. This offering is not approved or endorsed by OpenCFD Limited, producer and distributor of the OpenFOAM software via www.openfoam.com, and owner of the OPENFOAM® and OpenCFD® trademark. h) HPCG 6980P w/MRDIMM: 1 node, 2x Intel® Xeon® 6980P, HT On, Turbo On, SNC3, 1536 GB MRDIMM-8800, BIOS BHSDREL1.86B.0033.D40.2406180419, ucode=0x11000280, Ubuntu 24.04, Kernel 6.8.0, Test by Intel as of July 2024. Software App Version: HPCG from Intel_Optimized_MKL_v2024.1 8592+: 1 node, 2x Intel® Xeon® 8592+, HT On, Turbo On, SNC2, 512GB DDR5-5600, BIOS 3B07.TEL2P1, ucode 0x21000200, Ubuntu 23.10, Kernel 6.5.0, Test by Intel as of July 2024. Software App Version: HPCG from Intel_Optimized_MKL_v2022.1.0 i) LLM: 6972P w/MRDIMM: 1-node pre-production platform, 2x Intel® Xeon® 6972P, 96 cores, 500W TDP, HT On, Turbo On, Total Memory 1536GB (24x64GB MRDIMM 8800MT/s [8800 MT/s]), BIOS BHSDCRB1.IPC.0033.D57.2406240014, microcode 0x11000290, 2x Ethernet Controller 10-Gigabit X540-AT2, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 24.04 LTS, 6.8.0-31-generic. Test by Intel as of 07/10/24. 8592+: 1-node, 2x Intel® Xeon® Platinum 8592+, 64 cores, 350W TDP, HT On, Turbo On, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 3B07.TEL2P1, microcode 0x21000200, 1x Ethernet interface, 2x Ethernet Controller 10-Gigabit X540-AT2, 1x 3.5T Micron_7450_MTFDKCB3T8TFR, Ubuntu 24.04 LTS, 6.8.0-31-generic. Test by Intel as of 07/11/24. Llama2 7B: bf16, bs=4 (1024/128), PyTorch:2.4.0, IPEX: 2.4.0, OneDNN: v3.4.2, Modelzoo:https://github.com/intel/ai-reference-models Llama3 8B: int8, bs=7 (1024/128), PyTorch:2.3.0, IPEX: 2.3.0, OneDNN: v3.4.2, Modelzoo: https://github.com/intel/ai-reference-models | Integer Throughput, FP Throughput, Memory Bandwidth, LINPACK, MongoDB (1S), HammerDB MySQL (1S), Redis Vector Similarity Search, ClickHouse OLAP, NEMO, OpenFOAM, HPCG, LLM | Test by Intel as of 08/15/24. |
| [9G10] Up to 5.9x higher integer throughput with Intel® Xeon® 6980P vs. Intel® Xeon® 8280 Up to 6.4x higher floating point throughput with Intel® Xeon® 6980P vs. Intel® Xeon® 8280. Up to 2x higher integer throughput with Intel® Xeon® 6980P vs. Intel® Xeon® 8592+ Up to 2x higher floating point throughput with Intel® Xeon® 6980P vs. Intel® Xeon® 8592+ | Intel® Xeon® 6900-series with P-cores | Pre-production Intel® Xeon® 6 with P-cores: 1-node, pre-production platform, 2x Intel® Xeon® 6 with P cores, 128 cores, HT On [Off Linpack, Stream], Turbo On, Total Memory 1536GB - (24x64GB MCR 8800), microcode 0x810001d0, 1x I210 Gigabit Network Connection, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.4 LTS, 6.5.0-26-generic, Test by Intel as of 04/20/24. 8592+:1-node, 2x Intel® Xeon® PLATINUM 8592+, 64 cores, HT On[Off Linpack, Stream], Turbo On,Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), microcode 0x21000200, 2x Ethernet Controller X710 for 10GBASE-T, 1x 1.5T INTEL SSDPF21Q016TB, Ubuntu 22.04.1 LTS, 6.5.0-27-generic, Test by Intel as of 04/17/24. 8280: 1-node, 2x Intel® Xeon® Platinum 8280 CPU @ 2.70GHz, 28 cores, HT On [Off Linpack, Stream], Turbo On, S2600WFD, Total Memory 384GB (12x32GB DDR4 2933 MT/s [2933 MT/s]), microcode 0x5003604, 2x Ethernet Connection X722 for 10GBASE-T, 2x Ethernet Controller E810-C for QSFP, 1x 1.7T INTEL SSDPF2KX019T1M, Ubuntu 22.04.3 LTS, 6.5.0-27-generic, Test by Intel as of 04/11/24. Software: est. SPECcpu 2017 int/fp rate: gcc13.1 | Integer and floating point throughput - SPEC CPU® 2017 rate [est] | Test by Intel as of 04/20/24. |
| [9G201] Up to 1.37x higher integer throughput performance on Intel® Xeon® 6980P [MRDIMM] vs. AMD EPYC 9654 Up to 1.63x higher floating point throughput performance on Intel® Xeon® 6980P [MRDIMM] vs. AMD EPYC 9654 Up to 1.74x higher memory bandwidth on Intel® Xeon® 6980P [MRDIMM] vs. AMD EPYC 9654 Up to 2.04x higher LINPACK performance on Intel® Xeon® 6972P [DDR] vs. AMD EPYC 9654 Up to 1.20x higher integer throughput performance on Intel® Xeon® 6980P [MRDIMM] vs. AMD EPYC 9754 Up to 1.59x higher floating point throughput performance on Intel® Xeon® 6980P [MRDIMM] vs. AMD EPYC 9754 Up to 1.61x higher memory bandwidth on Intel® Xeon® 6980P [MRDIMM] vs. AMD EPYC 9754 Up to 1.79x higher LINPACK performance on Intel® Xeon® 6972P [DDR] vs. AMD EPYC 9754 | Intel® Xeon® 6900-series with P-cores | 6980P: 1-node pre-production platform, 2x Intel® Xeon® 6 with P cores, 128 cores, 500W, HT On [Off Linpack, Stream], Turbo On, Total Memory 1536GB [LINPACK (24x 64GB DDR5 6400), Others (24x64GB MRDIMM 8800)],microcode 0x81000290, 1x I210 Gigabit Network Connection, 1x 1.5T INTEL SSDPF21Q016TB, Ubuntu 24.04 LTS, 6.8.0-39-generic, Test by Intel as of 08/15/24. AMD EPYC 9654: 1-node, 2x AMD EPYC 9654, 96 cores, SMT On [Off Linpack, Stream], Boost On, Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 1.6, microcode 0xa10113e, 1x I210 Gigabit Network Connection, 1x 1.5T INTEL SSDPF21Q016TB, 1x 1.5T INTEL SSDPF21Q016TB, Ubuntu 22.04.4 LTS, 6.5.0-21-generic. Test by Intel as of 08/15/24. AMD EPYC 9754: 1-node, 2x AMD EPYC 9754, 128 cores, SMT On [Off Linpack, Stream], Boost On, Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 1.6, microcode 0xaa00212, 1x I210 Gigabit Network Connection, 1x 1.5T INTEL SSDPF21Q016TB, 1x 1.5T INTEL SSDPF21Q016TB, Ubuntu 22.04.4 LTS, 6.5.0-21-generic. Test by Intel as of 08/15/24. Software: est. SPECcpu 2017 int/fp rate: gcc13.1; STREAM Triad: STREAM 5.10, OneAPI2024.2, LINPACK: HPLinpack 2.3, OneAPI 2023.2. | General Compute (est. SPECcpu rate, STREAM Triad, LINPACK) | Test by Intel as of 08/15/24. |
| [9H2] Up to 7.6x average Earth Systems Modeling performance with Intel® Xeon® 6980P processor compared to 2nd Gen Intel Xeon processor. Up to 2.31x higher NEMO performance (geomean 2x) with Intel® Xeon® 6980P [MRDIMM] processor compared to Intel Xeon 8592+ Up to 1.84x MPAS-A (geomean of 2) performance with Intel Xeon 6980P [MRDIMM] vs. AMD EPYC 9654 Up to 1.75x NEMO (geomean of 2) performance with Intel Xeon 6980P [MRDIMM] vs. AMD EPYC 9654 Up to 1.28x WRF (geomean of 2) performance with Intel Xeon 6980P [MRDIMM] vs. AMD EPYC 9654 | Intel® Xeon® 6900-series with P-cores | MPAS-A (Geomean of 60-km dycore, 60-km dycore+Physics): Intel Xeon 6980P with MCR : Test by Intel as of July 2024, 1 node, 2x Intel Xeon 6980P, HT On, Turbo On, SNC3, 1536 GB MRDIMM-8800, BIOS BHSDREL1.86B.0033.D40.2406180419, ucode=0x11000280, Ubuntu 24.04, Kernel 6.8.0, MPAS-A v7.3. Intel Xeon 8280L: Test by Intel as of April 2024, 1 node, 2x Intel Xeon 8280L, HT On, Turbo On, 384 GB DDR3-2933, ucode=0x5003605, Ubuntu 23.10, Kernel 6.5.0, BIOS SE5C620.86B.02.01.0017.110620230543, MPAS-A 7.3. NEMO (Geomean of BENCH ORCA-1, GYRE_PISCES_25) 6980P w/MRDIMM: Test by Intel as of July 2024, 1 node, 2x Intel Xeon 6980P, HT On, Turbo On, SNC3, 1536 GB MRDIMM-8800, BIOS BHSDREL1.86B.0033.D40.2406180419, ucode=0x11000280, Ubuntu 24.04, Kernel 6.8.0, NEMO v4.2 8592+: Test by Intel as of April 2024, 1 node, 2x Intel Xeon 8592+, HT On, Turbo On, SNC2, 1024GB DDR5-5600, BIOS EGSDCRB1.SYS.0105.D74.2308261931, ucode 0x21000161, Ubuntu 22.04.1 LTS, Kernel 5.15.0, NEMO v4.2 8280L: Test by Intel as of April 2024, 1 node, 2x Intel Xeon 8280L, HT On, Turbo On, 384 GB DDR3-2933, ucode=0x5003605, Ubuntu 23.10, Kernel 6.5.0, BIOS SE5C620.86B.02.01.0017.110620230543, NEMO v4.2. NEMO (Geomean of BENCH ORCA-1, GYRE_PISCES_25) WRF (Geomean of CONUS-12km, CONUS-2.5km) Intel Xeon 6980P with MCR : Test by Intel as of July 2024, 1 node, 2x Intel Xeon 6980P, HT On, Turbo On, SNC3, 1536 GB MRDIMM-8800, BIOS BHSDREL1.86B.0033.D40.2406180419, ucode=0x11000280, Ubuntu 24.04, Kernel 6.8.0, WRF v4.5.2. Intel Xeon 8280L: Test by Intel as of April 2024, 1 node, 2x Intel Xeon 8280L, HT On, Turbo On, 384 GB DDR3-2933, ucode=0x5003605, Ubuntu 23.10, Kernel 6.5.0, BIOS SE5C620.86B.02.01.0017.110620230543, WRF v4.5.2. AMD EPYC 9654: Test by Intel as of April 2024, 1 node, 2x AMD EPYC 9654, SMT On, Boost On, NPS4, 1536 GB DDR5-4800, BIOS 1.9, ucode 0xa101148, Ubuntu 24.04, Kernel 6.8.0, MPAS-A v7.3, NEMO v4.2, WRF v4.5.2, App Version: v4.5.2 | Earth Systems Modeling (MPAS-A, NEMO, WRF) | Test by Intel as of July 2024 |
| [9H3] Up to 1.54x higher Seismic Kernels (geomean of 4) performance with Intel® Xeon® 6980P [MRDIMM] vs. AMD EPYC 9654 | Intel® Xeon® 6900-series with P-cores | Seismic Kernels run via YASK (Geomean of AWP; 640^3 grid, Iso3DFD; 1280^3 grid, SSG; 768^3 grid, wave-eq 2D; 32768^2 grid): 6980P with MRDIMM : Test by Intel as of July 2024, 1 node, 2x Intel® Xeon® 6980P, HT On, Turbo On, SNC3, 1536 GB MRDIMM-8800, BIOS BHSDREL1.86B.0033.D40.2406180419, ucode=0x11000280, Ubuntu 24.04, Kernel 6.8.0, YASK 4.05.01 AMD EPYC 9654: Test by Intel as of April 2024, 1 node, 2x AMD EPYC 9654, SMT On, Boost On, NPS4, 1536 GB DDR5-4800, BIOS 1.9, ucode 0xa101148, Ubuntu 24.04, Kernel 6.8.0, YASK 4.05.01 | Energy (Seismic Kernels) | Test by Intel as of July 2024 |
| [9H4] Up to 1.7x higher FSI Kernels performance with Intel® Xeon® 6980P [MRDIMM] vs. AMD EPYC 9654 | Intel® Xeon® 6900-series with P-cores | FSI Kernels (Geomean of Binomial Options, Black Scholes, Monte Carlo): 6980P [MRDIMM]: Test by Intel as of July 2024, 1 node, 2x Intel® Xeon® 6980P, HT On, Turbo On, SNC3, 1536 GB MRDIMM-8800, BIOS BHSDREL1.86B.0033.D40.2406180419, ucode=0x11000280, Ubuntu 24.04, Kernel 6.8.0, Binomial Options v1.1, Black Scholes v1.4, Monte Carlo: v1.2 AMD EPYC 9654: Test by Intel as of April 2024, 1 node, 2x AMD EPYC 9654, SMT On, Boost On, NPS4, 1536 GB DDR5-4800, BIOS 1.9, ucode 0xa101148, Ubuntu 24.04, Kernel 6.8.0, Binomial Options v1.1, Black Scholes v1.4, Monte Carlo: v1.2. | Finance | Test by Intel as of July 2024 |
| [9H5] Up to 1.3x GROMACS [DDR] performance with Intel® Xeon® 6980P vs. AMD EPYC 9654 Up to 1.7x LAMMPS [MRDIMM] performance with Intel® Xeon® 6980P vs. AMD EPYC 9654 Up to 2.26x NAMD [MRDIMM] performance with Intel® Xeon® 6980P vs. AMD EPYC 9654 Up to 2.01x RELION [DDR] performance with Intel® Xeon® 6980P vs. AMD EPYC 9654 | Intel® Xeon® 6900-series with P-cores | GROMACS (Geomean of benchPEP, benchPEP-h, benchRIB, ion_channel_pme_large, lignocellulose_rf_large, stmv, water1.5M_pme_large,water1.5M_rf_large): Intel® Xeon® 6980P with DDR5: Test by Intel as of July 2024, 1 node, 2x Intel® Xeon® 6980P, HT On, Turbo On, SNC3, 1536 GB DDR5-6400, BIOS BHSDREL1.86B.0033.D40.2406180419, ucode=0x11000280, Ubuntu 24.04, Kernel 6.8.0, GROMACS v2024.1 AMD EPYC 9654: Test by Intel as of August 2024, 1 node, 2x AMD EPYC 9654, SMT On, Boost On, NPS4, 1536 GB DDR5-4800, BIOS 1.9, ucode 0xa101148, Ubuntu 24.04, Kernel 6.8.0, GROMACS v2024.1. LAMMPS (Geomean of Atomic Fluid, Copper, DPD, Liquid Crystal, Polyethylene, Protein, Stillinger-Weber, Tersoff, Water): Intel® Xeon® 6980P with MCR : Test by Intel as of July 2024, 1 node, 2x Intel® Xeon® 6980P, HT On, Turbo On, SNC3, 1536 GB MRDIMM-8800, BIOS BHSDREL1.86B.0033.D40.2406180419, ucode=0x11000280, Ubuntu 24.04, Kernel 6.8.0, LAMMPS v2024-03-07_dev AMD EPYC 9654: Test by Intel as of April 2024, 1 node, 2x AMD EPYC 9654, SMT On, Boost On, NPS4, 1536 GB DDR5-4800, BIOS 1.9, ucode 0xa101148, Ubuntu 24.04, Kernel 6.8.0, LAMMPS v2024-03-07_dev NAMD (Geomean of apoa1_npt_2fs, f1atpase, hecbiosim-300k, hecbiosim-465k, hecbiosim-61k, stmv_npt_2fs): Intel® Xeon® 6980P with MCR : Test by Intel as of July 2024, 1 node, 2x Intel® Xeon® 6980P, HT On, Turbo On, SNC3, 1536 GB MRDIMM-8800, BIOS BHSDREL1.86B.0033.D40.2406180419, ucode=0x11000280, Ubuntu 24.04, Kernel 6.8.0, NAMD v2.15alpha AMD EPYC 9654: Test by Intel as of April 2024, 1 node, 2x AMD EPYC 9654, SMT On, Boost On, NPS4, 1536 GB DDR5-4800, BIOS 1.9, ucode 0xa101148, Ubuntu 24.04, Kernel 6.8.0, NAMD v2.15alpha RELION (Geomean of Plasmodium Ribosome 2D classification, Plasmodium Ribosome 3D classification): Intel® Xeon® 6980P with DDR5: Test by Intel as of July 2024, 1 node, 2x Intel® Xeon® 6980P, HT On, Turbo On, SNC3, 1536 GB DDR5-6400, BIOS BHSDREL1.86B.0033.D40.2406180419, ucode=0x11000280, Ubuntu 24.04, Kernel 6.8.0, RELION 5.0-beta-2 AMD EPYC 9654: Test by Intel as of April 2024, 1 node, 2x AMD EPYC 9654, SMT On, Boost On, NPS4, 1536 GB DDR5-4800, BIOS 1.9, ucode 0xa101148, Ubuntu 24.04, Kernel 6.8.0, RELION 5.0-beta-2 | Life & Material Science | Test by Intel as of July 2024. |
| [9H6] Up to 1.69x ANSYS CFX [MRDIMM] performance with Intel® Xeon® 6980P vs. AMD EPYC 9654 Up to 1.54x ANSYS FLUENT [MRDIMM] performance with Intel® Xeon® 6980P vs. AMD EPYC 9654 Up to 1.45x ANSYS LS-DYNA [MRDIMM] performance with Intel® Xeon® 6980P vs. AMD EPYC 9654 Up to 2.05x OpenFOAM [MRDIMM] performance with Intel® Xeon® 6980P vs. AMD EPYC 9654 | Intel® Xeon® 6900-series with P-cores | Ansys CFX (Geomean of CFX-Airfoil_10M, CFX-Airfoil_100M): Intel® Xeon® 6980P with DDR5: Test by Intel as of July 2024, 1 node, 2x Intel® Xeon® 6980P, HT On, Turbo On, SNC3, 1536 GB DDR5-6400, BIOS BHSDREL1.86B.0033.D40.2406180419, ucode=0x11000280, Ubuntu 24.04, Kernel 6.8.0, Ansys CFX 2022 R1 Intel® Xeon® 6980P with MCR : Test by Intel as of July 2024, 1 node, 2x Intel® Xeon® 6980P, HT On, Turbo On, SNC3, 1536 GB MRDIMM-8800, BIOS BHSDREL1.86B.0033.D40.2406180419, ucode=0x11000280, Ubuntu 24.04, Kernel 6.8.0, Ansys CFX 2022 R1 AMD EPYC 9654: Test by Intel as of August 2024, 1 node, 2x AMD EPYC 9654, SMT On, Boost On, NPS4, 1536 GB DDR5-4800, BIOS 1.9, ucode 0xa101148, Ubuntu 24.04, Kernel 6.8.0, Ansys Fluent CFX 2022 R1 Ansys Fluent (Geomean of aircraft_wing_14m, aircraft_wing_2m, combustor_12m, combustor_16m, combustor_71m, exhaust_system_33m, fluidized_bed_2m, ice_2m, landing_gear_15m, oil_rig_7m, pump_2m, rotor_3m, sedan_4m): Intel® Xeon® 6980P with DDR5: Test by Intel as of July 2024, 1 node, 2x Intel® Xeon® 6980P, HT On, Turbo On, SNC3, 1536 GB DDR5-6400, BIOS BHSDREL1.86B.0033.D40.2406180419, ucode=0x11000280, Ubuntu 24.04, Kernel 6.8.0, Ansys Fluent 2024R1 Intel® Xeon® 6980P with MCR : Test by Intel as of July 2024, 1 node, 2x Intel® Xeon® 6980P, HT On, Turbo On, SNC3, 1536 GB MRDIMM-8800, BIOS BHSDREL1.86B.0033.D40.2406180419, ucode=0x11000280, Ubuntu 24.04, Kernel 6.8.0, Ansys Fluent 2024R1 AMD EPYC 9654: Test by Intel as of April 2024, 1 node, 2x AMD EPYC 9654, SMT On, Boost On, NPS4, 1536 GB DDR5-4800, BIOS 1.9, ucode 0xa101148, Ubuntu 24.04, Kernel 6.8.0, Ansys Fluent 2024R1 Ansys LS-DYNA (Geomean of 3cars-150ms, car2car-120ms, ODB_10M-30ms): Intel® Xeon® 6980P with DDR5: Test by Intel as of July 2024, 1 node, 2x Intel® Xeon® 6980P, HT On, Turbo On, SNC3, 1536 GB DDR5-6400, BIOS BHSDREL1.86B.0033.D40.2406180419, ucode=0x11000280, Ubuntu 24.04, Kernel 6.8.0, Ansys LS-DYNA R11 Intel® Xeon® 6980P with MCR: Test by Intel as of July 2024, 1 node, 2x Intel® Xeon® 6980P, HT On, Turbo On, SNC3, 1536 GB MRDIMM-8800, BIOS BHSDREL1.86B.0033.D40.2406180419, ucode=0x11000280, Ubuntu 24.04, Kernel 6.8.0, Ansys LS-DYNA R11 AMD EPYC 9654: Test by Intel as of April 2024, 1 node, 2x AMD EPYC 9654, SMT On, Boost On, NPS4, 1536 GB DDR5-4800, BIOS 1.9, ucode 0xa101148, Ubuntu 24.04, Kernel 6.8.0, Ansys LS-DYNA R11 OpenFOAM (Geomean of motorbike-20m, motorbike-42m): Intel® Xeon® 6980P with MCR : Test by Intel as of July 2024, 1 node, 2x Intel® Xeon® 6980P, HT On, Turbo On, SNC3, 1536 GB MRDIMM-8800, BIOS BHSDREL1.86B.0033.D40.2406180419, ucode=0x11000280, Ubuntu 24.04, Kernel 6.8.0, OpenFOAM v2312 AMD EPYC 9654: Test by Intel as of April 2024, 1 node, 2x AMD EPYC 9654, SMT On, Boost On, NPS4, 1536 GB DDR5-4800, BIOS 1.9, ucode 0xa101148, Ubuntu 24.04, Kernel 6.8.0, Software: OpenFOAM v2312. This offering is not approved or endorsed by OpenCFD Limited, producer and distributor of the OpenFOAM software via www.openfoam.com, and owner of the OPENFOAM® and OpenCFD® trademark. | Manufacturing | Test by Intel as of July 2024. |
| [9H7] Achieve a blistering fast 1.8x performance gain in HPC workloads such as FluidX3D with Intel® Xeon® 6979P Processors vs. Intel® Xeon® Platinum 8592+ Processors | Intel® Xeon® 6900-series with P-cores | 6979P w/MRDIMM: Pre-production Intel® Xeon® 6 with P-cores: 1-node, pre-production platform, 2x Intel® Xeon® 6 with P cores, 120 cores, HT On, Turbo On, Total Memory 3072GB (24x128GB MRDIMM-8800), microcode 0x110002c0, 1x 1.7T Micron_7450_MTFDKCC1T9TFR, Ubuntu 24.04 LTS, 6.8.0-38-generic, Test by Intel as of 08/30/2024. 8592+: 1-node, 2x Intel® Xeon® PLATINUM 8592+, 64 cores, HT On, Turbo On, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), microcode 0x21000230, 1x 3.6T INTEL SSDPE2KX040T8, Ubuntu 24.04 LTS, 6.8.0-35-generic, Test by Intel as of 08/30/2024. Software: FluidX3D, https://github.com/ProjectPhysX/FluidX3D. Initial Parameters: 300 km/h airspeed, 10° angle of attack, 0.5 seconds simulated time. Calculations: 37k time steps at 1301 x 4338 x 759 = 4.28B cells resolution, 1 cell = 11.334 mm, 1 s = 74k time steps. Memory usage: 449GB (FP32 arithmetic + FP32 memory storage). Images rendered: 6x 1200 4K resolution images, each image visualizing 51GB (velocity field). | [Demo] FluidX3D, 4.3B Cell Simulation of NASA X-59 Aircraft | Test by Intel as of 08/30/2024 |
| [9H9] Up to 2.5x higher HPCG performance and 1.73x perf/watt with Intel® Xeon® 6980P [MRDIMM] vs. Intel® Xeon® 8592+. | Intel® Xeon® 6900-series with P-cores | 6980P w/MRDIMM: 1 node, 2x Intel® Xeon® 6980P, 128 cores, HT On, Turbo On, SNC3, 1536 GB MRDIMM-8800, BIOS BHSDREL1.86B.0033.D40.2406180419, ucode=0x11000280, Ubuntu 24.04, Kernel 6.8.0, HPCG from Intel_Optimized_MKL_v2024.1, Test by Intel as of July 2024. 8592+: 1 node, 2x Intel® Xeon® 8592+, 64 cores, HT On, Turbo On, SNC2, 512GB DDR5-5600, BIOS 3B07.TEL2P1, ucode 0x21000200, Ubuntu 23.10, Kernel 6.5.0, App Version: HPCG from Intel_Optimized_MKL_v2022.1.0, Test by Intel as of March 2024. | HPCG | Test by Intel as of July 2024. |
| [9H10] Up to 6.1x higher HPCG performance with Intel® Xeon® 6980P vs. Intel® Xeon® 8280. Up to 2.3x higher HPCG performance with Intel® Xeon® 6980P vs. Intel® Xeon® 8592+. | Intel® Xeon® 6900-series with P-cores | Pre-production Intel® Xeon® 6 with P-cores: (GNR-AP 128c): 1-node, pre-production platform, 2x Intel® Xeon® 6 with P cores, 128 cores, HT On, Turbo On, Total Memory 1536GB (24x64GB MCR 8800) microcode 0x810001d0, Ubuntu 23.10, Test by Intel as of April 2024. 8592+: 1-node, 2x Intel® Xeon® PLATINUM 8592+, 64 cores, HT On, Turbo On, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), microcode 0x21000200, Ubuntu 23.10, Test by Intel as of April 2024. 8280: 1-node, 2x Intel® Xeon® Platinum 8280 CPU @ 2.70GHz, 28 cores, HT On, Turbo On, Total Memory 768GB (12x64GB DDR4 3200 MT/s [2933 MT/s]), microcode 0x4003605, Ubuntu 23.10, Test by Intel as of April 2024. Software: HPCG - HPCG from Intel_Optimized_MKL_v2022.1.0. cmkl:2022.1.0 icc:2022.1.0 impi:2021.6.0 | HPCG | Test by Intel as of April 2024 |
| [9H11] Up to 2.43x higher OpenFOAM performance and up to 1.7x higher OpenFOAM perf/watt with Intel® Xeon® 6980P [MRDIMM] vs. Intel® Xeon® 8592+ Up to 2.1x higher OpenFOAM performance with Intel® Xeon® 6980P [MRDIMM] vs. AMD EPYC 9654 | Intel® Xeon® 6900-series with P-cores | OpenFOAM (motorbike-20m, motorbike-42m) 6980P w/MRDIMM: 1 node, 2x Intel® Xeon® 6980P, HT On, Turbo On, SNC3, 1536 GB MRDIMM-8800, BIOS BHSDREL1.86B.0033.D40.2406180419, ucode=0x11000280, Ubuntu 24.04, Kernel 6.8.0, OpenFOAM v2312, Test by Intel as of July 2024. 8592+: 1 node, 2x Intel® Xeon® 8592+, HT On, Turbo On, SNC2, 512GB DDR5-5600, BIOS 3B07.TEL2P1, ucode 0x21000200, Ubuntu 23.10, Kernel 6.5.0, OpenFOAM v2312, Test by Intel as of March 2024. 9654: Test by Intel as of April 2024, 1 node, 2x AMD EPYC 9654, SMT On, Boost On, NPS4, 1536 GB DDR5-4800, BIOS 1.9, ucode 0xa101148, Ubuntu 24.04, Kernel 6.8.0, OpenFOAM v2312 This offering is not approved or endorsed by OpenCFD Limited, producer and distributor of the OpenFOAM software via www.openfoam.com, and owner of the OPENFOAM® and OpenCFD® trademark | OpenFoam | Test by Intel as of July 2024. |
| [9H201] Up to 2.26x higher NAMD (Life and Material Science) performance on Intel® Xeon® 6980P vs. 4th Gen AMD EPYC 9654. | Intel® Xeon® 6900-series with P-cores | Intel® Xeon® 6980P with MRDIMM : Test by Intel as of July 2024, 1 node, 2x Intel® Xeon® 6980P, HT On, Turbo On, SNC3, 1536 GB MRDIMM-8800, BIOS BHSDREL1.86B.0033.D40.2406180419, ucode=0x11000280, Ubuntu 24.04, Kernel 6.8.0, NAMD v2.15alpha AMD EPYC 9654: Test by Intel as of April 2024, 1 node, 2x AMD EPYC 9654, SMT On, Boost On, NPS4, 1536 GB DDR5-4800, BIOS 1.9, ucode 0xa101148, Ubuntu 24.04, Kernel 6.8.0, NAMD v2.15alpha | NAMD | Test by Intel as of July 2024 |
| [9N4] Up to 1.46x higher IOPS on Intel® Xeon® 6980P with Intel VROC (8 disk RAID0) vs. legacy architecture (HBA) 30% lower latency on Intel® Xeon® 6980P with Intel VROC (8 disk RAID0) vs. legacy architecture (HBA) Up to 1.49x higher IOPS/watt on Intel® Xeon® 6980P with Intel VROC (8 disk RAID0) vs. legacy architecture (HBA) | Intel® Xeon® 6900-series with P-cores | Platform: AvenueCity CRB; 2x Intel® Xeon® 6966P-C (QDF: SVR GNR AP CPU UCC B1 Q5EH) (72 cores each) (BirchStream - Granite Rapids AP); 768GB RAM (24 x 32GB Micron MTC20F1045S1RC64BDY 6400 MT/s DDR5 Synchronous Registered (Buffered) DIMMs); BIOS Version: BHSDREL1.IPC.3275.D01.2405242326 (Microcode revision: 0x11000240); BKC#104_AVC; BMC version: 24.21-0; CPLD version: 5V0A_V1 Workload not dependent on CPU core count. Similar results expected with a lower core count CPU. BIOS Settings: Fan PWM Offset [100]; Enable LP (Global) [ALL LPs]; CPU P State Control -> SpeedStep (Pstates) [Enable]; CPU P State Control -> Energy Efficient Turbo [Enable]; CPU P State Control -> Turbo Mode [Enable]; Hardware PM State Control -> Hardware P-States [Native Mode]; CPU C State Control -> C1 to C1e Promotion [Disable]; CPU C State Control -> ACPI C6x Enumeration [Disable]; Package C State Control -> Package C State [C0/C1]; CPU - Advanced PM Tuning -> Energy Perf BIAS -> Workload Configuration [I/O sensitive]; PCI Express 4 -> Intel VMD technology -> Intel VMD technology [Enable]; PCI Express 4 -> Ports A, C, E, G -> Intel VMD technology [Enable]; PCI Express 5 -> Intel VMD technology -> Intel VMD technology [Enable]; PCI Express 5 -> Ports A, C, E, G -> Intel VMD technology [Enable] Storage: VROC: 8 x 3.2TB Kioxia CM7-V PCIe Gen5 U.2 SSDs (Model: KCMYDVUG3T20, Firmware: 1UET7103) connected to backplane which is connected to CPU0 4A-D, 5A-D MCIO PCIe ports (NUMA Node 2, CPU 0); Trimode with Midplane switch: 8 x 3.2TB Kioxia CM7-V PCIe Gen5 U.2 SSDs (Model: KCMYDVUG3T20, Firmware: 1UET7103) connected to backplane which is connected, via a midplane switch to a Broadcom MegaRAID 9670W-16i RAID card to SLOT C (NUMA Node 0, CPU0); OS: On P1600X 58GB Intel NVMe M.2 SSD (Model: SSDPEK1F058GA, Firmware: U40AE022) connected to M.2 LOM slot RAID Controller: HBA: Model: MegaRAID 9670W-16i Tri-Mode Storage Adapter; Firmware Version = 8.9.1.0-00000-00002; mpi3mr driver version = 8.9.1.0.0; CLI Version = 008.0009.0000.0010 Apr 02, 2024; Added "scsi_mod.use_blk_mq=y" to grub boot option for maximum throughput on the Broadcom card; "When creating RAID volumes: Read Cache Policy <No Read Ahead>, Write Cache Policy <Write-Back>, Drive Write Cache Policy <Disable>; RAID volume initialized before starting measurements"; "Extra commands set for maximum performance on HBA: echo ""0"" > /sys/block/sda/queue/rotational; echo ""none"" > /sys/block/sda/queue/scheduler; echo ""4065"" > /sys/block/sda/queue/nr_requests; echo ""4065"" > /sys/block/sda/device/queue_depth; echo ""0"" > /sys/block/sda/queue/nomerges; echo ""0"" > /sys/block/sda/queue/add_random; echo ""2"" > /sys/block/sda/queue/rq_affinity" HBA: Model: MegaRAID 9560-16i 8GB; Firmware Package Build = 52.30.0-5604; Firmware Version = 5.300.02-4030; megaraid_sas driver version = 07.730.01.00; CLI Version = 007.3007.0000.0000 May 16, 2024; Added "scsi_mod.use_blk_mq=y" to grub boot option for maximum throughput on the Broadcom card; "When creating RAID volumes: Read Cache Policy <No Read Ahead>, Write Cache Policy <Write-Back>, Drive Write Cache Policy <Disable>; RAID volume initialized before starting measurements"; "Extra commands set for maximum performance on HBA: echo ""0"" > /sys/block/sda/queue/rotational; echo ""none"" > /sys/block/sda/queue/scheduler; echo ""4065"" > /sys/block/sda/queue/nr_requests; echo ""4065"" > /sys/block/sda/device/queue_depth; echo ""0"" > /sys/block/sda/queue/nomerges; echo ""0"" > /sys/block/sda/queue/add_random; echo ""2"" > /sys/block/sda/queue/rq_affinity" VROC: Intel(R) VROC PreOS Version: 9.0.0.1244; mdadm version = mdadm-4.3-20240620.intel.14055539.el9.x86_64 (commit hash: 29aa21d94bc7ff10); vmd driver version = inbox; Added "pci=pcie_bus_perf" to grub boot option which sets MaxPayload to the maximum for each of the NVMe devices; Interrupt Coalescing NVMe feature was configured with "0x103" value during measurement OS: Red Hat Enterprise Linux 9.4 GA; Kernel: 6.4.16-upstream RAID Configurations 8-Disk RAID0 with 4KB random 70/30 R/W workload using 16 Threads and 64 IODepth with Intel VROC and Broadcom MegaRAID 9670W-16i Tri-Mode Varying IOPS controlled by changing thread count and IODepth. Benchmark: FIO v3.35 | Virtual RAID | Test by Intel as of July 2024 |
| [9N5] Up to 16% higher Vector similarity search performance on Intel® Xeon® 69xx processor with CXL memory interleaving vs. DRAM only on vector search in Redis database | Intel® Xeon® 6900-series with P-cores | DRAM-only: 1-node, pre-production platform, 2x Intel® Xeon® 6 w/P-cores, 120 cores, 500W TDP, HT On, Turbo On, NUMA 4, Total Memory 1536GB (24x64GB DDR5 6400 MT/s [6400 MT/s]), BIOS BHSDCRB1.IPC.0033.D57.2406240014, microcode 0x81000290, 1x I210 Gigabit Network Connection, 1x 1.7T Micron_7450_MTFDKBG1T9TFR, 3x 1.7T KIOXIA KCDY1RUG1T92, CentOS Stream 9, 6.9.7. Software: vector-db-benchmark, Redis 7.2.0, Redisearch 2.8.11, GCC 11.4.1, score=202.875 responses per second. Test by Intel as of 08/22/24. DDR+CXL: 1-node, pre-production platform, 2x Intel® Xeon® 6 w/P-cores, 120 cores, 500W TDP, HT On, Turbo On, NUMA 4, Total Memory 1536GB [(24x64GB DDR5 6400 MT/s [6400 MT/s]) + 4x Astera Leo D5 Gen5 x16 CXL Memory Controller FW v1.2.0 w/ 2x 64GB DDR5 5600MT/s RDIMM per device], BIOS BHSDCRB1.IPC.0033.D57.2406240014, microcode 0x81000290, 1x I210 Gigabit Network Connection, 1x 1.7T Micron_7450_MTFDKBG1T9TFR, 3x 1.7T KIOXIA KCDY1RUG1T92, CentOS Stream 9, 6.9.7. Software: vector-db-benchmark, Redis 7.2.0, Redisearch 2.8.11, GCC 11.4.1, numactl 2.0.18, score=234.866 responses per second. Test by Intel as of 08/22/24. | Vector Search with CXL | Test by Intel as of 08/22/24. |
| [9S1] When using Intel® SGX on Intel® Xeon® 69xx series, less than 10% performance overhead observed on PyTorch ResNet-50 with Graphene vs. no SGX | Intel® Xeon® 6900-series with P-cores | 1-node, 2x Intel® Xeon® 6 Pre-production 120c Processor on AvenueCity with 1.5 TB (24 slots/ 64GB/ 6400) total DDR5 memory, ucode x2d0, HT on, Turbo on, CentOS Stream 9, 6.6.0-gnr.bkc.6.6.26.5.40.x86_64, PyTorch -intel-extension-for-pytorch 2.4.0+git2731521 (RN50), GCC 8.5.0, OneDNN, Gramine - Master branch (610830d8e27c81f036f3f401ec7eb3cde7de0966), test by Intel on 8/10/2024. | ResNet-50 and Intel® TDX | Test by Intel as of 08/10/24. |
| [9T1] Up to 1.9x higher performance per watt with Intel Xeon 6980P processor vs. prior generation 8592+ at a typical 40% server utilization point | Intel® Xeon® 6900-series with P-cores | Pre-production Intel Xeon 6 with P-cores: 1-node, 2x Intel® Xeon® 6980P, 128 cores, HT On, Turbo On, NUMA 6, Total Memory 1536GB (24x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS BHSDCRB1.IPC.0033.D57.2406240014, microcode 0x81000290, 1x I210 Gigabit Network Connection, 1x 894.3G Micron_7450_MTFDKBG960TFR, CentOS Stream 9, 6.6.0-gnr.bkc.6.6.26.5.40.x86_64, Test by Intel as of 08/07/24 8592+: 1-node, 2x Intel® Xeon® PLATINUM 8592+, 64 cores, HT On, Turbo On, NUMA 4, Integrated Accelerators Available [used]: DLB 2 [0], DSA 2 [0], IAA 2 [0], QAT 2 [0], Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS EGSDCRB1.SYS.0111.D23.2405061937, microcode 0x21000283, 2x Ethernet Controller I225-LM, 1x 447.1G SAMSUNG MZ7LH480HAHQ-00005, CentOS Stream 9, 6.2.0-emr.bkc.6.2.19.2.52.x86_64. Test by Intel as of 08/07/24 Package power = measured 2 socket power during workload execution Software Config: Power Efficiency workload, OpenJDK11.28 | Energy Efficiency Server Load Line | Test by Intel as of 08/07/24 |
| [9T2] 30% lower average TCO for similar performance levels vs. 5th Gen Intel Xeon | Intel® Xeon® 6900-series with P-cores | This is based on a geomean average of TCO savings for scenarios running NGINX TLS, MongoDB, OpenFOAM, and ResNet50 workloads. See [9T3] ,[9T4], [9T5], [9T6]. | Average TCO Savings of ResNet50,NGINX TLS, MongoDB, OpenFOAM | Test by Intel between July to August 2024 |
| [9T3] Intel® Xeon® 6 with P-cores delivers up to 20% lower total cost of ownership (TCO) than Intel® Xeon® 8592+ based servers running a ResNet50 workload | Intel® Xeon® 6900-series with P-cores | Use 10 racks (80 servers) of Intel® Xeon® 6980P based servers instead of 10 racks (150 servers) of 8592+ based servers running ResNet50 and save 173 MWh of energy, reduce carbon footprint by 73 metric tons CO2, and save $1791K in total cost of ownership over 4-years. Intel Xeon 6980P delivers 1.83x higher performance and same performance/watt per server vs Intel Xeon 8592+ on ResNet50. ResNet50 6980P w/MRDIMM: 1-node, pre-production platform, 2x Intel(R) 6980P, 128 cores, 500W TDP, HT On, Turbo On, NUMA 6, Total Memory 1536GB (24x64GB MRDIMM 8800MT/s [8800 MT/s]), BIOS BHSDCRB1.IPC.0033.D57.2406240014, microcode 0x11000290, 2x Ethernet Controller X550, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 24.04 LTS, 6.8.0-31-generic. Test by Intel as of 08/20/24. 8592+: 1-node, 2x Intel® Xeon® PLATINUM 8592+, 64 cores, 350W TDP, HT On, Turbo On, NUMA 2, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 3B07.TEL2P1, microcode 0x21000230, 2x Ethernet Controller X710 for 10GBASE-T, 1x Ethernet interface, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 24.04 LTS, 6.8.0-31-generic. Test by Intel as of 08/05/24. Software: ResNet50 PT: ResNet50 v1.5, Inference: int8, bs=1 (sla=15ms), bs=x, Dataset: ImageNet, Framework: PyTorch:2.4.0, IPEX: 2.4.0, OneDNN: v3.4.2, Modelzoo: https://github.com/intel/ai-reference-models Assumptions: 1x 42U, 15KW Rack, supporting 20x 2U rack servers, 1x TOR switch, 1.6 PUE, kWh to kg CO2 factor 0.42394. For 10 racks of Intel Xeon 8592+ based servers over 4-years, estimated as of Sep 2024: CapEx costs: $6143k, OpEx costs (4 year, includes power and cooling utility costs, infrastructure and hardware maintenance costs): $2629k, Energy use: 8300MWh, CO2 emissions: 3519 metric tons. For 10 rack of Intel Xeon 6980P based servers over 4-years, estimated as of Sep 2024: CapEx costs: $5098k, OpEx costs (4 year, includes power and cooling utility costs, infrastructure and hardware maintenance costs): $1883k: Energy use: 8127MWh, CO2 emissions: 3445 metric tons. Costs based on Intel estimates and information from thinkmate.com as of Sep 2024. | TCO savings on ResNet50 | Test by Intel as of 08/20/24. |
| [9T4] Intel® Xeon® 6 with P-cores delivers up to 38% lower total cost of ownership (TCO) than Intel® Xeon® 8592+ based servers running a NGINX TLS (1S) workload | Intel® Xeon® 6900-series with P-cores | Use 10 racks (140 servers) of Intel® Xeon® 6980P based servers instead of 18 racks (324 servers) of 8592+ based servers running NGINX TLS (1S) and save 6691 MWh of energy, reduce carbon footprint by 2837 metric tons CO2, and save $7246K in total cost of ownership over 4-years. Intel Xeon 6980P delivers 2.31x higher performance and 1.83x higher performance/watt per server vs Intel Xeon 8592+ on NGINX TLS (1S). NGINX TLS (1S) 6980P w/DDR: 1-node, pre-production platform, 2x Intel(R) 6980P, 128 cores, HT On, Turbo Off, Integrated Total Memory 1536GB (24x64GB DDR5 6400 MT/s [6400 MT/s]), BIOS BHSDCRB1.IPC.0033.D57.2406240014, microcode 0x11000290, 2x Ethernet Controller 10-Gigabit X540-AT2, 2x Ethernet Controller E810-C for QSFP, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.4 LTS, 6.5.0-21-generic, Test by Intel as of 07/25/24. 8592+ w/DDR: 1-node, 2x Intel® Xeon® PLATINUM 8592+, 64 cores, HT On, Turbo Off, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 3B07.TEL2P1, microcode 0x21000200, 2x Ethernet Controller 10-Gigabit X540-AT2,2x Ethernet Connection X722 for 10GBASE-T, 1x 1.7T SAMSUNG MZWLR1T9HBJR-00007, Ubuntu 22.04.4 LTS, 6.5.0-25-generic, Test by Intel as of Aug-2024. Software: OOB : NGINX Async v0.5.1, OpenSSL 3.1.3 , IPP Crypto 2021.8, IPsec MB v 1.4 QAT sw: NGINX Async v0.5.1, OpenSSL 3.1.3,IPP Crypto 2021.8,IPsec MB v 1.4 , QAT driver: QAT _Engine v 1.6.1,QAT20.L.1.2.30-00020 Assumptions: 1x 42U, 15KW Rack, supporting 20x 2U rack servers, 1x TOR switch, 1.6 PUE, kWh to kg CO2 factor 0.42394. For 18 racks of Intel Xeon 8592+ based servers over 4-years, estimated as of Sep 2024: CapEx costs: $13493k, OpEx costs (4 year, includes power and cooling utility costs, infrastructure and hardware maintenance costs): $5262k, Energy use: 14713MWh, CO2 emissions: 6238 metric tons. For 10 rack of Intel Xeon 6980P based servers over 4-years, estimated as of Sep 2024: CapEx costs: $9019k, OpEx costs (4 year, includes power and cooling utility costs, infrastructure and hardware maintenance costs): $2490k: Energy use: 8022MWh, CO2 emissions: 3401 metric tons. Costs based on Intel estimates and information from thinkmate.com as of Sep 2024. | TCO savings on NGINX TLS | Test by Intel as of 07/25/24. |
| [9T5] Intel® Xeon® 6 with P-cores delivers up to 29% lower total cost of ownership (TCO) than Intel® Xeon® 8592+ based servers running a MongoDB (1S) workload | Intel® Xeon® 6900-series with P-cores | Use 10 racks (110 servers) of Intel® Xeon® 6980P based servers running MongoDB (1S) instead of 12 racks (228 servers) of 8592+ based servers and save 2030 MWh of energy, reduce carbon footprint by 861 metric tons CO2, and save $3892K in total cost of ownership over 4-years. Intel Xeon 6980P delivers 2.05x higher performance and 1.25x higher performance/watt per server vs Intel Xeon 8592+ on MongoDB (1S). MongoDB (1S) 6980P: 1-node pre-production platform, 2x (1x used) Intel® Xeon® 6980P, 128 cores, HT On, Turbo On, NUMA 6, Total Memory 1536GB (24x64GB DDR5 6400 MT/s [6400 MT/s]), BIOS BHSDCRB1.IPC.0033.D57.2406240014, microcode 0x11000290, 2x Ethernet Controller 10-Gigabit X540-AT2, 2x Ethernet Controller E810-C for QSFP, 4x 3.5T KIOXIA KCD8XPUG3T84, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.1 LTS, 6.5.0-21-generic. Test by Intel as of 07/17/24. 8592+: 1-node, 2x (1x used) Intel® Xeon® PLATINUM 8592+, 64 cores, HT On, Turbo On, NUMA 4, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 2.0, microcode 0x21000230, 1x Ethernet Controller E810-C for QSFP, 1x Ethernet interface, 2x Ethernet Controller X710 for 10GBASE-T, 1x 1.7T SAMSUNG MZ1L21T9HCLS-00A07, 4x 3.5T KIOXIA KCD8XPUG3T84, Ubuntu 22.04.4 LTS, 6.5.0-21-generic. Test by Intel as of 07/16/24. Software: MongoDB 6.0.4, YCSB, multi-instance, read/update 90/10. Assumptions: 1x 42U, 15KW Rack, supporting 20x 2U rack servers, 1x TOR switch, 1.6 PUE, kWh to kg CO2 factor 0.42394. For 12 racks of Intel Xeon 8592+ based servers over 4-years, estimated as of Sep 2024: CapEx costs: $9495k, OpEx costs (4 year, includes power and cooling utility costs, infrastructure and hardware maintenance costs): $3628k, Energy use: 9779MWh, CO2 emissions: 4146 metric tons. For 10 rack of Intel Xeon 6980P based servers over 4-years, estimated as of Sep 2024: CapEx costs: $7087k, OpEx costs (4 year, includes power and cooling utility costs, infrastructure and hardware maintenance costs): $2144k: Energy use: 7749MWh, CO2 emissions: 3285 metric tons. Costs based on Intel estimates and information from thinkmate.com as of Sep 2024. | TCO savings on MongoDB | Test by Intel as of 07/17/24. |
| [9T6] Intel® Xeon® 6 with P-cores delivers up to 39% lower total cost of ownership (TCO) than Intel® Xeon® 8592+ based servers running a OpenFOAM (Geomean of 2) workload. | Intel® Xeon® 6900-series with P-cores | Use 10 racks (80 servers) of Intel® Xeon® 6980P based servers instead of 14 racks (196 servers) of 8592+ based servers running OpenFOAM (Geomean of 2) and save 3464 MWh of energy, reduce carbon footprint by 1469 metric tons CO2, and save $4578K in total cost of ownership over 4-years. Intel Xeon 6980P delivers 2.43x higher performance and 1.42x higher performance/watt per server vs Intel Xeon 8592+ on OpenFOAM (Geomean of 2). OpenFOAM (motorbike-20m, motorbike-42m) 6980P w/MRDIMM: Test by Intel as of July 2024, 1 node, 2x Intel Xeon 6980P, HT On, Turbo On, SNC3, 1536 GB MRDIMM-8800, BIOS BHSDREL1.86B.0033.D40.2406180419, ucode=0x11000280, Ubuntu 24.04, Kernel 6.8.0, OpenFOAM v2312 8592+: Test by Intel as of March 2024, 1 node, 2x Intel Xeon 8592+, HT On, Turbo On, SNC2, 512GB DDR5-5600, BIOS 3B07.TEL2P1, ucode 0x21000200, Ubuntu 23.10, Kernel 6.5.0, OpenFOAM v2312 Assumptions: 1x 42U, 15KW Rack, supporting 20x 2U rack servers, 1x TOR switch, 1.6 PUE, kWh to kg CO2 factor 0.42394. For 14 racks of Intel Xeon 8592+ based servers over 4-years, estimated as of Sep 2024: CapEx costs: $8027k, OpEx costs (4 year, includes power and cooling utility costs, infrastructure and hardware maintenance costs): $3526k, Energy use: 11538MWh, CO2 emissions: 4891 metric tons. For 10 rack of Intel Xeon 6980P based servers over 4-years, estimated as of Sep 2024: CapEx costs: $5098k, OpEx costs (4 year, includes power and cooling utility costs, infrastructure and hardware maintenance costs): $1876k: Energy use: 8073MWh, CO2 emissions: 3423 metric tons. Costs based on Intel estimates and information from thinkmate.com as of Sep 2024. This offering is not approved or endorsed by OpenCFD Limited, producer and distributor of the OpenFOAM software via www.openfoam.com, and owner of the OPENFOAM® and OpenCFD® trademark | TCO savings on OpenFOAM | Test by Intel as of July 2024 |
| [9W1] Up to 1.8x higher Java Throughput with Intel Xeon 6980P processor vs. Intel® Xeon® 8592+ Up to 1.8x higher Java Throughput within a given SLA with Intel Xeon 6980P processor vs. Intel® Xeon® 8592+ Up to 6.1x higher Java Throughput with Intel Xeon 6980P processor vs. Intel® Xeon® 8280 Up to 5.7x higher Java Throughput within a given SLA with Intel Xeon 6980P processor vs. Intel® Xeon® 8280 Up to 1.32x higher Java Throughput with the new Intel Xeon 6980P [MRDIMM] vs. AMD EPYC 9654 Up to 1.24x higher Java Throughput with the new Intel Xeon 6980P [MRDIMM] vs. AMD EPYC 9754 Up to 1.42x higher Java Throughput within a given SLA with the new Intel Xeon 6980P [MRDIMM] vs. AMD EPYC 9654 Up to 1.27x higher Java Throughput within a given SLA with the new Intel Xeon 6980P [MRDIMM] vs. AMD EPYC 9754 Up to 1.5x higher Java Throughput with Intel Xeon 6972P processor vs. Intel® Xeon® 8592+ Up to 1.56x higher Java Throughput within a given SLA with Intel Xeon 6972P processor vs. Intel® Xeon® 8592+ Up to 5.37x higher Java Throughput with Intel Xeon 6972P processor vs. Intel® Xeon® 8280 Up to 4.86x higher Java Throughput within a given SLA with Intel Xeon 6972P processor vs. Intel® Xeon® 8280 | Intel® Xeon® 6900-series with P-cores | 6980P w/MRDIMM: Pre-production Intel Xeon 6 with P-cores: 1-node, 2x Genuine Intel(R) 6980P, 128 cores, HT On, Turbo On, Total Memory 1536GB (24x64GB MRDIMM 8800 MT/s [8800 MT/s]), BIOS BHSDCRB1.IPC.0033.D57.2406240014, microcode 0x81000290, 2x Ethernet Controller X550, 3x 1.7T KIOXIA KCD81PUG1T92, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, 1x 1.7T KIOXIA KCD8XPUG1T92, CentOS Stream 9, 5.14.0-467.el9.x86_64. Test by Intel as of 07/09/24. 6980P w/DDR: Pre-production Intel Xeon 6 with P-cores: 1-node, 2x Genuine Intel(R) 6980P, 128 cores, HT On, Total Memory 1536GB (24x64GB DDR5 6400 MT/s [6400 MT/s]), BIOS BHSDCRB1.IPC.0033.D57.2406240014, microcode 0x81000290, 2x Ethernet Controller 10-Gigabit X540-AT2, 1x 1.7T SAMSUNG MZWLJ1T9HBJR-00007, CentOS Stream 9, 5.14.0-467.el9.x86_64. Test by Intel as of 07/10/24. 6972P w/DDR: Pre-production Intel Xeon 6 with P-cores: 1-node, 2x Intel® Xeon® 6972P, 96 cores, HT On, Turbo On, Total Memory 1536GB (24x64GB DDR5 6400 MT/s [6400 MT/s]), BIOS BHSDCRB1.IPC.0033.D57.2406240014, microcode 0x11000290, 2x Ethernet Controller 10-Gigabit X540-AT2, 1x 1.7T SAMSUNG MZWLJ1T9HBJR-00007, CentOS Stream 9, 5.14.0-467.el9.x86_64. Test by Intel as of 07/16/24. 8592+: 1-node, 2x Intel® Xeon® PLATINUM 8592+, 64 cores, HT On, Turbo On, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 3B07.TEL2P1, microcode 0x21000200, 2x Ethernet Controller 10-Gigabit X540-AT2, 1x 1.7T SAMSUNG MZWLJ1T9HBJR-00007, Ubuntu 22.04.4 LTS, 6.5.0-26-generic, Test by Intel as of 04/05/24. 8280: 1-node, 2x Intel® Xeon® Platinum 8280M CPU @ 2.70GHz, 28 cores, HT On, Turbo On, Total Memory 768GB (12x64GB DDR4 3200 MT/s [2934 MT/s]), BIOS SE5C620.86B.02.01.0017.110620230543, microcode 0x4003605, 2x Ethernet Controller X710 for 10GBASE-T, 2x Ethernet Connection X722 for 10GBASE-T, 1x 1.7T SAMSUNG MZWLJ1T9HBJR-00007, Ubuntu 22.04.4 LTS, 6.5.0-25-generic, Test by Intel as of 04/11/24. AMD EPYC 9654: 1-node, 2x AMD EPYC 9654 96-Core Processor, 96 cores, 360W TDP, SMT On, Boost On, 1-node, NPS 4 LLC as NUMA on, Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 1.6, microcode 0xa101144, 2x Ethernet Controller X550, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, CentOS Stream 9, 5.14.0-467.el9.x86_64. Test by Intel as of 07/07/24. AMD EPYC 9754: 1-node, 2x AMD EPYC 9754 128-Core Processor, 128 cores, 360W TDP, SMT On, Boost On, NPS 4 LLC as NUMA on, Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 1.6, microcode 0xaa00213, 2x Ethernet Controller X550, 1x 1.7T SAMSUNG MZWLJ1T9HBJR-00007, CentOS Stream 9, 5.14.0-467.el9.x86_64. Test by Intel as of 07/07/24. Software : Server-side-java workload, JDK 21 Software : JDK 21 | Server-side Java | Test by Intel as of 07/09/24. |
| [9W2] Up to 2x higher NGINX performance with the new Intel® Xeon® 6980P vs. Intel® Xeon® 8592+ Up to 7x higher NGINX performance with the new Intel® Xeon® 6980P vs. Intel® Xeon® 8280 Up to 1.84x higher NGINX performance with the new Intel® Xeon® 6972P vs. Intel® Xeon® 8592+ Up to 6.4x higher NGINX performance with the new Intel® Xeon® 6972P vs. Intel® Xeon® 8280 | Intel® Xeon® 6900-series with P-cores | Pre-production Intel Xeon 6 with P-cores: 1-node, 2x Genuine Intel(R) 6980P, 128 cores, HT On, Turbo Off, Integrated Total Memory 1536GB (24x64GB DDR5 6400 MT/s [6400 MT/s]), BIOS BHSDCRB1.IPC.0033.D57.2406240014, microcode 0x11000290, 2x Ethernet Controller 10-Gigabit X540-AT2, 2x Ethernet Controller E810-C for QSFP, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.4 LTS, 6.5.0-21-generic, Test by Intel as of 07/25/24. Pre-production Intel Xeon 6 with P-cores: 1-node, 2x Intel® Xeon® 6972P, 96 cores, HT On, Turbo Off, Total Memory 1536GB (24x64GB DDR5 6400 MT/s [6400 MT/s]), BIOS BHSDCRB1.IPC.0033.D57.2406240014, microcode 0x11000290, 2x Ethernet Controller X710 for 10GBASE-T, 2x Ethernet Controller 10-Gigabit X540-AT2, 2x Ethernet Controller E810-C for QSFP, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.4 LTS, 6.5.0-26-generic, Test by Intel as of 07/23/24 8592+: 1-node, 2x Intel® Xeon® PLATINUM 8592+, 64 cores, HT On, Turbo Off, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 3B07.TEL2P1, microcode 0x21000200, 2x Ethernet Controller 10-Gigabit X540-AT2,2x Ethernet Connection X722 for 10GBASE-T, 1x 1.7T SAMSUNG MZWLR1T9HBJR-00007, Ubuntu 22.04.4 LTS, 6.5.0-25-generic, Test by Intel as of Aug-2024. 8280: 1-node, 2x Intel® Xeon® Platinum 8280M CPU @ 2.70GHz, 28 cores, HT On, Total Memory 768GB (12x64GB DDR4 3200 MT/s [2934 MT/s]), BIOS SE5C620.86B.02.01.0017.110620230543, microcode 0x4003605, 2x Ethernet Controller E810-C for QSFP, 2x Ethernet Connection X722 for 10GBASE-T, 1x 1.7T SAMSUNG MZWLR1T9HBJR-00007, Ubuntu 22.04.4 LTS, 6.5.0-25-generic,Test by Intel as of Aug-2024. Software Config: NGINX,NGINX Async v0.5.1, OpenSSL 3.1.3,IPP Crypto 2021.8,IPsec MB v 1.4 | NGINX | Test by Intel as of 07/25/24. |
| [9W3] Up to 1.66x higher throughput performance on SVT-AV1 Media Transcode with Intel® Xeon® 6980P vs. Intel Xeon Platinum 8592+ Up to 1.89x higher throughput performance on SVT-HEVC Media Transcode with Intel® Xeon® 6980P vs. Intel Xeon Platinum 8592+ Up to 2.14x higher throughput performance on AVC Media Transcode with Intel® Xeon® 6980P vs. Intel Xeon Platinum 8592+ Up to 2.19x higher throughput performance on x265 Media Transcode with Intel® Xeon® 6980P vs. Intel Xeon Platinum 8592+ Up to 1.30x higher throughput performance on SVT-HEVC Media Transcode with the new Intel Xeon 6980P [MRDIMM] vs. AMD EPYC 9654 Up to 1.08x higher throughput performance on SVT-HEVC Media Transcode with the new Intel Xeon 6980P [MRDIMM] vs. AMD EPYC 9754 | Intel® Xeon® 6900-series with P-cores | 6980P [MRDIMM]: Pre-production Intel Xeon 6 with P-cores: 1-node, 2x Intel® Xeon® 6980P, 128 cores, HT On, Turbo On, NUMA 6, Total Memory 1536GB (24x64GB MRDIMM 8800MT/s [8800 MT/s]), BIOS BHSDCRB1.IPC.0033.D57.2406240014, microcode 0x81000290, 1x I210 Gigabit Network Connection, 1x 894.3G Micron_7450_MTFDKBG960TFR, Ubuntu 24.04 LTS, 6.8.0-39-generic. Test by Intel as of 07/25/24. 6980P [DDR]: Pre-production Intel Xeon 6 with P-cores: 1-node, 2x Intel® Xeon® 6980P, 128 cores, HT On, Turbo On, NUMA 6, Total Memory 1536GB (24x64GB DDR5 6400 MT/s [6400 MT/s]), BIOS BHSDCRB1.IPC.0033.D57.2406240014, microcode 0x81000290, 1x I210 Gigabit Network Connection, 1x 894.3G Micron_7450_MTFDKBG960TFR, Ubuntu 24.04 LTS, 6.8.0-39-generic. Test by Intel as of 07/29/24. AMD Epyc 9754: 1-node, 2x AMD EPYC 9754 128-Core Processor, 128 cores, SMT On, Boost On, Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 1.4, microcode 0xaa00212, 2x Ethernet Controller 10G X550T, 1x 3.5T INTEL SSDPF2KX038TZ, Ubuntu 22.04.4 LTS, 6.5.0-25-generic, Test by Intel as of 04/24/24. AMD Epyc 9654: 1-node, 2x AMD EPYC 9654 96-Core Processor, 96 cores, SMT On, Boost On, Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 1.6, microcode 0xa10113e, 2x Ethernet Controller 10G X550T, 1x 1.7T SAMSUNG MZWLJ1T9HBJR-00007, Ubuntu 22.04.4 LTS, 6.5.0-26-generic, Test by Intel as of 04/22/24. Software Config: Version:release/6.0,SVT_AV1_VER:v1.5.0,LIBX264_VER:baee400fa9ced6f5481a728138fed6e867b0ff7f,LIBX265_VER:Release_3.5,SSVT_HEVC_VER:6cca5b932623d3a1953b165ae6b093ca1325ac44 | Media Transcode (SVT-AVI, SVT-HEVC, AVC, x265) | Test by Intel as of 07/25/24. |
| [9W4] Up to 2.15x higher Clickhouse Database performance and 1.5x perf/watt with the new Intel® Xeon® 6972P [DDR] vs. Intel® Xeon® 8592+ | Intel® Xeon® 6900-series with P-cores | 6972P: 1-node pre-production platform, 2x Intel® Xeon® 6972P, 96 cores, 500W TDP, HT On, Turbo On, NUMA 2, Total Memory 1536GB (24x64GB DDR5 6400 MT/s [6400 MT/s]), BIOS BHSDCRB1.IPC.0033.D57.2406240014, microcode 0x11000290, 2x Ethernet Controller 10-Gigabit X540-AT2, 2x Ethernet Controller E810-C for QSFP, 1x 1.7T Micron_7400_MTFDKCC1T9TDZ, Ubuntu 22.04.4 LTS, 6.5.0-21-generic. Test by Intel as of 08/15/24. 8592+: 1-node, 2x Intel® Xeon® PLATINUM 8592+, 64 cores, HT On, Turbo On, NUMA 2, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 3B08.TEL3P1, microcode 0x21000240, 2x Ethernet Controller 10-Gigabit X540-AT2, 2x Ethernet Controller E810-C for QSFP, 1x Ethernet interface, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.4 LTS, 6.5.0-21-generic. Test by Intel as of 08/15/24. Software : Star Schema Benchmark, ClickHouse, Clang 18, v24.7.3.42-stable, lz4. Geomean of Q1.1, Q2.1, Q2.2, Q2.3, Q3.1, Q3.2, Q3.3, Q4.1, Q4.2, Q4.3, multi-instance | Up to 2.15x higher Clickhouse Database performance and 1.5x perf/watt with the new Intel® Xeon® 6972P [DDR] vs. Intel® Xeon® 8592+ | Test by Intel as of 08/15/24. |
| [9W5] Up to 2.1x higher WordPress performance with Intel Xeon 6980P [DDR] processor vs. prior generation 8592+ Up to 6x higher WordPress performance with Intel Xeon 6980P [DDR] processor vs. prior generation 8280 Up to 1.37x higher WordPress performance with the new Intel Xeon 6980P [DDR] vs. AMD EPYC 9654 Up to 1.15x higher WordPress performance with the new Intel Xeon 6980P [DDR] vs. AMD EPYC 9754 | Intel® Xeon® 6900-series with P-cores | 6980P [DDR]: Pre-production Intel Xeon 6 with P-cores: 1-node, 2x (1x used) Intel® Xeon® 6980P, 128 cores, HT On, Turbo On, NUMA 6, Total Memory 1536GB (24x64GB DDR5 6400 MT/s [6400 MT/s]), BIOS BHSDCRB1.IPC.0033.D57.2406240014, microcode 0x11000290, 2x Ethernet Controller 10-Gigabit X540-AT2, 2x Ethernet Controller E810-C for QSFP, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.4 LTS, 6.5.0-21-generic. Test by Intel as of 08/22/24. 8592+: 1-node, 2x (1x used) Intel® Xeon® PLATINUM 8592+, 64 cores, HT On, Turbo On, NUMA 4, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 3B08.TEL3P1, microcode 0x21000240, 2x Ethernet Controller 10-Gigabit X540-AT2, 2x Ethernet Controller E810-C for QSFP, 1x Ethernet interface, 1x 0B Virtual HDisk1, 1x 1024M Virtual CDROM1, 1x 1.7T Micron_7450_MTFDKCC1T9TFR, 1x 1024M Virtual CDROM3, 1x 0B Virtual HDisk0, 1x 0B Virtual HDisk2, 1x 0B Virtual HDisk3, 1x 1024M Virtual CDROM0, 1x 1024M Virtual CDROM2, Ubuntu 22.04.4 LTS, 6.5.0-21-generic. Test by Intel as of 08/22/24. 8280: 1-node, 2x (1x used) Intel® Xeon® Platinum 8280L CPU @ 2.70GHz, 28 cores, HT On, Turbo On, NUMA 4, Total Memory 768GB (12x64GB DDR4 3200 MT/s [2934 MT/s]), BIOS SE5C620.86B.02.01.0017.110620230543, microcode 0x5003605, 2x Ethernet Controller E810-C for QSFP, 2x Ethernet Connection X722 for 10GBASE-T, 1x 3.5T SAMSUNG MZ7LH3T8, Ubuntu 22.04.4 LTS, 6.5.0-21-generic. Test by Intel as of 08/21/24. AMD EPYC 9654:1-node, 2x (1x used) AMD EPYC 9654 96-Core Processor, 96 cores, SMT On, Boost On, NUMA 4, Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 1.6, microcode 0xa10113e, 2x Ethernet Controller E810-C for QSFP, 2x Ethernet Controller 10G X550T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.4 LTS, 6.5.0-21-generic. Test by Intel as of 08/21/24. AMD EPYC 9754:1-node, 2x (1x used) AMD EPYC 9754 128-Core Processor, 128 cores, SMT On, Boost On, NUMA 4, Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 1.6, microcode 0xaa00212, 2x Ethernet Controller 10G X550T, 2x Ethernet Controller E810-C for QSFP, 1x 1.7T SAMSUNG MZWLR1T9HBJR-00007, Ubuntu 22.04.4 LTS, 6.5.0-21-generic. Test by Intel as of 08/21/24. Software Config: WordPress 6.5, Siege 4.1.5, PHP 8.1, MariaDB 11.4.2, NGINX 1.22, OpenSSL 3.1.4, Workload Pinned to Socket 0, 8 vCPU per Instance x & instances. | WordPress | Test by Intel as of 08/22/24. |
| [9W8] Up to 3.25x higher NGINX TLS throughput performance with the new Intel Xeon 6980P [MRDIMM] vs. AMD EPYC 9654 Up to 3.21x higher NGINX TLS throughput performance with the new Intel Xeon 6980P [MRDIMM] vs. AMD EPYC 9754 | Intel® Xeon® 6900-series with P-cores | 6980P: 1-node, pre-production platform, 2x (1x used) Intel(R) 6980P, 128 cores, HT On, Turbo Off, Integrated Total Memory 1536GB (24x64GB DDR5 6400 MT/s [6400 MT/s]), BIOS BHSDCRB1.IPC.0033.D57.2406240014, microcode 0x11000290, 2x Ethernet Controller 10-Gigabit X540-AT2, 2x Ethernet Controller E810-C for QSFP, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.4 LTS, 6.5.0-21-generic, Test by Intel as of 07/25/24. AMD EPYC 9654: 1-node, 2x (1x used) AMD EPYC 9654, 96 cores, SMT On, Boost Off, NPS 1, Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 1.6, microcode 0xa10113e, 2x Ethernet Controller 10G X550T, 2x Ethernet Controller E810-C for QSFP, 1x 3.5T SAMSUNG MZWLJ3T8HBLS-00007, Ubuntu 22.04.4 LTS, 6.5.0-26-generic, Test by Intel as of July 2024. AMD EPYC 9754: 1-node, 2x (1x used) AMD EPYC 9754, 128 cores, SMT On, Boost Off, NPS 1, Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 1.6, microcode 0xaa00212, 2x Ethernet Controller 10G X550T, 2x Ethernet Controller E810-C for QSFP, 1x 3.5T SAMSUNG MZWLJ3T8HBLS-00007, Ubuntu 22.04.4 LTS, 6.5.0-26-generic, Test by Intel as of July 2024. Software: NGINX,NGINX Async v0.5.1, OpenSSL 3.1.3, Intel=QAT driver: QAT _Engine v 1.6.1,QAT20.L.1.2.30-00020, AMD=OOB, IPP Crypto 2021.8,IPsec MB v 1.4, | NGINX TLS | Test by Intel as of 07/25/24. |
| [9T7] Intel® Xeon® 6 with P-cores delivers up to 49% lower total cost of ownership (TCO) than AMD EPYC 9654 based servers running a NGINX TLS (1S) workload. | Intel Xeon 6900-series with P-cores | Intel® Xeon® 6 with P-cores delivers up to 49% lower total cost of ownership (TCO) than AMD EPYC 9654 based servers running a NGINX TLS (1S) workload. Use 10 racks (140 servers) of Intel® Xeon® 6972P based servers running NGINX (1S) instead of 21 racks (420 servers) of AMD EPYC 9654 based servers and save 8130 MWh of energy, reduce carbon footprint by 3447 metric tons CO2, and save $9960K in total cost of ownership over 4-years. Intel Xeon 6972P delivers 3.04x higher performance and 2.06x higher performance/watt per server vs Intel Xeon AMD EPYC 9654 on NGINX TLS (1S). 6972P: 1-node, pre-production platform, 2x (1x used) Intel(R) 6972P, 96 cores, HT On, Turbo Off, Integrated Total Memory 1536GB (24x64GB DDR5 6400 MT/s [6400 MT/s]), BIOS BHSDCRB1.IPC.0033.D57.2406240014, microcode 0x11000290, 2x Ethernet Controller 10-Gigabit X540-AT2, 2x Ethernet Controller E810-C for QSFP, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.4 LTS, 6.5.0-21-generic, Test by Intel as of 07/25/24. AMD EPYC 9654: 1-node, 2x (1x used) AMD EPYC 9654, 96 cores, SMT On, Boost Off, Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 1.6, microcode 0xa10113e, 2x Ethernet Controller 10G X550T, 2x Ethernet Controller E810-C for QSFP, 1x 3.5T SAMSUNG MZWLJ3T8HBLS-00007, Ubuntu 22.04.4 LTS, 6.5.0-26-generic, Test by Intel as of July 2024. Software: NGINX,NGINX Async v0.5.1, OpenSSL 3.1.3, Intel=QAT driver: QAT _Engine v 1.6.1,QAT20.L.1.2.30-00020, AMD=OOB, IPP Crypto 2021.8,IPsec MB v 1.4, Assumptions: 1x 42U, 15KW Rack, supporting 20x 2U rack servers, 1x TOR switch, 1.6 PUE, kWh to kg CO2 factor 0.42394. For 21 racks of AMD EPYC 9654 based servers over 4-years, estimated as of Sep 2024: CapEx costs: $13863k, OpEx costs (4 year, includes power and cooling utility costs, infrastructure and hardware maintenance costs): $6420k, Energy use: 15988MWh, CO2 emissions: 6778 metric tons. For 10 rack of Intel Xeon 6972P based servers over 4-years, estimated as of Sep 2024: CapEx costs: $7854k, OpEx costs (4 year, includes power and cooling utility costs, infrastructure and hardware maintenance costs): $2468k: Energy use: 7857MWh, CO2 emissions: 3331 metric tons. Costs based on Intel estimates and information from thinkmate.com as of Sep 2024. Results may vary. | TCO Savings on NGINX TLS | Test by Intel as of July 2024 |
| [9T8] Intel® Xeon® 6 with P-cores delivers up to 25% lower total cost of ownership (TCO) than AMD EPYC 9654 based servers running a MongoDB (1S) workload. | Intel Xeon 6900-series with P-cores | Use 10 racks (110 servers) of Intel® Xeon® 6972P based servers running MongoDB (1S) instead of 12 racks (228 servers) of AMD EPYC 9654 based servers and save 1897 MWh of energy, reduce carbon footprint by 804 metric tons CO2, and save $2821K in total cost of ownership over 4-years. Intel Xeon 6972P delivers 2x higher performance and 1.2x higher performance/watt per server vs Intel Xeon AMD EPYC 9654 on MongoDB (1S). 6972P : 1-node, pre-production platform, 2x (1x used) Intel(R) Xeon(R) 6972P, 96 cores, HT On, Turbo On, Total Memory 1536GB (24x64GB DDR5 6400 MT/s [6400 MT/s]), BIOS BHSDCRB1.IPC.0033.D57.2406240014, microcode 0x11000290, 2x Ethernet Controller 10-Gigabit X540-AT2, 2x Ethernet Controller E810-C for QSFP, 1x 1.7T Micron_7400_MTFDKCC1T9TDZ, 4x 3.5T KIOXIA KCD8XPUG3T84, Ubuntu 22.04.4 LTS, 6.5.0-21-generic. Test by Intel as of 07/16/24. AMD EPYC 9654: 1-node, 2x (1x used) AMD EPYC 9654 96-Core Processor, 96 cores, SMT On, Boost On, NPS 1, Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 1.6, microcode 0xa10113e, 2x Ethernet Controller E810-C for QSFP, 2x Ethernet Controller 10G X550T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.4 LTS, 6.5.0-21-generic. Test by Intel as of 07/29/24. Software: MongoDB 6.0.4, YCSB, multi-instance, read/update 90/10. Assumptions: 1x 42U, 15KW Rack, supporting 20x 2U rack servers, 1x TOR switch, 1.6 PUE, kWh to kg CO2 factor 0.42394. For 12 racks of AMD EPYC 9654 based servers over 4-years, estimated as of Sep 2024: CapEx costs: $7526k, OpEx costs (4 year, includes power and cooling utility costs, infrastructure and hardware maintenance costs): $3611k, Energy use: 9648MWh, CO2 emissions: 4090 metric tons. For 10 rack of Intel Xeon 6972P based servers over 4-years, estimated as of Sep 2024: CapEx costs: $6171k, OpEx costs (4 year, includes power and cooling utility costs, infrastructure and hardware maintenance costs): $2145k: Energy use: 7750MWh, CO2 emissions: 3286 metric tons. Costs based on Intel estimates and information from thinkmate.com as of Sep 2024. | TCO Savings on MogoDB(1S) | Test by Intel as of 07/16/24. |
| [9T9] Intel® Xeon® 6 with P-cores delivers up to 18% lower total cost of ownership (TCO) than AMD EPYC 9654 based servers running a OpenFOAM | Intel Xeon 6900-series with P-cores | Use 10 racks (80 servers) of Intel® Xeon® 6972P based servers running OpenFOAM geomean (2) instead of 11 racks (154 servers) of AMD EPYC 9654 based servers and save 992 MWh of energy, reduce carbon footprint by 421 metric tons CO2, and save $1437K in total cost of ownership over 4-years. Intel Xeon 6972P delivers 1.89x higher performance and 1.1x higher performance/watt per server vs Intel Xeon AMD EPYC 9654 on OpenFOAM geomean (2). OpenFOAM (motorbike-20m, motorbike-42m) 6972P w/MRDIMM: Test by Intel as of July 2024, 1 node, 2x Intel Xeon 6972P, HT On, Turbo On, SNC3, 1536 GB MRDIMM-8800, BIOS BHSDREL1.86B.0033.D40.2406180419, ucode=0x11000280, Ubuntu 24.04, Kernel 6.8.0, OpenFOAM v2312 9654: Test by Intel as of April 2024, 1 node, 2x AMD EPYC 9654, SMT On, Boost On, NPS4, 1536 GB DDR5-4800, BIOS 1.9, ucode 0xa101148, Ubuntu 24.04, Kernel 6.8.0, OpenFOAM v2312 Assumptions: 1x 42U, 15KW Rack, supporting 20x 2U rack servers, 1x TOR switch, 1.6 PUE, kWh to kg CO2 factor 0.42394. For 11 racks of AMD EPYC 9654 based servers over 4-years, estimated as of Sep 2024: CapEx costs: $4977k, OpEx costs (4 year, includes power and cooling utility costs, infrastructure and hardware maintenance costs): $2770k, Energy use: 9066MWh, CO2 emissions: 3843 metric tons. For 10 rack of Intel Xeon 6972P based servers over 4-years, estimated as of Sep 2024: CapEx costs: $4433k, OpEx costs (4 year, includes power and cooling utility costs, infrastructure and hardware maintenance costs): $1876k: Energy use: 8073MWh, CO2 emissions: 3423 metric tons. Costs based on Intel estimates and information from thinkmate.com as of Sep 2024. This offering is not approved or endorsed by OpenCFD Limited, producer and distributor of the OpenFOAM software via www.openfoam.com, and owner of the OPENFOAM® and OpenCFD® trademark | TCO savings on OpenFOAM geomean(2) workload | Test by Intel as of July 2024, |
| [9T10] Intel® Xeon® 6 with P-cores delivers up to 69% lower total cost of ownership (TCO) than AMD EPYC 9654 based servers running a ResNet50 workload. | Intel Xeon 6900-series with P-cores | Use 10 racks (100 servers) of Intel® Xeon® 6972P based servers running ResNet50 instead of 31 racks (496 servers) of AMD EPYC 9654 based servers and save 16717 MWh of energy, reduce carbon footprint by 7087 metric tons CO2, and save $17619K in total cost of ownership over 4-years. Intel Xeon 6972P delivers 4.91x higher performance and 2.97x higher performance/watt per server vs Intel Xeon AMD EPYC 9654 on ResNet50. ResNet50 : Intel Xeon 6972P, MRDIMM: 1-node, pre-production platform, 2x Intel(R) Xeon(R) 6972P, 96 cores, 500W TDP, HT On, Turbo On, Total Memory 1536GB (24x64GB MRDIMM 8800MT/s [8800 MT/s]), BIOS BHSDCRB1.IPC.0033.D57.2406240014, microcode 0x11000290, 2x Dual-Media 10G RDMA Ethernet Controller, 2x Ethernet Controller E810-C for QSFP, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 24.04 LTS, 6.8.0-31-generic. Test by Intel as of 08/05/24. AMD EPYC 9654: 1-node, 2x AMD EPYC 9654, 96 cores, 360W TDP, SMT On, Boost On, NPS 1, Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 1.6, microcode 0xa101144, 2x Ethernet Controller X550, 1x 3.5T SAMSUNG MZWLJ3T8HBLS-00007, Ubuntu 24.04 LTS, 6.8.0-31-generic. Test by Intel as of 07/09/24. Software: ResNet50 v1.5, Inference: int8, bs=1 (sla=15ms), bs=x, Dataset: ImageNet, Framework: PyTorch:2.4.0, IPEX: 2.4.0, OneDNN: v3.4.2, Modelzoo: https://github.com/intel/ai-reference-models Assumptions: 1x 42U, 15KW Rack, supporting 20x 2U rack servers, 1x TOR switch, 1.6 PUE, kWh to kg CO2 factor 0.42394. For 31 racks of AMD EPYC 9654 based servers over 4-years, estimated as of Sep 2024: CapEx costs: $17026k, OpEx costs (4 year, includes power and cooling utility costs, infrastructure and hardware maintenance costs): $8387k, Energy use: 25083MWh, CO2 emissions: 10634 metric tons. For 10 rack of Intel Xeon 6972P based servers over 4-years, estimated as of Sep 2024: CapEx costs: $5673k, OpEx costs (4 year, includes power and cooling utility costs, infrastructure and hardware maintenance costs): $2121k: Energy use: 8365MWh, CO2 emissions: 3546 metric tons. Costs based on Intel estimates and information from thinkmate.com as of Sep 2024. | TCO Savings on AI-Image Classification (ResNet50) | Test by Intel as of 08/05/24. |
| [9T11] Intel® Xeon® 6 with P-cores delivers up to 49% lower total cost of ownership (TCO) than AMD EPYC 9654 based servers running a Llama-2 7B Chatbot (128/128) int8/BSX workload. | Intel Xeon 6900-series with P-cores | Use 10 racks (80 servers) of Intel® Xeon® 6972P based servers running Llama-2 7B Chatbot (128/128) int8/BSX instead of 18 racks (252 servers) of AMD EPYC 9654 based servers and save 6997 MWh of energy, reduce carbon footprint by 2967 metric tons CO2, and save $6292K in total cost of ownership over 4-years. Intel Xeon 6972P delivers 3.06x higher performance and 1.86x higher performance/watt per server vs Intel Xeon AMD EPYC 9654 on Llama-2 7B Chatbot (128/128) int8/BSX. Llama-2 7B Chatbot (128/128) int8/BSX. Intel Xeon 6972P, MRDIMM: 1-node, pre-production platform, 2x Intel(R) Xeon(R) 6972P, 96 cores, 500W TDP, HT On, Turbo On, Total Memory 1536GB (24x64GB MRDIMM 8800MT/s [8800 MT/s]), BIOS BHSDCRB1.IPC.0033.D57.2406240014, microcode 0x11000290, 2x Ethernet Controller 10-Gigabit X540-AT2, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 24.04 LTS, 6.8.0-31-generic. Test by Intel as of 07/10/24. AMD EPYC 9654: 1-node, 2x AMD EPYC 9654, 96 cores, 360W TDP, SMT On, Boost On, NPS 1, Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 1.6, microcode 0xa101144, 2x Ethernet Controller X550, 1x 3.5T SAMSUNG MZWLJ3T8HBLS-00007, Ubuntu 24.04 LTS, 6.8.0-31-generic. Test by Intel as of 07/09/24. Software: Llama2 7B: int8, Framework: PyTorch:2.4.0, IPEX: 2.4.0, OneDNN: v3.4.2, Modelzoo: https://github.com/intel/ai-reference-models, Model instances=2, bs=16 (128/128), bs=2 (2048/2048), bs=7 (1024/128) Assumptions: 1x 42U, 15KW Rack, supporting 20x 2U rack servers, 1x TOR switch, 1.6 PUE, kWh to kg CO2 factor 0.42394. For 18 racks of AMD EPYC 9654 based servers over 4-years, estimated as of Sep 2024: CapEx costs: $8143k, OpEx costs (4 year, includes power and cooling utility costs, infrastructure and hardware maintenance costs): $4506k, Energy use: 14622MWh, CO2 emissions: 6199 metric tons. For 10 rack of Intel Xeon 6972P based servers over 4-years, estimated as of Sep 2024: CapEx costs: $4539k, OpEx costs (4 year, includes power and cooling utility costs, infrastructure and hardware maintenance costs): $1818k: Energy use: 7625MWh, CO2 emissions: 3232 metric tons. Costs based on Intel estimates and information from thinkmate.com as of Sep 2024. | TCO Savings on Gen AI (Llama-2 7B Chatbot) | Test by Intel as of 07/10/24. |
| Claim | Processor Series | System Configuration | Measurement | Measurement Period |
|---|---|---|---|---|
| [7T1] Consolidate 3 racks (60 servers) of Intel® Xeon® 8280 based servers running Integer Throughput, into 1 racks (15 servers) of Intel® Xeon® 6780E based servers and save 1539 MWh of energy and reduce carbon footprint by 653 metric tons CO2 over 4-years. Intel Xeon 6780E delivers 3.66x higher performance and 2.74x higher performance/watt per server vs Intel Xeon 8280 on Integer Throughput. | Intel Xeon 6700-series with E-cores | Integer Throughput: Consolidate 3 racks (60 servers) of Intel® Xeon® 8280 based servers running Integer Throughput, into 1 racks (15 servers) of Intel® Xeon® 6780E based servers and save 1539 MWh of energy and reduce carbon footprint by 653 metric tons CO2 over 4-years. Intel Xeon 6780E delivers 3.66x higher performance and 2.74x higher performance/watt per server vs Intel Xeon 8280 on Integer Throughput. Assumptions: 1x 42U, 15KW Rack, supporting 20x 2U rack servers, 1x TOR switch, 1.6 PUE, kWh to kg CO2 factor 0.42394 For 3 racks of Intel Xeon 8280 based servers over 4-years, estimated as of Apr 2024: Energy use: 2311, CO2 emissions: 979.7 metric tons. For 1 rack of Intel Xeon 6780E based servers over 4-years, estimated as of Apr 2024: Energy use: 771.2, CO2 emissions: 326.9 metric tons. 6780E: 1-node, pre-production platform, 2x Intel(R) Xeon(R) 6780E, 144 cores/330W, HT NA, Turbo On, Total Memory 1024GB (16x64GB DDR5 6400 MT/s [6400 MT/s]), microcode 0x13000131, 1x I210 Gigabit Network Connection, 2x BCM57416 NetXtreme-E Dual-Media 10G RDMA Ethernet Controller, 1x 894.3G Micron_7450_MTFDKBG960TFR, Ubuntu 22.04.4 LTS, 6.5.0-26-generic, est SPECcpu2017 int-rate, gcc13.1, Test by Intel as of 04/11/24 8280: 1-node, 2x Intel(R) Xeon(R) Platinum 8280 CPU @ 2.70GHz, 28 cores/205W, HT On, Turbo On, Total Memory 384GB (12x32GB DDR4 2933 MT/s [2933 MT/s]), microcode 0x5003604, 2x Ethernet Connection X722 for 10GBASE-T, 2x Ethernet Controller E810-C for QSFP, 1x 1.7T INTEL SSDPF2KX019T1M, Ubuntu 22.04.3 LTS, 6.5.0-27-generic, est SPECcpu2017 int-rate, gcc13.1, Test by Intel as of 04/11/24. | Energy efficiency with Integer throughput | Test by Intel as of 04/11/24 |
| [7T2] Consolidate 3 racks (60 servers) of Intel® Xeon® 8280 based servers running Media Transcode - AVC, into 1 racks (15 servers) of Intel® Xeon® 6780E based servers and save 1194 MWh of energy and reduce carbon footprint by 507 metric tons CO2 over 4-years. Consolidate 200 racks (4000 servers) of Intel® Xeon® 8280 based servers running Media Transcode - AVC, into 66 racks (990 servers) of Intel® Xeon® 6780E based servers and save 80199 MWh of energy and reduce carbon footprint by 34000 metric tons CO2 over 4-years. Intel Xeon 6780E delivers 4.22x higher performance and 2.61x higher performance/watt per server vs. Intel Xeon 8280 on Media Transcode - AVC. | Intel Xeon 6700-series with E-cores | Media Transcode: Consolidate 3 racks (60 servers) of Intel® Xeon® 8280 based servers running Media Transcode - AVC, into 1 racks (15 servers) of Intel® Xeon® 6780E based servers and save 1194 MWh of energy and reduce carbon footprint by 507 metric tons CO2 over 4-years. Intel Xeon 6780E delivers 4.22x higher performance and 2.61x higher performance/watt per server vs Intel Xeon 8280 on Media Transcode - AVC. Assumptions: 1x 42U, 15KW Rack, supporting 20x 2U rack servers, 1x TOR switch, 1.6 PUE, kWh to kg CO2 factor 0.42394 For 3 racks of Intel Xeon 8280 based servers over 4-years, estimated as of Apr 2024: Energy use: 2004.3, CO2 emissions: 849.7 metric tons. For 1 rack of Intel Xeon 6780E based servers over 4-years, estimated as of Apr 2024: Energy use: 809.4, CO2 emissions: 343.1 metric tons. Media Transcode: Consolidate 200 racks (4000 servers) of Intel® Xeon® 8280 based servers running Media Transcode - AVC, into 66 racks (990 servers) of Intel® Xeon® 6780E based servers and save 80199 MWh of energy and reduce carbon footprint by 34000 metric tons CO2 over 4-years. Intel Xeon 6780E delivers 4.22x higher performance and 2.61x higher performance/watt per server vs Intel Xeon 8280 on Media Transcode - AVC. Assumptions: 1x 42U, 15KW Rack, supporting 20x 2U rack servers, 1x TOR switch, 1.6 PUE, kWh to kg CO2 factor 0.42394 For 200 racks of Intel Xeon 8280 based servers over 4-years, estimated as of Apr 2024: Energy use: 133617.7, CO2 emissions: 56645.9 metric tons. For 66 rack of Intel Xeon 6780E based servers over 4-years, estimated as of Apr 2024: Energy use: 53418.4, CO2 emissions: 22646.2 metric tons. 6780E: 1-node, pre-production platform, 2x Intel(R) Xeon(R) 6780E, 144 cores/330W, HT NA, Turbo On, Total Memory 1024GB (16x64GB DDR5 6400 MT/s [6400 MT/s]), microcode 0x13000131, 1x I210 Gigabit Network Connection, 1x 3.5T INTEL SSDPF2KX038TZ, Ubuntu 22.04.4 LTS, 6.5.0-25-generic, AVC Test by Intel as of 04/16/24. 8280: 1-node, 2x Intel(R) Xeon(R) Platinum 8280 CPU @ 2.70GHz, 28 cores/205W, HT On, Turbo On, Total Memory 384GB (12x32GB DDR4 2933 MT/s [2933 MT/s]), microcode 0x5003604, 2x Ethernet Connection X722 for 10GBASE-T, 1x 3.5T INTEL SSDPF2KX038TZ, Ubuntu 22.04.4 LTS, 6.5.0-25-generic, AVC, Test by Intel as of 04/17/24. | Energy efficiency with Media Transcode | Test by Intel as of 04/16/24. |
| [7T3] Save up to 280W power when operating at sweet spot 40-60% server utilization 18% improved performance on Intel Xeon 6780E vs. Intel Xeon Platinum 8592+. | Intel Xeon 6700-series with E-cores | 6780E: 1-node, pre-production platform, 2x Intel(R) Xeon(R) 6780E, 144 cores/330W, HT n/a, Turbo On, Total Memory 1024GB (16x64GB DDR5 6400 MT/s [5600 MT/s]), microcode 0x13000162, 1x I210 Gigabit Network Connection, 2x BCM57416 NetXtreme-E Dual-Media 10G RDMA Ethernet Controller, 1x 894.3G Micron_7450_MTFDKBG960TFR, CentOS Stream 9, 6.6.0-srf.bkc.6.6.17.8.13.x86_64, Power Efficiency workload, OpenJDK117, Test by Intel as of 04/11/24. 8592+: 1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores/350W, HT On, Turbo On, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 3B07.TEL2P1, microcode 0x21000200, 2x Ethernet Controller 10-Gigabit X540-AT2, 1x 1.7T SAMSUNG MZWLR1T9HBJR-00007, Ubuntu 22.04.4 LTS, 6.5.0-25-generic, Power Efficiency workload. Package power = measured socket power during workload execution | Power efficiency workload | Test by Intel as of 04/11/24. |
| [7T4] ~60% average performance/watt gain between 40-60% load comparing Intel Xeon 6766E vs. Intel Xeon 8592+. | Intel Xeon 6700-series with E-cores | 6766E: 1-node, pre-production platform, 2x Intel(R) Xeon(R) 6766E, 144 cores/250W, HT NA, Turbo On, Total Memory 1024GB (16x64GB DDR5 6400 MT/s [6400 MT/s]), BIOS BHSDREL1.IPC.0030.D85.2403122320, microcode 0x13000131, 2x Ethernet Controller 10-Gigabit X540-AT2, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.1 LTS, 6.5.0-21-generic, Power Efficiency workload. 8592+: 1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores, HT On, Turbo On, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 3B07.TEL2P1, microcode 0x2100020, 2x Ethernet Controller 10-Gigabit X540-AT2, 1x 1.7T SAMSUNG MZWLR1T9HBJR-00007, Ubuntu 22.04.4 LTS, 6.5.0-25-generic, Power Efficiency workload. | Power efficiency load line | Test by Intel April 2024. |
| [7D1] Up to 3.7x higher performance and 2.78x higher performance/watt (socket power) on MySQL OLTP with Intel Xeon 6780E processor vs. Intel Xeon Platinum 8280 . | Intel Xeon 6700-series with E-cores | 6780E: 1-node pre-production platform, 2x (1x used) Intel(R) Xeon(R) 6780E, 144 cores/330W, HT na, Turbo On, NUMA 2, Beechnut City, Total Memory 1024GB (16x64GB DDR5 6400 MT/s [6400 MT/s]), microcode 0x13000131, 2x Ethernet Controller 10-Gigabit X540-AT2, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, 4x 1.7T KIOXIA KCD8XPUG1T92, Ubuntu 22.04.1 LTS, 6.5.0-21-generic, Test by Intel as of 04/05/24. 8280: 1-node, 2x (1x used) Intel(R) Xeon(R) Platinum 8280M CPU @ 2.70GHz, 28 cores/205W, HT On, Turbo On, NUMA 2, S2600WFT, Total Memory 768GB (12x64GB DDR4 3200 MT/s [2933 MT/s]), microcode 0x4003605, 2x Ethernet Connection X722 for 10GBASE-T, 4x 3.5T SAMSUNG MZWLJ3T8HBLS-00007, 1x 1.7T SAMSUNG MZWLJ1T9HBJR-00007, Ubuntu 22.04.4 LTS, 6.5.0-21-generic, Test by Intel as of 04/08/24. Socket power is power consumed by CPUs. Software: HammerDB TPROC-C, MySQL 8.0.33, multi-instance | HammerDB TPROC-C with MySQL* database | Test by Intel as of 04/05/24. |
| [7D2] Up to 1.1x higher performance and 1.63x higher performance/watt (socket power) on MySQL OLTP with Intel Xeon 6780E processor vs. 5th Gen Intel Xeon Platinum 8592+. | Intel Xeon 6700-series with E-cores | 6780E: 1-node pre-production platform, 2x (1x used) Intel(R) Xeon(R) 6780E, 144 cores/330W, HT na, Turbo On, Beechnut City, Total Memory 1024GB (16x64GB DDR5 6400 MT/s [6400 MT/s]), microcode 0x13000131, 2x Ethernet Controller 10-Gigabit X540-AT2, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, 4x 1.7T KIOXIA KCD8XPUG1T92, Ubuntu 22.04.1 LTS, 6.5.0-21-generic, Test by Intel as of 04/05/24. 8592+: 1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores/350W, HT On, Turbo On, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), microcode 0x21000200, 2x Ethernet Controller 10-Gigabit X540-AT2, 1x 1.7T SAMSUNG MZWLR1T9HBJR-00007, 4x 1.7T KIOXIA KCD8XPUG1T92, Ubuntu 22.04.4 LTS, 6.5.0-21-generic,Test by Intel as of 04/05/24. Socket power is power consumed by CPUs. Software: HammerDB TPROC-C, MySQL 8.0.33, multi-instance | HammerDB TPROC-C with MySQL* database | Test by Intel as of 04/05/24. |
| [7G1] Up to 3.66x higher integer throughput performance and up to 2.59x higher integer throughput performance/watt (socket power) with Intel Xeon 6780E vs. 2nd Gen Intel Xeon 8280 processors. Up to 3.25x higher floating point throughput performance and up to 2.29x higher floating point throughput performance/watt (socket power) with Intel Xeon 6780E vs. 2nd Gen Intel Xeon 8280 processors. | Intel Xeon 6700-series with E-cores | 6780E: 1-node, pre-production platform, 2x Intel(R) Xeon(R) 6780E, 144 cores/330W, HT na, Turbo On, Beechnut City, Total Memory 1024GB (16x64GB DDR5 6400 MT/s [6400 MT/s]), microcode 0x13000131, 1x I210 Gigabit Network Connection, 2x BCM57416 NetXtreme-E Dual-Media 10G RDMA Ethernet Controller, 1x 894.3G Micron_7450_MTFDKBG960TFR, Ubuntu 22.04.4 LTS, 6.5.0-26-generic, Test by Intel as of 04/11/24. 8280: 1-node, 2x Intel(R) Xeon(R) Platinum 8280 CPU @ 2.70GHz, 28 cores/205W, HT On [Off Linpack, Stream], Turbo On, S2600WFD, Total Memory 384GB (12x32GB DDR4 2933 MT/s [2933 MT/s]), microcode 0x5003604, 2x Ethernet Connection X722 for 10GBASE-T, 2x Ethernet Controller E810-C for QSFP, 1x 1.7T INTEL SSDPF2KX019T1M, Ubuntu 22.04.3 LTS, 6.5.0-27-generic, Test by Intel as of 04/11/24. Power used is socket power. Software: est. SPECcpu 2017 integer rate, floating point rate: gcc13.1 | Integer and floating point throughput - SPEC CPU® 2017 rate [est] | Test by Intel as of 04/11/24. |
| [7G2] Up to 1.25x higher integer throughput performance and up to 1.55x higher integer throughput performance/watt (socket power) with Intel Xeon 6780E vs. 5th Gen Intel Xeon 8592+ processors. Up to 1.03x higher floating point throughput performance and up to 1,34x higher floating point throughput performance/watt (socket power) with Intel Xeon 6780E vs. 5th Gen Intel Xeon 8592+ processors. | Intel Xeon 6700-series with E-cores | 6780E: 1-node, pre-production platform, 2x Intel(R) Xeon(R) 6780E, 144 cores/330W, HT na, Turbo On, Beechnut City, Total Memory 1024GB (16x64GB DDR5 6400 MT/s [6400 MT/s]), microcode 0x13000131, 1x I210 Gigabit Network Connection, 2x BCM57416 NetXtreme-E Dual-Media 10G RDMA Ethernet Controller, 1x 894.3G Micron_7450_MTFDKBG960TFR, Ubuntu 22.04.4 LTS, 6.5.0-26-generic, Test by Intel as of 04/11/24. 8592+: 1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores/350W, HT On(Off Linpack, Stream), Turbo On, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), microcode 0x21000200, 2x Ethernet Controller X710 for 10GBASE-T, 1x 1.5T INTEL SSDPF21Q016TB, Ubuntu 22.04.1 LTS, 6.5.0-27-generic,Test by Intel as of 04/16/24. Power used is socket power. Software: est. SPECcpu 2017 integer rate, floating point rate: gcc13.1 | Integer and floating point throughput - SPEC CPU® 2017 rate [est] | Test by Intel on 04/16/24. |
| [7G3] Up to 3.79x higher average* performance and 2.57x higher average* performance/watt across various workloads with Intel Xeon 6 with E-cores vs. 2nd Gen Intel Xeon. | Intel Xeon 6700-series with E-cores | *Geomean of integer throughput (est) , floating point throughput (est), MySQL OLTP, Server Side Java throughput, Server Side Jave throughput under SLA, NGFW, SVT-HEVC, AVC, x265. See [7G1, 7D1, 7N2, 7W1, 7W4] at intel.com/processorclaims: Intel® Xeon® 6 | Summary Perf and Perf/Watt across workloads | Test by Intel April 2024. |
| [7G4] Up to 1.17x higher average* performance and 1.46x higher average* performance/watt across various workloads with Intel Xeon 6 with E-cores vs. 5th Gen Intel Xeon . | Intel Xeon 6700-series with E-cores | *Geomean of integer throughput (est) , floating point throughput (est), MySQL OLTP, Server Side Java throughput, Server Side Jave throughput under SLA, NGFW, SVT-HEVC, AVC, x265. See [7G1, 7D1, 7N2, 7W1, 7W4] at intel.com/processorclaims: Intel® Xeon® 6 | Summary Perf and Perf/Watt across workloads | Test by Intel April 2024. |
| [7N1] Up to 4.17x higher 5G UPF performance and 2.66x higher performance/watt (socket power) with Intel Xeon 6780E vs. 2nd Gen Intel Xeon 6252N processors. | Intel Xeon 6700-series with E-cores | 6780E: 1-node, pre-production platform, 2x Intel(R) Xeon(R) 6780E(1 used), 144 cores/330W, HT na, Turbo Off, Total Memory 512GB (16x32GB DDR5 5600 MT/s [5600 MT/s]), microcode 0x13000131, uncore=2GHz, core=1.8GHz, 10x Ethernet Controller E810-C for QSFP, 1x I210 Gigabit Network Connection, 1x 223.6G INTEL SSDSC2KB240GZ, Ubuntu 22.04 LTS, 5.15.0-27-generic, Test by Intel as of 04/28/2024. 6252N: 1-node, 2x Intel(R) Xeon(R) Gold 6252N (1 used), CPU @ 2.30GHz, 24 cores/150W, HT on, Turbo On, Total Memory 192GB (12x16GB DDR4 2933 MT/s [2933 MT/s]), microcode 0x5003605, 2x Ethernet Controller 10G X550T, 4x Ethernet Controller E810-C for QSFP, 1x 745.2G INTEL SSDSC2BA800G4, Ubuntu 22.04 LTS, 5.15.0-27-generic, Test by Intel as of 04/23/24. Socket power is power consumed by CPUs. Software: 5G UPF PMA4, GCC 11.3, Packet-Size = 650B | 5G-UPF (User Plane Forwarding) | Test by Intel on April 23-28, 2024. |
| [7N2] Up to 5.82x higher NGFW performance and 3.46x higher performance/watt (socket power) with Intel Xeon 6780E vs. 2nd Gen Intel Xeon 6252N processors on Next Gen Firewall solutions. | Intel Xeon 6700-series with E-cores | 6780E: 1-node, pre-production platform, 2x Intel(R) Xeon(R) 6780E(2 populated, 1 used), HT NA, Turbo On, Total Memory 512GB (16x32GB DDR5 5600 MT/s [5600 MT/s]), microcode 0x13000131, 1x I210 Gigabit Network Connection, 2x Ethernet Controller E810-C for QSFP, 1x 223.6G INTEL SSDSC2KB240GZ, Ubuntu 22.04 LTS, 5.15.0-27-generic, Test by Intel as of 03/27/24. 6252N: 1-node, 2x Intel(R) Xeon(R) Gold 6252N CPU (2 populated 1 used), @ 2.30GHz, 24 cores/150W, HT On, Turbo Off, Total Memory 256GB (16x16GB DDR4 2933 MT/s [2933 MT/s]), microcode 0x5003302, 2x Ethernet Controller 10G X550T, 1x 223.6G KINGSTON SA400S37240G, Ubuntu 22.04 LTS, 5.15.0-27-generic, Test by Intel as of 04/24/24. +H237 Software: Workload: NGFW 24.01-RC2, Snort 3.1.36.0, Hyperscan 5.6.1, NGFW-64K HTTP. | Next Gen Firewall (NGFW) | Test by Intel on March 27, 2024 and April 24, 2024. |
| [7N4] Up to 1.43x higher IOPS on Intel® Xeon® 6766E with Intel VROC (eight-disk RAID0) vs. legacy architecture (HBA). 30% lower latency on Intel® Xeon® 6766E with Intel VROC (8 disk RAID0) vs. legacy architecture (HBA). Up to 1.39x higher IOPS/watt on Intel® Xeon® 6766E with Intel VROC (8 disk RAID0) vs. legacy architecture (HBA). | Intel Xeon 6700-series with E-cores | 6766E: 1-node, pre-production platform , 2x Intel® Xeon® 6766E Processor on BeechnutCity , 512GB RAM (16 x 32GB Micron MTC20F1045S1RC64BDY 6400 MT/s DDR5 Synchronous Registered (Buffered) DIMMs); Microcode revision: 0x13000131, Fio version: 3.35 ,HT na, Red Hat Enterprise Linux 9.3 GA, Kernel: 6.4.16-upstream. Test by Intel as of 04/24/2024. Storage: VROC: 8 x 3.2TB Kioxia CM7-V PCIe Gen5 U.2 SSDs (Model: KCMYDVUG3T20, Firmware: 1UET7103) connected to backplane which is connected to CPU0 4A-D, 5A-D MCIO PCIe ports (NUMA Node 1, CPU 0), Trimode with Midplane switch: 8 x 3.2TB Kioxia CM7-V PCIe Gen5 U.2 SSDs (Model: KCMYDVUG3T20, Firmware: 1UET7103) connected to backplane which is connected, via a midplane switch to a Broadcom MegaRAID 9670W-16i RAID card on CPU0 Riser, top PCIe slot (NUMA Node 0, CPU0), OS: On P1600X 58GB Intel NVMe M.2 SSD (Model: SSDPEK1F058GA, Firmware: U40AE022) connected to M.2 LOM slot VROC: VMD enabled on any applicable ports containing NVMe devices (with Intel(R) VROC Premium licesne),Intel(R) VROC PreOS Version: 9.0.0.1148,mdadm version = mdadm-4.2-8.el9.x86_64,vmd driver version = inbox,Added "pci=pcie_bus_perf" to grub boot option which sets MaxPayload to the maximum for each of the NVMe devices,Interrupt Coalescing NVMe feature was configured with "0x103" value during measurement HBA: Model: MegaRAID 9670W-16i Tri-Mode Storage Adapter,Firmware Version = 8.8.1.0-00000-00001,mpi3mr driver version = 8.8.1.0.0,CLI Version = 008.0008.0000.0010 Jan 08, 2024,Added "scsi_mod.use_blk_mq=y" to grub boot option for maximum throughput on the Broadcom card,"When creating RAID volumes: Read Cache Policy <No Read Ahead>, Write Cache Policy <Write-Back>, Drive Write Cache Policy <Disable>,RAID volume initialized before starting measurements" RAID Configurations: 8-Disk RAID0 with 4KB random 70/30 R/W workload using 32 Threads and 64 IODepth with Intel VROC FIO version: Fio version: 3.35 | FIO [VROC] | Test by Intel as of 04/24/2024. |
| [7N5] Up to 24x higher CDN VoD performance and 8x higher performance/watt (socket power) with Intel Xeon 6780E processor vs. 2nd Gen Intel Xeon 8280. Up to 4.9x higher CDN Live-Linear performance and 3x higher performance/watt (socket power) with Intel Xeon 6780E processor vs. 2nd Gen Intel Xeon 8280. | Intel Xeon 6700-series with E-cores | 6780E: 1-node, pre-production platform, 1x Intel(R) Xeon(R) 6780E, 144 cores, HT NA, Turbo On, Total Memory 512GB (8x64GB DDR5 6400 MT/s [6400 MT/s]), microcode 0x13000131, 4x MT2910 Family [ConnectX-7], 1x 894.3G Micron_7450_MTFDKBG960TFR, 8x 1.8T KIOXIA KCMY1RUG1T92, Red Hat Enterprise Linux 8.9 (Ootpa), 6.6.16, Test by Intel as of 05/09/24. 8280: 1-node, 1x Intel(R) Xeon(R) Platinum 8280 CPU @ 2.70GHz, 28 cores, HT On, Turbo On, Total Memory 192GB (6x32GB DDR4 2933 MT/s [2933 MT/s]), microcode 0x5003605, 2x Ethernet Connection X722 for 10GBASE-T, 4x MT28800 Family [ConnectX-5 Ex], 1x 477G INTEL SSDPEKNW512G8, 2x 3.7T INTEL SSDPE2KX040T8, Red Hat Enterprise Linux 8.9 (Ootpa), 6.6.16, Test by Intel as of 05/09/24. Socket power is power consumed by CPUs. Software: Workload: wrk master 02/07/2021, varnish-plus-6.0.12r6 revision b9a3af68bd9c9ecf253a4c2aeda757ad6e30e71f, OpenSSL 1.1.1k FIPS 25 Mar 2021, keep alive, 800 connections per client, throughput measured with 100% Transport Layer Security (TLS) traffic with 98.8%(Live Linear) and 100%(Video-On-Demand) target cache hit ratio. | CDN Performance - Video-on-Demand | Test by Intel as of 05/09/24. |
| [7N6] Up to 18x higher CDN VoD performance and 7x higher performance/watt (socket power) with Intel Xeon 6710E processor vs. 2nd Gen Intel Xeon 6252N. Up to 3.4x higher CDN Live-Linear performance and 2.5x higher performance/watt (socket power) with Intel Xeon 6710E processor vs. 2nd Gen Intel Xeon 6252N. | Intel Xeon 6700-series with E-cores | 6710E: 1-node, pre-production platform, 1x Intel(R) Xeon(R) 6710E, 64 cores, HT NA, Turbo On, Total Memory 512GB (8x64GB DDR5 6400 MT/s [5600 MT/s]), microcode 0x13000131, 4x MT2910 Family [ConnectX-7], 1x 894.3G Micron_7450_MTFDKBG960TFR, 8x 1.8T KIOXIA KCMY1RUG1T92, Red Hat Enterprise Linux 8.9 (Ootpa), 6.6.16, Test by Intel as of 05/10/24. 6252N: 1-node, 1x Intel(R) Xeon(R) Gold 6252N CPU @ 2.30GHz, 24 cores, HT On, Turbo On, Total Memory 192GB (6x32GB DDR4 2933 MT/s [2933 MT/s]), microcode 0x5003605, 2x Ethernet Connection X722 for 10GBASE-T, 4x MT28800 Family [ConnectX-5 Ex], 1x 477G INTEL SSDPEKNW512G8, 2x 3.7T INTEL SSDPE2KX040T8, Red Hat Enterprise Linux 8.9 (Ootpa), 6.6.16, Test by Intel as of 05/10/24. Socket power is power consumed by CPUs. Software: Workload: wrk master 02/07/2021, varnish-plus-6.0.12r6 revision b9a3af68bd9c9ecf253a4c2aeda757ad6e30e71f, OpenSSL 1.1.1k FIPS 25 Mar 2021, keep alive, 800 connections per client, throughput measured with 100% Transport Layer Security (TLS) traffic with 98.8%(Live Linear) and 100%(Video-On-Demand) target cache hit ratio. | CDN Performance - Video-on-Demand | Test by Intel as of 05/10/24. |
| [7W1] Up to 4.10x higher throughput performance and 2.5x higher performance/watt (socket power) on SVT-HEVC Media Transcode with Intel® Xeon® 6780E vs. Intel Xeon Platinum 8280. Up to 4.22x higher throughput performance and 2.6x higher performance/watt (socket power) on AVC Media Transcode with Intel® Xeon® 6780E vs. Intel Xeon Platinum 8280. Up to 4.22x higher throughput performance and 2.6x higher performance/watt (socket power) on x265 Media Transcode with Intel® Xeon® 6780E vs. Intel Xeon Platinum 8280. | Intel Xeon 6700-series with E-cores | 6780E: 1-node, 2x Intel(R) Xeon(R) 6780E, 144 cores/330W, HT na, Turbo On, NUMA 2, Beechnut City, Total Memory 1024GB (16x64GB DDR5 6400 MT/s [6400 MT/s]), microcode 0x13000131, 1x I210 Gigabit Network Connection, 1x 3.5T INTEL SSDPF2KX038TZ, Ubuntu 22.04.4 LTS, 6.5.0-25-generic, Test by Intel as of 04/16/24. 8280: 1-node, 2x Intel(R) Xeon(R) Platinum 8280 CPU @ 2.70GHz, 28 cores/205W, HT On, Turbo On, NUMA 2, S2600WFS, Total Memory 384GB (12x32GB DDR4 2933 MT/s [2933 MT/s]), microcode 0x5003604, 2x Ethernet Connection X722 for 10GBASE-T, 1x 3.5T INTEL SSDPF2KX038TZ, Ubuntu 22.04.4 LTS, 6.5.0-25-generic, Test by Intel as of 04/17/24. Socket power is power consumed by CPUs. Software: FFMPEG, LIBX264_baee400fa9ced6f5481a728138fed6e867b0ff7f, LIBX265_Release_3.5, SVT v1.5.0. Geomean: HEVC [SVT-HEVC-1080p-preset1,SVT-HEVC-1080p-preset5,SVT-HEVC-1080p-preset7,SVT-HEVC-1080p-preset9,SVT-HEVC-4k-preset5,SVT-HEVC-4k-preset9], AVC [AVC-1080p-fast,AVC-1080p-medium,AVC-1080p-veryslow], x265[x265-1080p-medium,x265-1080p-slow,x265-4k-veryslow]. | Media Transcode (SVT-HEVC, AVC, x265) | Tests by Intel on 4/16/2024 and 4/17/2024. |
| [7W2] Up to 1.36x higher throughput performance and 1.46x higher performance/watt (socket power) on SVT-HEVC Media Transcode with Intel® Xeon® 6780E vs. Intel Xeon Platinum 8592+. Up to 1.42x higher throughput performance and 1.52x higher performance/watt G247on AVC Media Transcode with Intel® Xeon® 6780E vs. Intel Xeon Platinum 8592+. Up to 1.26x higher throughput performance and 1.35x higher performance/watt (socket power) on x265 Media Transcode with Intel® Xeon® 6780E vs. Intel Xeon Platinum 8592+. | Intel Xeon 6700-series with E-cores | Socket power is power consumed by CPUs. 6780E: 1-node, pre-production platform, 2x Intel(R) Xeon(R) 6780E, 144 cores/330W, HT na, Turbo On, NUMA 2, Beechnut City, Total Memory 1024GB (16x64GB DDR5 6400 MT/s [6400 MT/s]), microcode 0x13000131, 1x I210 Gigabit Network Connection, 1x 3.5T INTEL SSDPF2KX038TZ, Ubuntu 22.04.4 LTS, 6.5.0-25-generic, Test by Intel as of 04/16/24. 8592+: 1-node, 2x Intel Xeon Platinum 8592+, 64 cores/350W, HT On, Turbo On, NUMA 4, QuantaGrid D54Q-2U, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), microcode 0x21000200, 2x Ethernet Controller X710 for 10GBASE-T, 1x 3.5T INTEL SSDPF2KX038TZ, Ubuntu 22.04.4 LTS, 6.5.0-25-generic, Test by Intel as of 04/15/24. Socket power is power consumed by CPUs. Software: FFMPEG, LIBX264_baee400fa9ced6f5481a728138fed6e867b0ff7f, LIBX265_Release_3.5, SVT v1.5.0. Geomean: HEVC [SVT-HEVC-1080p-preset1,SVT-HEVC-1080p-preset5,SVT-HEVC-1080p-preset7,SVT-HEVC-1080p-preset9,SVT-HEVC-4k-preset5,SVT-HEVC-4k-preset9], AVC [AVC-1080p-fast,AVC-1080p-medium,AVC-1080p-veryslow], x265[x265-1080p-medium,x265-1080p-slow,x265-4k-veryslow]. | Media Transcode (SVT-HEVC, AVC, x265) | Tests by Intel on 4/15/2024 and 4/16/2024. |
| [7W4] Up to 3.18x higher Java throughput and 2.36x higher performance/watt (socket power) with Intel Xeon 6780E processor vs. 2nd Gen Intel Xeon 8280. Up to 2.96x higher Java throughput within a given SLA and 2.7x higher performance/watt (socket power) with Intel Xeon 6780E processor vs. 2nd Gen Intel Xeon 8280. | Intel Xeon 6700-series with E-cores | 6780E: 1-node pre-production platform, 2x Intel(R) Xeon(R) 6780E, 144 cores/330W, HT na, Turbo On, NUMA 2, Beechnut City, Total Memory 1024GB (16x64GB DDR5 6400 MT/s [6400 MT/s]), microcode 0x13000131, 2x Ethernet Controller 10-Gigabit X540-AT2, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, CentOS Stream 9, 5.14.0-435.el9.x86_64, Test by Intel as of 04/10/24. 8280: 1-node, 2x Intel(R) Xeon(R) Platinum 8280M CPU @ 2.70GHz, 28 cores/205W, HT On, Turbo On, NUMA 4, S2600WFT, Total Memory 768GB (12x64GB DDR4 3200 MT/s [2933 MT/s]), microcode 0x4003605, 2x Ethernet Controller X710 for 10GBASE-T, 2x Ethernet Connection X722 for 10GBASE-T, 1x 1.7T SAMSUNG MZWLJ1T9HBJR-00007, Ubuntu 22.04.4 LTS, 6.5.0-25-generic, Test by Intel as of 04/10/24. Socket power is power consumed by CPUs. Software: Server-Side Java, JDK: OpenJDK 21.0.2 | Server-side Java | Test by Intel as of 04/10/24. |
| [7W5] Up to 1.2x higher performance/watt (socket-power) on Server-Side Java with Intel® Xeon® 6780E vs. Intel Xeon Platinum 8592+. Up to 1.5x higher performance/watt (socket-power) on Server-Side Java with SLA with Intel® Xeon® 6780E vs. Intel Xeon Platinum 8592+. | Intel Xeon 6700-series with E-cores | 6780E: 1-node pre-production platform, 2x Intel(R) Xeon(R) 6780E, 144 cores/330W, HT na, Turbo On, NUMA 2, Beechnut City, Total Memory 1024GB (16x64GB DDR5 6400 MT/s [6400 MT/s]), microcode 0x13000131, 2x Ethernet Controller 10-Gigabit X540-AT2, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, CentOS Stream 9, 5.14.0-435.el9.x86_64, Test by Intel as of 04/10/24. 8592+: 1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores/350W, HT On, Turbo On, NUMA 4,Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 3B07.TEL2P1, microcode 0x21000200, 2x Ethernet Controller 10-Gigabit X540-AT2, 1x 1.7T SAMSUNG MZWLJ1T9HBJR-00007, Ubuntu 22.04.4 LTS, 6.5.0-26-generic,Test by Intel as of 04/05/24. Socket power is power consumed by CPUs. Software: Server-Side Java, JDK: OpenJDK 21.0.2 | Server-side Java | Test by Intel as of 04/10/24. |
| [7W210] Up to 1.3x Media Transcode performance/watt vs. AMD EPYC. | Intel Xeon 6700-series with E-cores | 6756E: 1-node, pre-production platform, 2x Intel(R) Xeon(R) 6756E, 128 cores, HT NA, Turbo On, Total Memory 1024GB (16x64GB DDR5 6400 MT/s [6400 MT/s]), microcode 0x13000131, 1x I210 Gigabit Network Connection, 1x 3.5T INTEL SSDPF2KX038TZ, Ubuntu 22.04.4 LTS, 6.5.0-25-generic, Test by Intel as of 05/10/24. 9534: 1-node, 2x AMD EPYC 9534 64-Core Processor, 64 cores, SMT On, Turbo On, Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 1.6, microcode 0xa10113e, 1x Ethernet Controller E810-XXV for SFP, 2x Ethernet Controller 10G X550T, 1x 1.7T SAMSUNG MZWLJ1T9HBJR-00007, Ubuntu 22.04.4 LTS, 6.5.0-26-generic, Test by Intel as of 05/09/24. Socket power for Intel, TDP power for AMD. Software: FFMPEG, LIBX264_baee400fa9ced6f5481a728138fed6e867b0ff7f, LIBX265_Release_3.5, SVT v1.5.0. Geomean: AVC [AVC-1080p-fast,AVC-1080p-medium,AVC-1080p-veryslow]. | Media Transcode (AVC) | Test by Intel as of 05/10/24. |