Intel® Ethernet 800 Series

Linux Performance Tuning Guide

ID Date Version Classification
636781 10/23/2023 Public
Document Table of Contents
Document Table of Contents
Notices and Disclaimers Revision History Introduction Initial Checklist ​Baseline Performance Measurements and Tuning Methodology Performance Troubleshooting ​Tuning ice Driver Settings ​Platform Tuning (ice Non-Specific) ​Operating System Tuning ​Recommendations for Common Performance Scenarios
Notices and Disclaimers
Revision History
Introduction
Introduction ​Terminology ​Reference Documents
​Terminology
​Reference Documents
Initial Checklist
​Update Driver/Firmware Versions ​Read the ice Driver README ​Check System Hardware Capabilities ​Check Linux Kernel Version ​Check Kernel Boot Parameters ​Check System Logs for Driver Errors ​Check PCI Express (PCIe) Slot Capabilities ​Ensure DDP Package is Loading Properly
​Update Driver/Firmware Versions
​Read the ice Driver README
​Check System Hardware Capabilities
​Check Linux Kernel Version
​Check Kernel Boot Parameters
​Check System Logs for Driver Errors
​Check PCI Express (PCIe) Slot Capabilities
​Ensure DDP Package is Loading Properly
​Baseline Performance Measurements and Tuning Methodology
​General Performance Tuning Methodology ​Network Performance Benchmarks
​General Performance Tuning Methodology
​Network Performance Benchmarks
​Network Performance Benchmarks ​iperf2 ​iperf3 ​netperf ​Adapter Bonding
​iperf2
​iperf3
​netperf
​Adapter Bonding
Performance Troubleshooting
​CPU Utilization ​ice Counters ​Intel Unified Driver Statistics ​Intel svr-info Tool ​IOMMU in Virtualized Environments ​Resource Limitations Using E810 in 8x10G Mode
​CPU Utilization
​ice Counters
​Intel Unified Driver Statistics
​Intel svr-info Tool
​IOMMU in Virtualized Environments
​Resource Limitations Using E810 in 8x10G Mode
​Tuning ice Driver Settings
​IRQ Affinity ​Tx/Rx Queues ​Transmit and Receive Queue Alignment ​Transmit Balancing ​Interrupt Moderation ​Ring Size ​Flow Control ​Jumbo Frames ​Accelerated Receive Flow Steering (aRFS)
​IRQ Affinity
​Tx/Rx Queues
​Transmit and Receive Queue Alignment
​Transmit Balancing
​Interrupt Moderation
​Ring Size
​Flow Control
​Jumbo Frames
​Accelerated Receive Flow Steering (aRFS)
​Platform Tuning (ice Non-Specific)
​BIOS Settings ​Platform Power Management ​CPU Frequency Scaling ​Additional Power Management Guidance
​BIOS Settings
​Platform Power Management
​Platform Power Management ​CPU Package C-State Control
​CPU Package C-State Control
​CPU Frequency Scaling
​Additional Power Management Guidance
​Operating System Tuning
​Firewalls ​Application Settings ​Kernel Version ​Kernel Settings
​Firewalls
​Application Settings
​Kernel Version
​Kernel Settings
​Recommendations for Common Performance Scenarios
​IP Forwarding ​Low Latency ​Related Performance Topics
​IP Forwarding
​Low Latency
​Related Performance Topics
​DPDK ​ADQ
​DPDK
​ADQ

​Resource Limitations Using E810 in 8x10G Mode

When E810 adapters are used in 8x10 Gbps mode, the device can run out of hardware resources (MSI-X vectors) by the time the driver gets to the 8th port during driver initialization. No errors appear in the system logs, but performance on the 8th port can be affected, and the ethtool statistics for the device show all RX traffic for the 8th port going to RX Queue 0. The first 7 ports see the traffic evenly distributed among all the RX queues as expected.

Mitigation: This issue is fixed in ice v1.12.X and later.

​IRQ Affinity