Intel® Ethernet Controller E810 Application Device Queues (ADQ)

Configuration Guide

Download as ZIP
ID 609008
Date 04/03/2023
Version 2.8
Document Table of Contents
Document Table of Contents
Legal and Disclaimers Revision History Fixed and Known Issues - Read First Introduction ADQ Requirements ADQ System Under Test (SUT) Installation General System Tuning ADQ Setup Using ADQ Setup Script ADQ Configuration on SR-IOV Virtual Functions Troubleshooting Testing ADQ with Netperf Testing ADQ with Redis Testing ADQ with Memcached/rpc-perf Testing ADQ with NGINX Testing ADQ with AF_XDP Testing ADQ with Apache Traffic Server (ATS) Testing ADQ with VirtIO Appendix
Legal and Disclaimers
Revision History
Fixed and Known Issues - Read First
Fixed and Known Issues - Read First Fixed Issues Known Issues
Fixed Issues
ADQ PF Issues ADQ Setup Script Issues ADQ VF Issues
ADQ PF Issues
ADQ Setup Script Issues
ADQ VF Issues
Known Issues
ADQ PF Known Issues ADQ Setup Script Known Issues ADQ VF Known Issues
ADQ PF Known Issues
ADQ Setup Script Known Issues
ADQ VF Known Issues
Introduction
Introduction ADQ Overview ADQ Reference
ADQ Overview
ADQ Reference
ADQ Requirements
Hardware Requirements Software Requirements
Hardware Requirements
Software Requirements
ADQ System Under Test (SUT) Installation
Install OS Update Kernel (If Needed) Install ice Driver with ADQ Flags Install iproute2 (Update If Needed) Install cgroup Packages (If Needed)
Install OS
Update Kernel (If Needed)
Install ice Driver with ADQ Flags
Install iproute2 (Update If Needed)
Install cgroup Packages (If Needed)
General System Tuning
ADQ Setup Using ADQ Setup Script
ADQ Setup Using ADQ Setup Script ADQ Setup Script Prerequisites ADQ Setup Script Installation ADQ Setup Script Usage
ADQ Setup Script Prerequisites
ADQ Setup Script Installation
ADQ Setup Script Usage
ADQ Configuration on SR-IOV Virtual Functions
ADQ Configuration on SR-IOV Virtual Functions General SUT Configuration for VFs SUT Configuration Bare Metal VF SUT Configuration VF Inside a VM ADQ VF Configuration
General SUT Configuration for VFs
SUT Configuration Bare Metal VF
SUT Configuration VF Inside a VM
ADQ VF Configuration
Troubleshooting
Testing ADQ with Netperf
Testing ADQ with Netperf Installation and Configuration – Both Systems netperf Server netperf Client
Installation and Configuration – Both Systems
netperf Server
netperf Client
Testing ADQ with Redis
Testing ADQ with Redis Redis Server Setup Redis Clients (non-ADQ) Configuration
Redis Server Setup
Redis Clients (non-ADQ) Configuration
Testing ADQ with Memcached/rpc-perf
Testing ADQ with Memcached/rpc-perf Memcached Server Setup Memcached/rpc-perf Clients (non-ADQ) Configuration
Memcached Server Setup
Memcached/rpc-perf Clients (non-ADQ) Configuration
Testing ADQ with NGINX
Testing ADQ with NGINX NGINX Server Setup wrk Clients Configuration
NGINX Server Setup
wrk Clients Configuration
Testing ADQ with AF_XDP
Testing ADQ with AF_XDP AF_XDP Server Configuration Traffic Generator Example Configuration (Non-ADQ)
AF_XDP Server Configuration
Traffic Generator Example Configuration (Non-ADQ)
Traffic Generator Example Configuration (Non-ADQ) Traffic Pattern to Be Generated Example: Running DPDK-pktgen Traffic
Traffic Pattern to Be Generated
Example: Running DPDK-pktgen Traffic
Testing ADQ with Apache Traffic Server (ATS)
Testing ADQ with Apache Traffic Server (ATS) ATS Server Setup Vegeta Clients Configuration
ATS Server Setup
Vegeta Clients Configuration
Testing ADQ with VirtIO
Testing ADQ with VirtIO Installation and Configuration - Both Systems Run the Traffic
Installation and Configuration - Both Systems
Run the Traffic
Appendix
ADQ Configuration Reference (Manual)
ADQ Configuration Reference (Manual)
ADQ Configuration on SUT
ADQ Configuration on SUT
ADQ Configuration on SUT Adapter Preparation Configure ADQ Traffic Class (TC) on SUT Independent Pollers (Optional) Apply Adapter Tuning Configure Symmetric Queues Configure Intel® Ethernet Flow Director Settings Set cgroup Priority for Application Network Traffic (If Needed) Verify ADQ Application Traffic and Independent Pollers (If Applicable) Clear the ADQ Configuration
Adapter Preparation
Configure ADQ Traffic Class (TC) on SUT
Configure ADQ Traffic Class (TC) on SUT Create TCs TC Filtering Confirm TC Configuration
Create TCs
TC Filtering
TC Filtering TC Filtering Requirements
TC Filtering Requirements
Confirm TC Configuration
Independent Pollers (Optional)
Independent Pollers (Optional) Independent Pollers Introduction Configure Independent Pollers
Independent Pollers Introduction
Configure Independent Pollers
Apply Adapter Tuning
Configure Symmetric Queues
Configure Intel® Ethernet Flow Director Settings
Set cgroup Priority for Application Network Traffic (If Needed)
Verify ADQ Application Traffic and Independent Pollers (If Applicable)
Clear the ADQ Configuration
Legal and Disclaimers
Revision History
Fixed and Known Issues - Read First
Introduction
ADQ Requirements
ADQ System Under Test (SUT) Installation
General System Tuning
ADQ Setup Using ADQ Setup Script
ADQ Configuration on SR-IOV Virtual Functions
Troubleshooting
Testing ADQ with Netperf
Testing ADQ with Redis
Testing ADQ with Memcached/rpc-perf
Testing ADQ with NGINX
Testing ADQ with AF_XDP
Testing ADQ with Apache Traffic Server (ATS)
Testing ADQ with VirtIO
Appendix

ADQ PF Issues

  • ice driver version 1.1.x can create unnecessary Linux kernel (kworker) threads, under certain workloads with an uncabled port on an E810 Network Interface Card (NIC) port. This can increase CPU utilization, which might impact ADQ performance.

    Mitigation: Use ice driver version 1.2.1 or later.

  • VXLAN stateless offloads (checksum, TSO) and TC filters directing traffic to a VXLAN interface are not supported with Linux v5.9 or later, using older versions of the ice driver.

    Mitigation: Use ice driver version 1.9.7 or later.

  • ADQ configuration commands that update settings on the interface (i.e., tc qdisc add and ethtool -L) cause the driver to close the associated RDMA interface and reopen it. This disrupts RDMA traffic on the interface. RDMA and ADQ configurations are not supported on the same interface simultaneously.
  • When TCs are created, deleted, then recreated, Intel® Ethernet Flow Director might not work as expected. To recover, reload ice driver and reapply ADQ configuration.

    Mitigation: Use ice driver version 1.5.8 or later.

  • The ice driver can return an error when trying to create TC filters using ipv6 filter rules.

    Mitigation: Use ice driver version 1.9.7 or later.

ADQ Setup Script Issues