Article ID: 000088729 Content Type: Maintenance & Performance Last Reviewed: 05/13/2022

How to Reach the Max Bandwidth Speed of a Single RDMA QPS When Using E810-CQDA2?

Environment

Red Hat Linux 7.0*, Red Hat Linux 8.0*

BUILT IN - ARTICLE INTRO SECOND COMPONENT
Summary

For best performance, multiple queue pairs (QPs) are required when using E810-CQDA2.

Description

Unable to reach the max bandwidth speed of a single RDMA QPS with E810-CQDA2.

Resolution

The E810s cannot reach the max bandwidth speed of a single RDMA QPS (queue pairs) in either iWARP or RoCEv2 mode.Columbiaville is designed to deliver best performance using multiple QPs and unfortunately we cannot reach max bandwidth with a single QP. 

Excerpt from irdma README:

-----------

Performance

-----------

RDMA performance may be optimized by adjusting system, application, or driver

settings.

- Flow control is required for best performance in RoCEv2 mode and is optional

in iWARP mode. Both link-level flow control (LFC) and priority flow control

(PFC) are supported, but PFC is recommended. See the "Flow Control Settings"

section of this document for configuration details.

- For bandwidth applications, multiple queue pairs (QPs) are required for best

performance. For example, in the perftest suite, use "-q 8" on the command

line to run with 8 QP.​

Related Products

This article applies to 1 products