Table 2. Observed bandwidths (in Gb s−1) from RNIC to CPU memory using RDMA.
The RoCE implementations use the RNIC capabilities efficiently. The SEND API is similar to a stream transfer. The WRITE API specifies, in addition, the destination memory address. The RAW API does not require a specific packet format.
| Packet size (bytes) | RoCE-v2 SEND | RoCE-v2 WRITE | RDMA RAW | 
|---|---|---|---|
| 2048 | 94.5 | 95.2 | 33.3 | 
| 4096 | 97.6 | 97.5 | 60.5 | 
| 8246 | N/A† | N/A† | 99.1 | 
RoCE maximum payload (MTU) is 4096.