Multi-core network packet steering

This is an old revision of this page, as edited by FrancioT (talk | contribs) at 07:55, 9 July 2025 (loading the last 2 images). The present address (URL) is a permanent link to this revision, which may differ significantly from the current revision.

Network packet steering of incoming traffic for multi-core architectures is needed in modern network computing environment, especially in data centers, where the high bandwidth and heavy loads would easily congestion a single core's queue.

Simple graph showing the path receiving packets need to travel to reach the cores' queues

For this reason many techniques, both in hardware and in software, are leveraged in order to distribute the incoming load of packets across the cores of the processor.





Hardware techniques

Hardware accelerated techniques like RSS and aRFS are used to route and load balance incoming packets across the multiple cores' queues of a processor.
Those hardware supported methods achieve extremely low latencies and reduce the load on the CPU, as compared to the software based ones. However they require a specialized hardware integrated within the network interface card (NIC) (which could be for example a SmartNIC).

RSS

 
simple view of the receive side scaling architecture

Receive Side Scaling (RSS) [1] [2] [3] [4] [5]





aRFS

 
simple view of the accelerated receive flow steering architecture

Accelerated Receive Flow Steering (aRFS) [6] [7] [8]





Software techniques

Software techniques like RPS and RFS employ one of the CPU cores to steer incoming packets across the other cores of the processor.
The benefits of a software solutions is the ease in implementation, without having to change any component (like the NIC) of the currently used architecture, but by simply deploying the proper kernel module. This benefit can be crucial especially in cases where the server machine can't be customized or accessed (like in cloud computing environment), even if the network performances could be reduced as compared the hardware supported ones.

RPS

 
diagram showing how RPS load balance incoming packets across the CPU cores

Receive Packet Steering (RPS) [9] [10] [11]





RFS

 
diagram showing how the RFS logic distribute each incoming packet to the core running the corresponding application

Receive Flow Steering (RFS) [12] [13] [14] [15]





XPS (in transmission)

Transmit Packet Steering (XPS) [16] [17] [18]

References

  1. ^ "RSS intel doc" (PDF). earn.microsoft.com. Retrieved 2025-07-08.
  2. ^ "RSS overview by microsoft". learn.microsoft.com. Retrieved 2025-07-08.
  3. ^ "RSS by redhat". docs.redhat.com. Retrieved 2025-07-08.
  4. ^ "RSS kernel linux docs". kernel.org. Retrieved 2025-07-08.
  5. ^ Barbette, Tom and Katsikas, Georgios P. and Maguire, Gerald Q. and Kostic, Dejan (2019). "RSS++: load and state-aware receive side scaling". Association for Computing Machinery.{{cite journal}}: CS1 maint: multiple names: authors list (link)
  6. ^ "aRFS by nvidea". docs.nvidia.com. Retrieved 2025-07-08.
  7. ^ "aRFS by redhat". docs.redhat.com. Retrieved 2025-07-08.
  8. ^ "aRFS kernel linux docs". kernel.org. Retrieved 2025-07-08.
  9. ^ "RPS linux news (LWM)". lwn.net. Retrieved 2025-07-08.
  10. ^ "RPS by redhat". docs.redhat.com. Retrieved 2025-07-08.
  11. ^ "RPS kernel linux docs". kernel.org. Retrieved 2025-07-08.
  12. ^ "RFS 1". docs.nvidia.com. Retrieved 2025-07-08.
  13. ^ "RFS by nvidea". docs.nvidia.com. Retrieved 2025-07-08.
  14. ^ "RFS by redhat". docs.redhat.com. Retrieved 2025-07-08.
  15. ^ "RFS kernel linux docs". kernel.org. Retrieved 2025-07-08.
  16. ^ "XPS intel overview". intel.com. Retrieved 2025-07-08.
  17. ^ "XPS linux news (LWM)". lwn.net. Retrieved 2025-07-08.
  18. ^ "XPS kernel linux docs". kernel.org. Retrieved 2025-07-08.