TY - GEN
T1 - OS4C
T2 - 17th IEEE International Conference on Cloud Computing, CLOUD 2024
AU - Smith, Scott
AU - Ma, Yuan
AU - Lanz, Marissa
AU - Dai, Bill
AU - Ohmacht, Martin
AU - Sukhwani, Bharat
AU - Franke, Hubertus
AU - Kindratenko, Volodymyr
AU - Chen, Deming
N1 - This work was supported from the AMD-Xilinx Center of Excellence, the AMD Heterogeneous Accelerated Compute Cluster Program, and the IBM-Illinois Discovery Accelerator Institute. OS4C would not have been possible without them.
PY - 2024
Y1 - 2024
N2 - Smart network interface cards (SmartNICs) are programmable network cards that enable the flexible offloading of network- and application-level functionality. The last several years have seen a significant rise in research related to smart, programmable NICs. Meanwhile, several open-source FPGA-based NIC and networking projects have emerged. However, these projects lack many key features necessary for strong performance in cloud settings. We identify Single Root In-put/Output Virtualization (SR-IOV) as one of the key missing features in these open-source implementations. SR-IOV enables cloud vendors to grant cloud tenants direct access to hardware resources, dramatically reducing the software overheads of device virtualization. We present OS4C, which extends the popular open-source NIC Corundum [1] with support for SR-IOV. We demonstrate that OS4C can improve virtual machine P99.9 network tail latency by up to 17x, throughput by up to 4x, and CPU effort by up to 3.9x compared to software virtualization. On top of this system, we provide a novel weighted round-robin scheduler that enables tenants and providers to control weight distributions and overhaul the Corundum simulation framework to support multi-tenant tests and performance insights.
AB - Smart network interface cards (SmartNICs) are programmable network cards that enable the flexible offloading of network- and application-level functionality. The last several years have seen a significant rise in research related to smart, programmable NICs. Meanwhile, several open-source FPGA-based NIC and networking projects have emerged. However, these projects lack many key features necessary for strong performance in cloud settings. We identify Single Root In-put/Output Virtualization (SR-IOV) as one of the key missing features in these open-source implementations. SR-IOV enables cloud vendors to grant cloud tenants direct access to hardware resources, dramatically reducing the software overheads of device virtualization. We present OS4C, which extends the popular open-source NIC Corundum [1] with support for SR-IOV. We demonstrate that OS4C can improve virtual machine P99.9 network tail latency by up to 17x, throughput by up to 4x, and CPU effort by up to 3.9x compared to software virtualization. On top of this system, we provide a novel weighted round-robin scheduler that enables tenants and providers to control weight distributions and overhaul the Corundum simulation framework to support multi-tenant tests and performance insights.
KW - Cloud Networking
KW - Device Vir-tualization
KW - FPGAs
KW - Network Virtualization
KW - Open-Source
KW - SmartNIC
UR - http://www.scopus.com/inward/record.url?scp=85203252198&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85203252198&partnerID=8YFLogxK
U2 - 10.1109/CLOUD62652.2024.00048
DO - 10.1109/CLOUD62652.2024.00048
M3 - Conference contribution
AN - SCOPUS:85203252198
T3 - IEEE International Conference on Cloud Computing, CLOUD
SP - 365
EP - 375
BT - Proceedings - 2024 IEEE 17th International Conference on Cloud Computing, CLOUD 2024
A2 - Chang, Rong N.
A2 - Chang, Carl K.
A2 - Yang, Jingwei
A2 - Atukorala, Nimanthi
A2 - Jin, Zhi
A2 - Sheng, Michael
A2 - Fan, Jing
A2 - Fletcher, Kenneth
A2 - He, Qiang
A2 - Kosar, Tevfik
A2 - Sarkar, Santonu
A2 - Venkateswaran, Sreekrishnan
A2 - Wang, Shangguang
A2 - Liu, Xuanzhe
A2 - Seelam, Seetharami
A2 - Narayanaswami, Chandra
A2 - Zong, Ziliang
PB - IEEE Computer Society
Y2 - 7 July 2024 through 13 July 2024
ER -