Server`s milestone

The arrival of 5G networks, the continuous evolution of ARM architecture, and the miniaturization of specialized solutions have caused a rise of a very interesting idea of edge computing - Smart NIC.

None of the above is new, even Smart NIC existed previously. Simply with less functional - just Ethernet and TCP/IP offload or intelligent NIC aimed to provides features as RoCE or DPDK. But now, with interest in edge computing and 5G attention increases interest in developing Smart NIC solutions.

Of the three existing technologies - ASIC, FPGA, and SoC - the most flexible and “democratic” option is the latter.

AWS uses a homemade Smart NIC solution for several years, gradually improving and expanding the functionality of the solution. Presented in 2013, first-generation ASIC offloaded block storage-related tasks from the CPU, progressed to Project Nitro — a full-fledged board for network management, block disks, security, and even hypervisor.

On the other side, VMware for several years promised to migrate its hypervisor to the ARM platform, and finally, it happened on VMworld 2020. The release of the leading virtualization platform on the ARM platform opens new horizons to absolutely everyone, and the benefits are huge.

For example, AWS thanks to Project Nitro able to sell an additional ~30% of the server previously reserved for management purposes (basically cloud overhead). VMware itself has NSX and VSAN — SDN and SDS solutions, respectively. Offload service overhead or implementation of GENEVE on any Smart NIC will significantly reduce the costs of the hardware due to lower service workloads.

vSphere on ARM is a very interesting release a new ground for a bright future and enabler of hybrid clouds promised for so many years. And more important it will pave the widespread way for Smart NIC, not just some specialized niches. Honestly saying, now, Smart NICs were used either for NFV (classic ASIC) or in black boxes (AWS Outpost) and are little understood or used by a general business.