Skip to main content

High-Speed Networking w/ SR-IOV

In this article:​

Overview​

For workloads requiring higher bandwidth between virtual machines, known as inter-VM bandwidth, Hyperstack offers GPU VMs with high-speed networking powered by SR-IOV (Single Root I/O Virtualization) technology. SR-IOV enables a single physical network interface to be shared among multiple VMs, supporting inter-VM bandwidth of up to 350 Gbps, depending on thread count and MTU size. This technology significantly enhances the efficiency and speed of network traffic between VMs and the physical network, achieving near line-rate throughput. The reduced latency in data transfer accelerates AI model training, improves real-time responsiveness, and optimizes GPU utilization for superior overall performance.

note

High-speed networking is available exclusively for VMs with compatible GPUs deployed in network-optimized environments within the CANADA-1 region. These environments are marked by the ⚡ icon in Hyperstack.

To learn how to setup a VM with high-speed networking, click here.

High-speed networking GPUs​

Hyperstack offers NVIDIA GPUs that support high-speed networking, including A100 PCIe with NVLink, H100 PCIe, and H100 PCIe with NVLink. These GPUs utilize SR-IOV technology through the PCIe interface, providing direct, high-speed access to GPU resources while minimizing overhead and latency. The NVLink feature further enhances inter-GPU communication, making these GPUs ideal for network-intensive tasks requiring high throughput and low latency.

Hyperstack GPUs are available in various Flavors—hardware configurations for virtual machines. To learn more about the Flavors featuring these high-speed networking GPUs and choose one that suits your workload, see the following links:

Network-optimized environments​

Virtual machines with network-optimized flavors deployed in legacy CANADA-1 environments have inter-VM bandwidth of up to 125 Gbps. To optimize networking performance for these VMs, follow the instructions below to create a new high-speed networking environment and deploy a network-optimized VM within it, capable of bandwidth up to 350 Gbps.

How to use high-speed networking in Hyperstack​

To take advantage of Hyperstack's high-speed networking with SR-IOV technology, offering inter-VM bandwidth of up to 350 Gbps for compatible flavors, follow these steps:

  1. Create a network-optimized environment:

    a. In Hyperstack, go to the Environments page.

    b. Click Create New Environment.

    • i. Enter a name for the environment.

    • ii. Select the CANADA-1 region, where high-speed networking flavors are available.

    • iii. Click Create Environment.

  2. Deploy a network-optimized VM within a network-optimized environment:

    a. In Hyperstack, go to the VM deployment page by clicking Virtual Machines on the sidebar, then click the Deploy New Virtual Machine button.

    • i. Choose GPU Flavor: Choose a network-optimized Hyperstack flavor, such as A100 with NVLink, H100, or H100 with NVLink.

    • ii. Select Environment: Select a network-optimized environment in the CANADA-1 region, indicated by the ⚡ icon.

    • iii. Select OS Image: Choose Ubuntu Server 22.04 LTS R535 CUDA 12.2 image for your VM's operating system, as high-speed networking is exclusively available with this Ubuntu image.

    • iv. Configure any other VM features as needed.

    b. After configuring your VM as desired, click Deploy.