High-Performance Computing (HPC) Networking Solutions

Cisco DNA / Arista CloudVision® for H100 InfiniBand Solution

Overview

The solution based on the NVIDIA® H100 GPU, integrated with Cisco DNA or Arista CloudVision® management platforms, offers a robust Infiniband network architecture tailored for high-performance computing (HPC). This setup meets various business needs by encompassing the InfiniBand network, management network, and storage network.

InfiniBand Technology

InfiniBand is a high-performance networking technology primarily used in HPC environments, data centers, and enterprise networks.

Purpose: InfiniBand is designed to deliver high-speed data transfer, low latency, and high throughput for communication between servers and storage systems.

In-band Management

In-band management involves using the same network that handles regular data traffic to manage network devices and systems.

Purpose: This method allows administrators to perform tasks such as configuration, monitoring, and troubleshooting over the same network used for normal data communication.

Out-of-band Management

Out-of-band management employs a dedicated management network separate from the regular data network for managing network devices and systems.

Purpose: OOB management provides a separate pathway for management tasks, ensuring that administrators can access network devices even if the primary data network is down.

InfiniBand Network Components

Powered by NVIDIA® H100 GPUs and InfiniBand switches, the InfiniBand network offers ultra-low latency and high bandwidth. It ensures lossless transmission through advanced flow control mechanisms.

S.No Product Equivalents
(1)
  • Cisco: Nexus N9K-C9364C-GX, Nexus 92348GC-X
  • Arista: 7800 R3 Series
(2)
(3)

Management Network

The management network is a critical element for provisioning, monitoring, and troubleshooting HPC infrastructure. Leveraging the NXTGEN transceivers, customers can efficiently manage their HPC systems with reduced operational expenses.

S.No Product Equivalents
(1)
  • Cisco Nexus 93240YC-FX2
  • Arista 7050SX3-48YC12
(2)
  • Cisco WS-C3850-48XS-F-S
  • Arista 7048T-A
(3)
  • Cisco Nexus 9364C
  • Arista 7060CX-64
(4)
  • Cisco Nexus 93180YC-EX
  • Arista 7280SR-48C6
(5)
(6)
(7)

Storage Network

NXTGEN transceivers support the BGP protocol and offer optimal low-latency forwarding, ensuring that storage networks maintain high throughput and efficiency, which are critical for large-scale data center environments.

S.No Product Equivalents
(1)
  • Cisco Nexus 9364C
  • Arista 7060CX-64
(2)

RoCE Computing

For HPC environments, RoCE (RDMA over Converged Ethernet) enables high-speed and lossless communication between computing nodes. NXTGEN transceivers ensure optimal 400G interconnects, improving the efficiency and performance of RoCE networks.

S.No Product Equivalents
(1)
  • Cisco Nexus 9364C
  • Arista 7060CX-64
(2)
  • Cisco Nexus 93240YC-FX2
  • Arista 7050SX3-48YC12
(3)
  • Cisco Nexus 9332C
  • Arista 7060CX-32S
(4)
  • Cisco Nexus 9364D-GX2A
  • Arista 7060DX5-64S
(5)
(6)