Máy chủ trí tuệ nhân tạo NVidia DGX H100

  • Nhà sản xuất: NVIDIA
  • Mã sản phẩm/Part No. TM9193 / DGX H100
  • Tình trạng: Đặt trước
Danh mục: Thẻ:

Mô tả

The World’s Proven Choice for Enterprise AI

NVIDIA DGX H100 powers business innovation and optimization. Part of the DGX platform and the latest iteration of NVIDIA’s legendary DGX systems, DGX H100 is the AI powerhouse that’s the foundation of NVIDIA DGX SuperPOD™, accelerated by the groundbreaking performance of the NVIDIA H100 Tensor Core GPU. The system is designed to maximize AI throughput, providing enterprises with a highly refined, systemized, and scalable platform to help them achieve breakthroughs in natural language processing, recommender systems, data analytics, and much more. Available on-premises and through a wide variety of access and deployment options, DGX H100 delivers the performance needed for enterprises to solve the biggest challenges with AI

Giới thiệu chi tiết NVIDIA DGX H100

Datasheet DGX H100


SPECIFICATIONS

GPUs

8x NVIDIA H100 Tensor Core GPUs

GPU Memory

640GB total

Performance

  • 32 petaFLOPS FP8

CPU

  • Dual Intel® Xeon® Platinum 8480C Processors
  • 112 Cores total, 2.00 GHz (Base), 3.80 GHz (Max Boost)

NVIDIA NVSwitches

4

System Power Usage

10.2kW max

System Memory

2TB

Networking

  • 4x OSFP ports serving 8x single-port NVIDIA ConnectX-7 VPI
  • 400Gb/s InfiniBand/Ethernet
  • 2x dual-port NVIDIA ConnectX-7 VPI
  • 1x 400Gb/s InfiniBand
  • 1x 200Gb/s Ethernet

Management Network

  • 10Gb/s onboard NIC with RJ45
  • 50Gb/s Ethernet NIC
  • Host baseboard management controller (BMC) with RJ45

Storage

  • OS: 2x 1.92TB NVMe M.2
  • 8x 3.84TB NVMe U.2

Software

  • NVIDIA AI Enterprise – Optimized AI software
  • NVIDIA Base Command – Orchestration, scheduling, and cluster management
  • DGX OS / Ubuntu / Red Hat Enterprise Linux / Rocky – Operating System

System Weight

287.6lbs (130.45kgs)

System Dimensions

  • Height: 14.0in (356mm)
  • Width: 19.0in (482.2mm)
  • Length: 35.3in (897.1mm)

Packing System Weight

315 lbs (143kgs)

Thông số kỹ thuật Máy chủ trí tuệ nhân tạo NVidia DGX H100

Server
CPU 2 x Intel Xeon Platinum 8480C
RAM 32 x DIMM; 2TB total;
M.2 Interface 2
Storage OS: 2x 1.92TB NVMe M.2; Storage: 8x 3.84TB NVMe U.2;
Form Factor 8U
Network Interface 4x OSFP ports (8x single-port ConnectX-7 VPI); 2x dual-port QSFP112 ConnectX-7 VPI;
Power Supply 6 x 3300W
Redundant Power Yes
GPU 8 x NVIDIA H100 Tensor Core GPUs, 640GB total memory
Operating System DGX OS / Ubuntu / Red Hat Enterprise Linux / Rocky