Mô tả
The World’s Proven Choice for Enterprise AI
NVIDIA DGX H100 powers business innovation and optimization. Part of the DGX platform and the latest iteration of NVIDIA’s legendary DGX systems, DGX H100 is the AI powerhouse that’s the foundation of NVIDIA DGX SuperPOD™, accelerated by the groundbreaking performance of the NVIDIA H100 Tensor Core GPU. The system is designed to maximize AI throughput, providing enterprises with a highly refined, systemized, and scalable platform to help them achieve breakthroughs in natural language processing, recommender systems, data analytics, and much more. Available on-premises and through a wide variety of access and deployment options, DGX H100 delivers the performance needed for enterprises to solve the biggest challenges with AI
→ Giới thiệu chi tiết NVIDIA DGX H100
SPECIFICATIONS
GPUs
8x NVIDIA H100 Tensor Core GPUs
GPU Memory
640GB total
Performance
- 32 petaFLOPS FP8
CPU
- Dual Intel® Xeon® Platinum 8480C Processors
- 112 Cores total, 2.00 GHz (Base), 3.80 GHz (Max Boost)
NVIDIA NVSwitches
4
System Power Usage
10.2kW max
System Memory
2TB
Networking
- 4x OSFP ports serving 8x single-port NVIDIA ConnectX-7 VPI
- 400Gb/s InfiniBand/Ethernet
- 2x dual-port NVIDIA ConnectX-7 VPI
- 1x 400Gb/s InfiniBand
- 1x 200Gb/s Ethernet
Management Network
- 10Gb/s onboard NIC with RJ45
- 50Gb/s Ethernet NIC
- Host baseboard management controller (BMC) with RJ45
Storage
Software
- NVIDIA AI Enterprise – Optimized AI software
- NVIDIA Base Command – Orchestration, scheduling, and cluster management
- DGX OS / Ubuntu / Red Hat Enterprise Linux / Rocky – Operating System
System Weight
287.6lbs (130.45kgs)
System Dimensions
- Height: 14.0in (356mm)
- Width: 19.0in (482.2mm)
- Length: 35.3in (897.1mm)
Packing System Weight
315 lbs (143kgs)
Thông số kỹ thuật Máy chủ trí tuệ nhân tạo NVidia DGX H100
Server | |
CPU | 2 x Intel Xeon Platinum 8480C |
RAM | 32 x DIMM; 2TB total; |
M.2 Interface | 2 |
Storage | OS: 2x 1.92TB NVMe M.2; Storage: 8x 3.84TB NVMe U.2; |
Form Factor | 8U |
Network Interface | 4x OSFP ports (8x single-port ConnectX-7 VPI); 2x dual-port QSFP112 ConnectX-7 VPI; |
Power Supply | 6 x 3300W |
Redundant Power | Yes |
GPU | 8 x NVIDIA H100 Tensor Core GPUs, 640GB total memory |
Operating System | DGX OS / Ubuntu / Red Hat Enterprise Linux / Rocky |