The main function
- 7U NVIDIA HGX HGX H100 8 GPU server is equipped with a dual -generation 4th generation Intel Xeon scalable processor, specially created for large -scale AI and HPC applications. Buy)
- Special designed for generating AI, optimized server design, coupled with LLM consulting services and AI infrastructure development of AI integrated AI
- NVIDIA®HGX H100 is equipped with 8 Tensor Core GPU to implement AI/HPC workload
- Double generation Intel® Xeon® Expansion processor, support 350W TDP
- Provide 900GB/s bandwidth of 900GB/s through NVLINK to GPU to achieve efficient expansion
- With independent CPU and GPU airflow design, more energy -saving
- The network interface card (NIC) and storage are close to the GPU, the ratio of GPU to NIC is 1: 1, NVIDIA GPUDIRECT Storage design can reduce read/write delay
- 4+2 or 3+3000W 80 Plus® Titanium power supply reduces operating costs
- ASUS ASMB11-IKVM and ASPEED AST2600 Controller to implement external management
End -to -end AI supercomputing platform
NVIDIA HGX H100 8-GPU server
support PCIe 5.0
Fast storage, graphics and network functions



900GB/s bandwidth
Direct GPU to the GPU interconnection through NVLINK
PCIe 5.0 The exchange board can provide faster connections between storage, graphics and NIC
10 NVMe storage
- 8 Front panel
- 2 Back plate
Modular and tool design
With skateboard design and handle
Independent air flow channel design
With a dual rotor fan module


10 X Fan (80x80) supports NVIDIA HGX H100 8-GPU substrate
2 x 10Gb LAN Mesh
1 x Management interface
1 x Positioning button
1 x Port80 Q code
1 x VGA interface
4 x USB3.2 Gen1 interface
1 x Power button
8 x 2.5" NVMe
(PCIe switch)


8x PCIe Gen5 x16, HHHL (LP) (PCIe Switch)
GPU Sled
(4U)
CPU Sled
(3U)
2x 2.5” NVMe (CPU2)
/SATA (PCH)/SAS*
1x Positioning button
1x Power button
4+2 3000W 54V CRPS PSU
1x PCIe Gen5 x16,
FHHL 或 OCP 3.0 (CPU1)
1x PCIe Gen5 x16,
FHHL (CPU2)


8x PCIe Gen5 x16, HHHL (LP) (PCIe Switch)
GPU Sled
(4U)
CPU Sled
(3U)
2x 2.5” NVMe (CPU2)
/SATA (PCH)/SAS*
1x Positioning button
1x Power button
4+2 3000W 54V CRPS PSU
1x PCIe Gen5 x16, FHHL or
OCP 3.0 + 1 x PCIe Gen4 x8,
FHHL (CPU1)
1x PCIe Gen5 x16, FHHL
+ 1 x PCIe Gen4 x8, FHHL
(CPU2)
Modular design to reduce cable use
Easy failure exclusion and heat dissipation optimization

Advanced NVIDIA technology
Release the potential of NVIDIA GPU, DPU, NVLINK, NVSWITCH
Sustainability
Keep your data center green and high -quality development
Comprehensive liquid cooling solution
Better data center energy efficiency
-
One -stop rack support solution combined with complete installation and testing
-
For server verification for specific liquid cooling solutions
-
Work closely with industry cooling solutions suppliers
Optimize cooling design
Independent CPU and GPU airflow channels
4+2 or 3+3 power supply
High -level power efficiency


Serviceability
Improve IT operation efficiency
-
The handle design of ergonomics
-
Getting -free thumb screw
-
Riser card lock
-
LED Status Indicator
-
Pre -baffle protection
-
Tool cover
manage
Comprehensive IT infrastructure solution
BMC
Remote server management

IT Infrastructure management software
Simplify IT operations through a single instrument board

Hardware trust root solution
Detect, restore, start and protect
* Platform firmware flexibility (PFR) module must be specified at the time of ordering and installed in the original factory, and it is not sold separately.

performance
The fourth -generation Intel® Xeon® Scalable processor

* The usability of the accelerator varies from SKU. For more product information, please visit Intel Product Specification pageLearn more.
-
Processor / system bus
2 x Socket
Intel® Xeon® Processor Scalable Family (Up to 350W) -
Memory
Total Slots:
32 (8 channel per CPU, 16 DIMM per CPU)
Capacity:
Maximum up to 4TB per CPU socket
Memory Type:
DDR5 4800/4400 RDIMM/ 3DS RDIMM (2DIMM per Channel)
512GB, 256GB, 128GB Intel® Optane™ persistent memory 300 series (Crow Pass)
Memory Size:
64GB, 32GB, 16GB RDIMM
256GB, 128GB RDIMM 3DS
* Refer to support page for more information -
Extended slot
SKU1:
10 + 1 x PCIe Gen5 slots (1 x internal RAID card)
[PCIe Switch directly]- 8 x PCIe Gen5 x16 link (LP, HL)
[CPU directly]
- 1 x PCIe Gen5 x16 link (FH, HL)* + 1 x PCIe Gen5 x16 link (FH, HL)*
SKU2 (Launch in 2023Q4)
12 x PCIe Gen5 slots
[PCIe Switch directly]
- 8 x PCIe Gen5 x16 link (LP, HL)
[CPU directly]
- 1 x PCIe Gen5 x16 link (FH, HL)* + 1 x PCIe Gen5 x16 link (FH, HL)*
- 1 x PCIe Gen5 x8 link (FH, HL) + 1 x PCIe Gen5 x8 link (FH, HL)
*Support BlueField2 DPU or BlueField3 DPU with double deck/extension -
Storage function (depends on delivery)
Optional Kits:
-Broadcom MegaRAID 9560-16i
-Broadcom MegaRAID 9540-8i -
Disk
10 x 2.5” hot-swap drive bays (8 NVMe, 2 NVMe/SATA/SAS*)
[PCIe Switch directly]
Front: 8 NVMe
[CPU directly]
Rear: 2 NVMe(CPU2)/SATA(PCH)/SAS*
2 x M.2 Gen5 x4 link (CPU1) / 2 x M.2 Gen3 x2 link (PCH)
*SAS support required an HBA/RAID card. -
Network (depends on delivery)
2 x 10 Gigabit LAN ports (Intel X710-AT2 Controller)
1 x Management Por -
Support multi -graphics card
Please find the latest GPU support from https://servers.asus.com/support/gpu -
Front I/O interface
4 x USB3.2 Gen1 ports
1 x VGA port
2 x 10Gb RJ45 LAN module (Intel-x710 Based)
1 x Mgmt LAN
1 x locate button
1 x power button -
Rear I/O interface
1 x locate button
1 x power button -
switch/LED
Front :
1 x Power Button/LED
1 x Location Button/LED
1 x Message LED
1 x Q-Code/Port 80 LED
Rear :
1 x Location LED
1 x Power Button/LED -
Support operating system
Please find the latest OS support from https://servers.asus.com/support/os
-
Management function
ASUS Control Center
ASUS ASMB11-iKVM (on-board) -
Compliance certification
BSMI, CB, CE, FCC, KCC -
Appearance size
885mm x 447mm x 306.65mm -
Dimensions
7U -
weight
Net Weight: 99 Kg.
Gross Weight: 154 Kg. -
power
4+2 or 3+3 Redundant 3000W 80 PLUS Titanium Power Supply -
environment
Operation temperature: 10℃ ~ 35℃
Non operation temperature: -40℃ ~ 70℃
Non operation humidity: 20% ~ 90% ( Non condensing)
- The product specifications may change in the regional or product batches. We recommend that you consult the seller in detail when buying.
- Product pictures and colors may be due to the light errors and screen settings of camera, and it may be different from the effect of the physical product. Please refer to the physical object.
- The product information, specification parameters, applications, product pictures and product characteristics mentioned on this website are for reference only. The content may be updated and revised at any time without notice.
- PCB boards may be slightly different from the product batch. If there is a change, it will not be notified separately.
- The name of the product name mentioned on this website is only used for identification, and these names may be registered trademarks or copyrights of other companies.
- Word HDMI, HDMI High-Definition Multimedia Interface (high-definition multimedia interface), HDMI business appearance and HDMI logo are all HDMI Licensing Administrator, Inc..
- The information included is the general test result, for reference only. Please consult local sales representatives to get more information.