Home / H20SXM single card module

H20SXM single card module

Leviathan
H20SXM single card module
H20 SXM is an NVIDIA Hopper architecture SXM5 form data center GPU module, focusing on large model reasoning scenarios, equipped with 96GB HBM3 high-bandwidth graphics memory, graphics memory bandwidth 4.0TB/s, built-in Hopper fourth-generation tensor core and Transformer engine, FP8 computing power 296 TFLOPS, single-card power consumption 400W, support NVLink4 high-speed interconnection, multi-card networking.
$0.00
405 sold
Quantity
  • Detail
    • Architecture: Hopper, the fourth-generation tensmer core, TSMC 4N process

      Graphics memory: 96GB HBM3, graphics memory bandwidth 4.0TB/s

      Calculation power (dense / sparse)

      FP8 / INT8: 296 TFLOPS / 592 TOPS

      BF16 / FP16: 148 TFLOPS / 296 TFLOPS

      TF32: 74 TFLOPS / 148 TFLOPS

      FP32: 44 TFLOPS

      FP64: 1 TFLOPS TikTok Encyclopedia

      Interconnection: NVLink4, one-way 900GB/s; PCIe 5.0, 128GB/s

      Power consumption TDP: 400W

      Form: SXM5 module, HGX carrier board is required, and ordinary motherboard cannot be directly plugged in.

      MIG: Support MIG multi-instance, up to 7 instances

      Cache: L2 Cache 60MB

      Media engine: 7×NVDEC, 7×NVJPEG decoder

      Software: CUDA, NCCL, compatible with Hopper ecology

  • Customer Reviews
    No comments