A30 Tensor Core GPU Specifications |
|
FP64 |
5.2 teraFLOPS |
FP64 Tensor Core |
10.3 teraFLOPS |
FP32 |
10.3 teraFLOPS |
TF32 Tensor Core |
82 teraFLOPS | 165 teraFLOPS* |
BFLOAT16 Tensor Core |
165 teraFLOPS | 330 teraFLOPS* |
FP16 Tensor Core |
165 teraFLOPS | 330 teraFLOPS* |
INT8 Tensor Core |
330 TOPS | 661 TOPS* |
INT4 Tensor Core |
661 TOPS | 1321 TOPS* |
Media engines |
1 optical flow accelerator (OFA) 1 JPEG decoder (NVJPEG) 4 video decoders (NVDEC) |
GPU memory |
24GB HBM2 |
GPU memory bandwidth |
933GB/s |
Interconnect |
PCIe Gen4: 64GB/s Third-gen NVLINK: 200GB/s** |
Form factor |
Dual-slot, full-height, full-length (FHFL) |
Max thermal design power (TDP) |
165W |
Multi-Instance GPU (MIG) |
4 GPU instances @ 6GB each 2 GPU instances @ 12GB each 1 GPU instance @ 24GB |
Virtual GPU (vGPU) software support |
NVIDIA AI Enterprise NVIDIA Virtual Compute Server |