Unprecedented Acceleration for World’s Highest-Performing Elastic Data Centers
The NVIDIA A100 80GB Tensor Core GPU delivers unprecedented acceleration—at every scale—to power the world’s highest performing elastic data centers for AI, data analytics, and high-performance computing (HPC) applications. As the engine of the NVIDIA data center platform, A100 provides up to 20x higher performance over the prior NVIDIA Volta generation. A100 can efficiently scale up or be partitioned into seven isolated GPU instances, with Multi-Instance GPU (MIG) providing a unified platform that enables elastic data centers to dynamically adjust to shifting workload demands.
A100 is part of the complete NVIDIA data center solution that incorporates building blocks across hardware, networking, software, libraries, and optimized AI models and applications from NGC. Representing the most powerful end-to-end AI and HPC platform for data centers, it allows researchers to deliver real-world results and deploy solutions into production at scale, while allowing IT to optimize the utilization of every available A100 GPU.
FP64 9.7 TFLOPS
FP64 Tensor Core 19.5 TFLOPS
FP32 19.5 TFLOPS
TF32 Tensor Core 156 TFLOPS | 312 TFLOPS*
BFLOAT16 Tensor Core 312 TFLOPS | 624 TFLOPS*
FP16 Tensor Core 312 TFLOPS | 624 TFLOPS*
INT8 Tensor Core 624 TOPS | 1248 TOPS*
INT4 Tensor Core 1248 TOPS | 2496 TOPS*
Thermal Solutions Passive
vGPU Support NVIDIA Virtual Compute Server (vCS)
System Interface PCIE 4.0 x16
Maximum Power Consumption 300 W
| CUDA Cores | 6912 |
| Streaming Multiprocessors | 108 |
| Tensor Cores | Gen 3 | 432 |
| GPU Memory | 80GB HBM2e ECC on by Default |
| Memory Interface | 5120-bit |
| Memory Bandwidth | 1555 GB/s |
| NVLink | 2-Way, 2-Slot, 600 GB/s Bidirectional |
| MIG (Multi-Instance GPU) Support | Yes, up to 7 GPU Instances |
| FP64 | 9.7 TFLOPS |
| FP32 | 19.5 TFLOPS |
| TF32 Tensor Core | 156 TFLOPS | 312 TFLOPS* |
|
Data Center Class Reliability Designed for 24 x 7 data center operations and driven by power-efficient hardware and components selected for optimum performance, durability, and longevity. Every NVIDIA H100 board is designed, built and tested by NVIDIA to the most rigorous quality and performance standards, ensuring that leading OEMs and systems integrators can meet or exceed the most demanding real-world conditions. |
NVIDIA Hopper ArchitectureNVIDIA A100 is the world's most powerful data center GPU for AI, data analytics, and high-performance computing (HPC) applications. Building upon the major SM enhancements from the Turing GPU, the NVIDIA Ampere architecture enhances tensor matrix operations and concurrent executions of FP32 and INT32 operations. |
Third Generation Tensor CoresPurpose-built for deep learning matrix arithmetic at the heart of neural network training and inferencing functions, the NVIDIA A100 includes enhanced Tensor Cores that accelerate more datatypes (TF32 and BF16) and includes a new Fine-Grained Structured Sparsity feature that delivers up to 2x throughput for tensor matrix operations compared to the previous generation. |
Compare GPUs For Virtualization
NVIDIA virtual GPU (vGPU) software runs on NVIDIA GPUs.
Match your needs with the right GPU below.
| A100 | A30 | L40 | A40 | RTX 6000 | A16 | A2 | |
| GPU Architecture | NVIDIA Ampere | NVIDIA Ampere | NVIDIA Ada Lovelace | NVIDIA Ampere | NVIDIA Ada Lovelace | NVIDIA Ampere | NVIDIA Ampere |
| Memory Size | 80 GB/40 GB HBM2 | 24 GB HBM2 | 48 GB GDDR6 with ECC | 48 GB GDDR6 | 48 GB DDR6 | 64 GB GDDR6 (16 GB per GPU) | 16 GB GDDR6 |
| Virtualization Workload | Highest performance virtualized compute including AI, HPC, and data processing. Includes support for up to 7 MIG instances. Upgrade path for V100/V100S Tensor Core GPUs. | Virtualize mainstream compute and AI inference, includes support for up to 4 MIG instances. Upgrade path for T4. | High-end 3D visualization applications, AI training and inference workloads Upgrade path for Quadro® RTX 8000, Quadro RTX 6000, or T4. | Mid-range to high-end 3D design and creative workflows with NVIDIA RTX® Virtual Workstation (vWS). Upgrade path for Quadro RTX™ 8000, RTX 6000 or T4. | High-end design, real-time rendering, AI, and high-performance compute workflows. Upgrade path for Quadro RTX 6000. | Office productivity applications, streaming video and teleconferencing tools for graphics-rich virtual desktops accessible from anywhere. Upgrade path for M10 or T4. | Space constrained environments or edge deployments of graphics or compute workloads. |
| vGPU Software Support | NVIDIA AI Enterprise | NVIDIA AI Enterprise | NVIDIA RTX vWS, NVIDIA Virtual PC (vPC), NVIDIA Virtual Apps (vApps), NVIDIA AI Enterprise* | NVIDIA RTX vWS, vPC, vApps, NVIDIA AI Enterprise | NVIDIA RTX vWS, vPC, vApps, NVIDIA AI Enterprise* | NVIDIA RTX vWS, vPC, vApps, NVIDIA AI Enterprise | NVIDIA RTX vWS, vPC, vApps |
| CUDA® Cores | 6912 |
|---|---|
| Architecture | NVIDIA Ampere |
| GPU rozwiązania i zastosowanie | NVIDIA Virtual Compute Server (vCS), Visualization and AI, NVIDIA AI Enterprise for VMWare |
| wsparcie VR | n/a |
| chłodzenie grafiki | pasywne serwerowe |
| rodzaj pamięci | HBM3 |
| pamieć karty | 80GB |
| Mocowanie i profil kart | PCIe FHHL/ HHHL |
| Gwarancja | 3 lata |
Konfiguracja
