T4 Cloud GPU Pricing

About the T4

The NVIDIA T4 is the original inference-optimized datacenter GPU and remains one of the most widely deployed accelerators in cloud infrastructure. Its 70W power draw and single-slot PCIe form factor make it trivially easy to provision at scale. While outperformed by every newer GPU, the T4 still handles production inference for INT8-quantized models efficiently, and its ubiquity means rock-bottom pricing.

Key Specifications

Cloud Pricing Context

T4 pricing starts as low as $0.27/hr on budget providers and about $0.35/hr on Google Cloud. Its low TDP keeps per-instance costs minimal. The T4 is often the default GPU for inference endpoints on managed ML platforms like Vertex AI and SageMaker.

Best For

• Production inference for INT8/FP16 models under 7B parameters
• Cost-sensitive batch processing and embedding generation
• Always-on inference endpoints where low power draw reduces TCO
• Entry-level GPU workloads on managed ML platforms

Available From

Related GPUs

Compare Providers