xAI Power Up Colossus 2 Supercomputer with 200,000 NVIDIA H100 GPUs in Memphis

The World's Most Powerful AI Cluster

xAI has officially powered up Colossus 2, an expanded supercomputing cluster located in Memphis, Tennessee. The system now features 200,000 NVIDIA H100 GPUs connected via a single unified network fabric, establishing it as the most powerful AI training environment in existence.

Infrastructure and Scale

Network Throughput: Custom network architectures connect the 200,000 GPUs, allowing for massive parallel training jobs with minimal latency.

Power Substation Integration: xAI collaborated with local utility providers to secure direct high-voltage power feeds to sustain the system's operational load.

Grok 3 Training: The expanded cluster is already dedicated to training xAI's next-generation Grok 3 model suite, scheduled for release in late 2026.

Musk highlighted that Colossus 2 went from initial planning to full power activation in under six months, demonstrating unprecedented infrastructure deployment speeds.

xAI Power Up Colossus 2 Supercomputer with 200,000 NVIDIA H100 GPUs in Memphis

The World's Most Powerful AI Cluster

Infrastructure and Scale

Vetted News References

# Pulse Discussion0