GPUYard

  If you are running large-scale AI training or inference workloads in 2026, one technology separates the systems that truly scale from those that merely pretend to: NVLink 5.0 on NVIDIA Blackwell GPU servers. Most guides on this topic stop at "NVLink is fast." That is not enough. If you are provisioning, configuring, or operating a Blackwell-based GPU server, you need to understand the full picture: how the hardware topology actually works, how to configure NCCL and IMEX correctly, and how to avoid the operational pitfalls that burned early adopters. Key Takeaways You Need to Know: Massive Bandwidth: NVLink 5.0 delivers 1.8 TB/s bidirectional bandwidth per GPU. The "One Massive GPU" Topology: The GB200 NVL72 rack connects 72 GPUs in a single flat NVLink domain with 130 TB/s aggregate bandwidth. The Bandwidth Cliff: Crossing an NVLink domain boundary without proper topology-aware scheduling causes a severe bandwidth drop from ~800+ GB/s to roughly 100–200 GB/s. H...

  For years, the autonomous vehicle (AV) industry operated on a simple rule: the more proprietary your AI stack, the bigger your competitive moat. NVIDIA just challenged that assumption head-on at GTC Taipei 2026. With the launch of Alpamayo 2 Super —a 32-billion-parameter open reasoning Vision Language Action (VLA) model—NVIDIA is betting that an open-source ecosystem will accelerate Level 4 autonomy faster than any closed-loop approach ever could. If you are an AV developer, machine learning researcher, or infrastructure engineer, this release completely rewrites your development roadmap. 5 Core Upgrades Under the Hood Alpamayo 2 Super isn't just a minor iteration; it triples the scale of previous 10B models and introduces deep reasoning capabilities directly into the perception loop: 3× Parameter Scale (32B): Built on NVIDIA Cosmos, delivering vastly superior 3D spatial understanding and long-tail scenario handling. 360° Surround Perception: Expands from front-focused camera c...