← LIVE TERMINALALL EDITIONSRIVALS SECTION

GPU Dispatch · 2026-W32

DISPATCH 2026-W32 · published 8/3/2026 UTC

NVIDIA confirms Vera Rubin NVL72 racks live at cloud partners; B200/B300 still the OEM HGX baseline

UPDATED

NVIDIA's Vera Rubin blog now states NVL72 production is ramping with racks running at CoreWeave, Google Cloud, Microsoft Azure, Oracle Cloud Infrastructure, and Nebius. CoreWeave reports ~10x tokens/sec per megawatt vs Grace Blackwell NVL72 on DeepSeek-R1 (partner/vendor figures). HGX B200/B300 remain the shipping OEM HGX baseline; H200 stays the Hopper HBM3e workhorse.

NVDA ecosystem — weekly dispatch (2026-W32)

### Material change this week

Official partner confirmation — NVIDIA's Vera Rubin blog states that Vera Rubin NVL72 production is ramping with racks running at partners CoreWeave, Google Cloud, Microsoft Azure, Oracle Cloud Infrastructure, and Nebius, across a supply chain spanning 350+ factory sites in 30 countries. This upgrades last week's press-report framing: the partner-live claim is now on NVIDIA's own blog.

Tokens/MW metric — CoreWeave's first DeepSeek-R1 benchmark on Vera Rubin NVL72, published via NVIDIA, reports ~10x tokens per second per megawatt versus Grace Blackwell NVL72. Treat as a partner/vendor workload result, not an independent audit.

Related NVIDIA posts on the same blog cluster: Google Cloud A5X instances on Vera Rubin NVL72; Nebius receiving first NVL72 systems in Finland; Spectrum-6 / Spectrum-X Ethernet Photonics called out for scale-out.

### What is shipping / generally available today

HGX B200 — Eight Blackwell SXM GPUs, 1.4 TB aggregate GPU memory, 5th-gen NVLink (1.8 TB/s GPU-to-GPU, 14.4 TB/s total), up to 108 PFLOPS FP4 sparse at the 8-GPU system level per NVIDIA's HGX table.

HGX B300 (Blackwell Ultra) — Shipping alongside B200 on NVIDIA's HGX page: eight Blackwell Ultra SXMs, 2.1 TB total memory, NVLink-5, higher FP4 system throughput (144 PFLOPS sparse).

H200141 GB HBM3e at 4.8 TB/s, up to 700W configurable TDP (SXM). Still listed as available for Hopper-generation LLM/HPC memory-bound workloads.

GB200 / Grace Blackwell — Module/rack-scale NVL remains the current AI-factory form factor for fleets not yet on Vera Rubin NVL72 allocation.

### Forward visibility

Vera Rubin remains a rack/POD-scale platform (NVL72 + Vera CPU + NVLink 6 + Spectrum-6 / HBM4), not a drop-in SXM card swap for HGX B200 fleets. Early access is concentrated at named cloud partners; OEM channel breadth is still the open question for enterprise on-prem buyers.

### Supply chain

Blackwell and Rubin platforms depend on advanced packaging (TSMC) and HBM from Samsung, SK Hynix, and Micron. Automated news continues to stress HBM capacity constraints and long-term supply pacts — relevant as deployment bottlenecks, not investment signals. See the live supply-chain graph (F3).

---

Technical research for informational purposes only. Not financial advice. No investment recommendations. Specs sourced from vendor documentation; verify before engineering or procurement decisions.

ANALYSIS

The metric that matters for power-constrained AI factories is shifting to tokens per megawatt. For fleets without a Rubin allocation this quarter, B200/B300 and H200 remain the practical procurement baseline.

[NVIDIA Blog: Vera Rubin partner deployments + CoreWeave benchmark][NVIDIA Newsroom: Vera Rubin full production (2026-05-31)][NVIDIA HGX platform (B200/B300)][NVIDIA H200 GPU]

Helios/MI455X rivalry settles in; MI355X still the catalog CDNA4 SKU; Samsung posts HBM4E

UPDATED

No new AMD SKU launch this ISO week — technical follow-ups on MI455X package (CDNA5 / HBM4 / Helios) continue after the 2026-07-23 launch. MI355X (288 GB HBM3E) remains our catalog shipping baseline. Samsung's HBM page now lists HBM4E (up to 64 GB / 16H, up to 4 TB/s) above HBM4 and HBM3E.

Rivals — weekly dispatch (2026-W32)

### AMD Instinct / Helios (follow-through)

AMD's 2026-07-23 Helios launch remains the rivalry headline versus Vera Rubin NVL72:

  • MI455X: 432 GB HBM4, 23.3 TB/s memory bandwidth, ~40 PF FP4 (AMD Helios materials)
  • Helios: 72 GPUs + EPYC "Venice" + Pensando / UALoE; 31 TB HBM4 rack capacity; 260 TB/s scale-up bandwidth
  • AMD-modeled rack claims vs Vera Rubin NVL72: up to 15% more AI compute, 50% more HBM, 50% more scale-out — vendor figures with footnotes

This week brings technical unpacking (package die stack, CDNA5 / ROCm ecosystem blogs) rather than a new product announcement. Catalog note: MI455X is still not in `gpu_products` — covered in brief only. Shipping catalog SKU remains MI355X (288 GB HBM3E, 8 TB/s, CDNA4, 1400W TBP).

Software — ROCm remains the adoption variable versus CUDA for open-ecosystem fleets.

### Samsung (HBM supply)

Samsung Semiconductor's HBM page now surfaces three generations relevant to AI racks:

  • HBM3E — up to 36 GB (12H), up to 1,180 GB/s per stack (Blackwell / MI355X era)
  • HBM4 — up to 36 GB, up to 3,300 GB/s (Vera Rubin / MI455X era)
  • HBM4E — up to 64 GB (16H), up to 4 TB/s, up to 16 Gbps/pin (roadmap / next-gen stacks)

HBM allocation timelines remain the shared bottleneck across NVIDIA and AMD rack ramps.

### Huawei Ascend

Ascend 910B/910C serve China-domestic deployments under export-control constraints. No material English-language SKU revision surfaced this week.

---

Technical research for informational purposes only. Not financial advice. No investment recommendations. Specs sourced from vendor documentation; verify before engineering or procurement decisions.

ANALYSIS

Rivalry is rack-scale HBM4 (Helios vs Vera Rubin) plus HBM supply depth. Until MI455X is catalogued and channel-available, compare on ROCm readiness and allocation — not brochure FLOPS alone.

[AMD: Helios / MI455X launch (2026-07-23)][AMD ROCm blog: CDNA5 and Helios][AMD Instinct MI355X (catalog baseline)][Samsung HBM (HBM3E / HBM4 / HBM4E)][Huawei Ascend 910B]

Model spotlights

B200-SXM-192GB

Reference shipping Blackwell GPU on HGX B200 while Vera Rubin NVL72 remains partner-allocation-gated for most buyers.

  • 192 GB HBM3e per GPU (catalog)
  • HGX B200: 1.4 TB total memory across 8 GPUs
  • 5th-gen NVLink — 1.8 TB/s GPU-to-GPU
  • FP4/MX formats on Blackwell Tensor Cores
ANALYSIS

Validate power/cooling at HGX/MGX system level — GPU TDP alone does not describe rack deployment.

GB200-SUPERCHIP

Grace + Blackwell module for NVL racks — still the AI-factory unit of sale for fleets not yet on Vera Rubin NVL72.

  • 384 GB aggregate HBM3e per superchip module (catalog)
  • Grace CPU for host-side data movement
  • NVL72/NVL36 configurations with NVLink fabric
  • Comparison baseline in CoreWeave's tokens/MW claims vs Vera Rubin
ANALYSIS

Procurement is system/module level — cooling and fabric dominate TCO.

H200-SXM-141GB

First HBM3e Hopper GPU — pragmatic path from H100 for memory-bound LLM inference without Blackwell/Rubin retool.

  • 141 GB HBM3e at 4.8 TB/s
  • Up to 3,958 TFLOPS FP8 sparse (H200 SXM)
  • Up to 700W configurable TDP (SXM)
  • 900 GB/s NVLink; MIG up to 7 instances
ANALYSIS

Validate NVIDIA's published LLM throughput claims on your model size and batching.

MI355X-OAM-288GB

Current catalog AMD flagship (CDNA4 / HBM3E) until MI455X/Helios land in our catalog and your channel.

  • 288 GB HBM3E at 8 TB/s peak
  • CDNA4; 1400W TBP; OAM / UBB 2.0
  • 2.3 TB aggregate HBM3E on platform materials
  • Successor: MI455X at 432 GB HBM4 (Helios — not yet catalogued)
ANALYSIS

ROCm compatibility remains the gating item for MI355X; Helios adds rack-fabric and HBM4 questions on top.

SAMSUNG-HBM3E-12H

HBM stacks gate every accelerator generation — HBM3E today, HBM4 for Rubin/MI455X, HBM4E now listed on Samsung's product page.

  • HBM3E: up to 36 GB (12H), up to 1,180 GB/s per stack
  • HBM4: up to 3,300 GB/s, 36 GB
  • HBM4E (new on page): up to 64 GB (16H), up to 4 TB/s, up to 16 Gbps/pin
ANALYSIS

HBM4/HBM4E allocation is the shared bottleneck for next-gen rack ramps on both NVIDIA and AMD roadmaps.

Comparison matrix

DimensionB200-SXM-192GBH200-SXM-141GBMI355X-OAM-288GBASCEND-910B
GPU memory (GB)19214128864
Memory bandwidth (GB/s)800048008000
Memory typeHBM3eHBM3eHBM3EHBM2e
ArchitectureBlackwellHopperCDNA4Ascend
TDP / TBP (W)10007001400400
Form factorSXMSXMOAMOAM
ANALYSIS

Matrix stays on catalog SKUs (no MI455X row yet). Rack-scale HBM4 rivalry (Helios vs Vera Rubin) is covered in the briefs until MI455X is catalogued.

[NVIDIA HGX B200][NVIDIA H200][AMD MI355X][Huawei Ascend 910B]