← LIVE TERMINALALL EDITIONSRIVALS SECTION

GPU Dispatch · 2026-W34

DISPATCH 2026-W34 · published 8/23/2026 UTC

Microsoft begins Vera Rubin install; NVIDIA publishes Rubin GPU architecture deep-dive; B200/B300 still OEM HGX baseline

UPDATED

This week NVIDIA publicly congratulated Microsoft on reaching a Vera Rubin installation milestone (Aug 21), marking large-scale cloud deployment after earlier partner ramps. NVIDIA's developer blog documents Rubin GPU architecture: up to 288 GB HBM4 at 22 TB/s, ~50 PFLOPS NVFP4, NVLink 6, and NVL72 rack-scale. HGX B200/B300 remain the shipping OEM HGX baseline; H200 stays the Hopper HBM3e path.

NVDA ecosystem — weekly dispatch (2026-W34)

### Material change this week

Microsoft Vera Rubin installation — On 2026-08-21, NVIDIA publicly marked Microsoft reaching a Vera Rubin deployment milestone (NVIDIA social / trade coverage). Treat this as confirmation that hyperscaler installation is underway for NVL72-class systems — still allocation-gated, not broad OEM-channel GA for every enterprise buyer.

Rubin architecture documentation — NVIDIA's technical blog *Inside NVIDIA Rubin GPU Architecture* publishes GPU-level specs useful for engineering comparisons:

  • Up to 288 GB HBM4 with up to 22 TB/s peak bandwidth (12-Hi stacks)
  • Up to 50 petaflops NVFP4 via third-generation Transformer Engine
  • 336B transistors, 224 SMs, 896 Tensor Cores; dual compute dies linked by NV-HBI
  • NVLink 6 scale-up (3,600 GB/s to NVLink Switch), NVLink-C2C 1,800 GB/s, PCIe Gen6 x16
  • Vera Rubin NVL72 rack: cable-free MGX trays, liquid cooling, hot-swappable NVLink switch trays
  • NVIDIA claims up to 10× agentic throughput per unit energy vs Blackwell (vendor/internal workload)

NVIDIA's 2026-05-31 newsroom release remains the primary official production statement (full production ramp; production shipments starting this fall).

### What remains the practical OEM / fleet baseline

HGX B200 — Eight Blackwell SXM GPUs, 1.4 TB aggregate GPU memory, 5th-gen NVLink (1.8 TB/s GPU-to-GPU, 14.4 TB/s total), up to 108 PFLOPS FP4 sparse at the 8-GPU system level.

HGX B300 (Blackwell Ultra) — Shipping alongside B200: eight Blackwell Ultra SXMs, 2.1 TB total memory, NVLink-5, 144 PFLOPS FP4 sparse at system level.

H200141 GB HBM3e at 4.8 TB/s, up to 700W configurable TDP (SXM).

GB200 / Grace Blackwell — Module/rack-scale NVL for fleets without a Vera Rubin allocation.

### Supply chain

Rubin depends on TSMC advanced packaging and HBM4 from Samsung, SK Hynix, and Micron. Ecosystem news continues to stress HBM capacity buildouts — operational constraint context only. See the live supply-chain graph (F3).

---

Technical research for informational purposes only. Not financial advice. No investment recommendations. Specs sourced from vendor documentation; verify before engineering or procurement decisions.

ANALYSIS

Rubin moved from 'racks at partners' to named hyperscaler install milestones plus official architecture docs. For fleets without allocation, B200/B300 and H200 remain the planning baseline.

[NVIDIA: Inside Rubin GPU architecture][NVIDIA Vera Rubin platform page][NVIDIA: Vera Rubin full production (2026-05-31)][KOCPC: Microsoft Vera Rubin installation (Aug 21)][NVIDIA HGX B200/B300][NVIDIA H200]

Helios/MI455X still in production awaiting late-Q3 shipments; MI355X remains catalog CDNA4 baseline

NO MATERIAL CHANGE

No new AMD SKU launch this ISO week. Helios remains in full production per AMD's July 23 launch, with trade coverage still pointing to initial shipments end of Q3 2026 and ramp in Q4. MI355X (288 GB HBM3E) stays our catalog shipping SKU. Samsung HBM4/HBM4E continues to gate next-gen rack memory supply.

Rivals — weekly dispatch (2026-W34)

### Quiet on new AMD silicon this week

No new Instinct SKU or Helios datasheet revision material to our catalog. Carry forward:

  • MI455X / Helios — AMD launch blog (2026-07-23): 432 GB HBM4, ~23.3 TB/s memory bandwidth, ~40 PF FP4, 72-GPU Helios rack with EPYC Venice + Pensando/UALoE. Status: in production; shipments expected end of Q3, broader ramp Q4 / into 2027 (AMD + trade coverage).
  • Catalog note: MI455X is still not in `gpu_products`. Shipping baseline remains MI355X.

### AMD Instinct (current catalog)

MI355X288 GB HBM3E, 8 TB/s, CDNA4, 1400W TBP, OAM / UBB 2.0. Still the open-ecosystem HBM3E density play for fleets not on Helios allocation.

MI325X — 256 GB HBM3e refresh of the MI300 line.

Software — ROCm (including the Aug 4 CDNA5/Helios developer blog) remains the adoption variable versus CUDA.

### Samsung HBM

Samsung's HBM page lists HBM4E (up to 64 GB / 16H, up to 4 TB/s), HBM4, and HBM3E (up to 36 GB 12H, up to 1,180 GB/s per stack). HBM4 feeds Rubin/Helios; HBM4E is the next-stack roadmap.

### Huawei Ascend

Ascend 910B/910C remain the China-domestic path under export-control constraints.

---

Technical research for informational purposes only. Not financial advice. No investment recommendations. Specs sourced from vendor documentation; verify before engineering or procurement decisions.

ANALYSIS

Honest quiet week on AMD launches. Rivalry is still rack-scale HBM4 (Helios vs Vera Rubin) vs shipping catalog SKUs (MI355X vs B200). Watch late-Q3 Helios shipment confirmation.

[AMD Helios launch blog (2026-07-23)][DCD: Helios production / late-Q3 shipments][AMD Instinct MI355X][Samsung HBM][Huawei Ascend 910B]

Model spotlights

B200-SXM-192GB

Reference shipping Blackwell GPU on HGX B200 while Vera Rubin installs ramp at hyperscalers.

  • 192 GB HBM3e per GPU (catalog)
  • HGX B200: 1.4 TB total memory across 8 GPUs
  • 5th-gen NVLink — 1.8 TB/s GPU-to-GPU
  • FP4/MX formats on Blackwell Tensor Cores
ANALYSIS

Validate power/cooling at HGX/MGX system level.

GB200-SUPERCHIP

Grace + Blackwell module for NVL racks — current AI-factory unit of sale without Vera Rubin allocation.

  • 384 GB aggregate HBM3e per superchip module (catalog)
  • Grace CPU for host-side data movement
  • NVL72/NVL36 with NVLink fabric
ANALYSIS

Procurement is system/module level — cooling and fabric dominate TCO.

H200-SXM-141GB

First HBM3e Hopper GPU — pragmatic upgrade from H100 without Blackwell/Rubin retool.

  • 141 GB HBM3e at 4.8 TB/s
  • Up to 3,958 TFLOPS FP8 sparse (H200 SXM)
  • Up to 700W configurable TDP (SXM)
  • 900 GB/s NVLink; MIG up to 7 instances
ANALYSIS

Validate published LLM throughput on your model size and batching.

MI355X-OAM-288GB

Catalog AMD flagship (CDNA4 / HBM3E) until MI455X/Helios ship into channels (late-Q3 language).

  • 288 GB HBM3E at 8 TB/s peak
  • CDNA4; 1400W TBP; OAM / UBB 2.0
  • Successor: MI455X 432 GB HBM4 + Helios 72-GPU rack (not catalogued)
ANALYSIS

ROCm readiness remains the gating item vs CUDA fleets.

SAMSUNG-HBM3E-12H

HBM stacks gate every accelerator generation — HBM3E today, HBM4 for Rubin/Helios, HBM4E next.

  • HBM3E: up to 36 GB (12H), up to 1,180 GB/s per stack
  • HBM4: up to 3,300 GB/s, 36 GB
  • HBM4E: up to 64 GB / 16H, up to 4 TB/s (Samsung HBM page)
ANALYSIS

HBM capacity remains the shared bottleneck across NVIDIA and AMD rack ramps.

Comparison matrix

DimensionB200-SXM-192GBH200-SXM-141GBMI355X-OAM-288GBASCEND-910B
GPU memory (GB)19214128864
Memory bandwidth (GB/s)800048008000
Memory typeHBM3eHBM3eHBM3EHBM2e
ArchitectureBlackwellHopperCDNA4Ascend
TDP / TBP (W)10007001400400
Form factorSXMSXMOAMOAM
ANALYSIS

Matrix stays on catalog SKUs. Rubin (288 GB HBM4) and MI455X (432 GB HBM4) are covered in briefs until those SKUs are catalogued.

[NVIDIA HGX B200][NVIDIA H200][AMD MI355X][Huawei Ascend 910B]