Beta
Subscribe

Distributed Systems

Articles (3)

Night aerial of three separate data center buildings on dark terrain, one lit cool blue-white, one warm orange, one dimly in the distance, connected by a single glowing indigo fiber-optic line.
AIanalysis

Gigawatt Supercomputers Span Buildings. Scale-Across Networking Has a Benchmark. Heterogeneity Doesn't.

NVIDIA has priced training across 1,000 km; Google trains synchronously across data centers. Missing: what one job pays to span mixed silicon and fabrics.

AI InfrastructureHyperscaler Strategy
SCN Staff·
The VAST Data logo over an intricate three-dimensional lattice of interconnected nodes converging toward a central hub, rendered in silver on a dark purple-black background.
AIanalysis

VAST Data's $30B mark is a bet on the middle layer of AI, not storage

VAST Data closed a $1B Series F at a $30B post-money, 3.3x its 2023 mark and roughly 1.7x Everpure's public cap. Here's what the math and the customer list actually signal.

AI InfrastructureDistributed Systems
SCN Staff·
Illustration of token streams routing through a central AI communication layer to a small set of active compute nodes inside a larger data center, representing sparse activation and expert-parallel communication.
AIanalysis

UCCL-EP vs. NCCL EP: Portability or Consolidation for MoE Communication?

Two new expert-parallel efforts point to different futures for MoE systems: one built for heterogeneous fleets, the other folded into NVIDIA’s stack.

AI InfrastructureInference Economics
SCN Staff·