This talk delivers a data-driven summary on the physical and economic bottlenecks in the AI infrastructure market today. We will cover the diverging strategies between traditional hyperscalers and specialized "Neoclouds," supported by deep supply chain data. The audience will gain understanding of trends across the industry, from DRAM price hikes to CoWoS constraints, inference performance to behind the meter power generation for GW-scale datacenters.
What the audience will learn
- The Reality of the Power Wall: Why the commercial grid is failing to meet AI demand and how the industry is pivoting to "behind-the-meter" power solutions (like onsite gas turbines) to bring gigawatt clusters online.
- Neocloud vs. Hyperscaler Economics: A comparative framework for understanding the cost-performance trade-offs between renting from AWS/Azure versus specialized GPU clouds, backed by real-world benchmarking data.
- Supply Chain "Ground Truth": A detailed look at the actual constraints in the hardware supply chain (specifically HBM yield and advanced packaging) and a realistic timeline for when these bottlenecks will alleviate.
- The Next-Gen Network: Insights into the battle between InfiniBand and Ultra Ethernet, and why optical interconnects are becoming critical for scaling beyond the individual rack.
Speaker
Jordan Nanos
Member of Technical Staff @SemiAnalysis, Previously Distinguished Technologist @HPE
Jordan Nanos is a Member of Technical Staff at SemiAnalysis and a former Distinguished Technologist at HPE. He lives in Squamish, British Columbia, Canada.