The world stands at the cusp of a technological revolution powered by artificial intelligence (AI). The exponential growth in AI computational demands—rising by an estimated factor of four annually for advanced models—requires a radical transformation of data center infrastructure. This challenge cannot be met by traditional system designs, and it presents an unparalleled opportunity for innovation, collaboration, and economic development. Recognizing this, the Open Compute Project (OCP) has launched its Open Systems for AI (OSAI) Strategic Initiative, bringing together a broad community of hyperscalers, technology vendors, and engineers to pioneer open, scalable infrastructure solutions. Datacenter IT Infrastructure refers to the components and systems that make up AI Clusters supporting AI workloads. This includes the Silicon, IT Hardware, and Interconnect.
As a follow-up to and building upon our Open Systems for AI Workshop – Physical Infrastructure, we continue to advance our understanding by exploring IT Infrastructure. This workshop will bring together various practitioners to share their knowledge and vision and allow for a melding of forward thinking in this space. Specifically, we will focus this workshop on IT Infrastructure – Silicon & what changes when we are deploying +1MW Racks?
Workshop Agenda
| Start Time | End Time | Title | Speakers |
|---|---|---|---|
| 8:00 | 8:10 | Welcome and Intro [Slides] | Anu Ramamurthy (Microchip) |
| 8:10 | 8:30 | BoW for Custom HBM [Slides] | Kevin Donnelly (Eliyan) |
| 8:30 | 8:50 | SystemC / Virtual Prototyping [Slides] | Raghu Shankar |
| 8:50 | 9:10 | Roofline analysis and profiling of HPC/AI apps to guide open systems for AI system design [Slides] | Georgios Michelogiannakis (Berkeley Lab), Raghu Shankar (Berkeley Lab) |
| 9:10 | 9:30 | Optical BoW | Shahab Ardalan |
| 9:30 | 9:40 | BREAK | |
| 9:40 | 10:00 | Chiplet Systems Workstream [Slides] | Itai Nadler (GSOC Solutions), Durgesh Srivasta (DataraAI) |
| 10:00 | 10:20 | Chiplets: A key ingredient for specialization in HPC [Slides] | Patricia Gonzalez-Guerrero (Berkeley Lab) |
| 10:20 | 10:40 | Abundance of Wires [Slides] | Jawad Nasrullah (Palo Alto Electron) |
| 10:40 | 11:00 | CDX [Slides] | David Ratchkov (Thrace Systems) |