The world stands at the cusp of a technological revolution powered by artificial intelligence (AI). The exponential growth in AI computational demands—rising by an estimated factor of four annually for advanced models—requires a radical transformation of data center infrastructure. This challenge cannot be met by traditional system designs, and it presents an unparalleled opportunity for innovation, collaboration, and economic development. Recognizing this, the Open Compute Project (OCP) has launched its Open Systems for AI (OSAI) Strategic Initiative, bringing together a broad community of hyperscalers, technology vendors, and engineers to pioneer open, scalable infrastructure solutions. Datacenter IT Infrastructure refers to the components and systems that make up AI Clusters supporting AI workloads. This includes the Silicon, IT Hardware, and Interconnect.
As a follow-up to and building upon our Open Systems for AI Workshop – Physical Infrastructure, we continue to advance our understanding by exploring IT Infrastructure. This workshop will bring together various practitioners to share their knowledge and vision and allow for a melding of forward thinking in this space. Specifically, we will focus this workshop on IT Infrastructure – Silicon.
Workshop Agenda
| Start Time | End Time | Title | Speakers |
|---|---|---|---|
| 8:00 | 8:10 | Welcome and Introduction | Rob Coyle (OCP) |
| 8:10 | 8:30 | Mt. Diablo Server Scope [Slides] | Christina Peabody (Google) Mingchun Xu (Meta) |
| 8:30 | 8:50 | High Efficiency Mass Storage Cooling Innovation [Slides] | Mohamed El-Batal (Seagate) |
| 8:50 | 9:10 | AI Infrastructure Management : Challenges and Mitigations through Open Standards [Slides] | Chitrak Gupta (AMI) Sudan Ayanam (AMI) |
| 9:10 | 9:30 | Open Cluster Designs – Strategic Initiative [Slides] | Lowell Lamb (Broadcom) Loren Staley (Celestica) |
| 9:30 | 9:40 | BREAK | |
| 9:40 | 10:00 | Next-Gen AI/HPC Server Performance with CXL3.1 Tiered Memory and MRDIMM solution [Slides] | David Zhuo (Montage Technology) |
| 10:00 | 10:20 | Towards memory efficient RAG pipelines with CXL technology [Slides] | Arun George (Samsung) Siamak Tavallaei (Independent) |
| 10:20 | 10:40 | DC-MHS [Slides] | Mike Gregoire (Dell) |
| 10:40 | 10:45 | Closing Remarks | Rob Coyle (OCP) |