Kaytus Mission Bay GPU - High-Density NVlink GPU Expansion

ON5388M5 (“Mission Bay”) is a 3OU 8-GPU high-density GPU expansion box that features an NVlink 2.0 architecture that provides flexible topology for different applications.

The setup includes three PEX9797 chips for PCIE fan-out, along with a PEX8608 chip responsible for PCIE management signal routing. The PCIE device, SXM2 GPU, is managed by the MCU, handling GPU power and sideband signals. Power on/off control is managed by the CPLD. For box management, AST2500 is utilized. The configuration comprises one X24 GEN3 PCIE slot for the management CPU board, two x16 GEN3 PCIE slots for upstream connection to the host, and four x16 GEN3 PCIE slots for downstream connection to endpoints. Box management is facilitated through one management LAN connected to the BMC, while there are two external UARTs for BMC and CPU debugging purposes.

The system employs locally generated CFC clocks. Both the PCIE switch and PCIE endpoint clocks are derived from the same clock buffer. The diagram illustrates the configuration:

  • There are 18x 100MHz clocks allocated for PCIE.
  • Additionally, there are 8 x 156MHz clocks designated for GPU NVLink.
     

Product Information

  • Model #: ON5388M5

Solution Providers

Kaytus