Alibaba Cloud reveals its datacenter design and homebrew network used for LLM training

15,000 GPUs per DC, in hosts packing eight apiece, plus nine NICs – helped by switches with custom heat sinks

Exclusive  Alibaba Cloud has revealed the design of an Ethernet-based network it created specifically to carry traffic for training large language models – and has used in production for eight months.…

alibaba alibaba cloud cloud custom datacenter design ethernet exclusive gpus heat homebrew language language models large language large language models llm llm training network nics per traffic training