Meta Unveils 24k GPU AI Infrastructure Design

Meta recently announced the design of two new AI computing clusters, each containing 24,576 GPUs. The clusters are based on Meta's Grand Teton hardware platform, and one cluster is currently used by Meta for training their next-generation Llama 3 model.

ai ai infrastructure anthony cluster computing deep learning design gpu gpus grand teton hardware infrastructure llama llama 3 meta ml & data engineering neural networks next platform training