Meta shares details of new 24k GPU AI clusters
March 13, 2024 Microsoft Azure
Meta has shared the details of the hardware, network, storage, design, performance, and software that make up its two new 24,000-GPU data center scale training clusters. These clusters based on Meta’s AI Research SuperCluster (RSC) are being usedto train its Llama 3 large language AI model. In a...
Read more