Amazon AWS: AWS launches EC2 UltraServers

Amazon Web Services (AWS) is launching EC2 instances featuring the latest Nvidia GPUs and Trainium chips. At this week's Re:Invent event in Las Vegas, the cloud giant revealed plans for its Trainium3 chip after unveiling the EC2 during a keynote speech by CEO Matt Garman. Garman revealed three new EC2 instances: the P6 and Trn2 instances and the Trn2 UltraServers.

The Amazon EC2 Trn2 instances are now generally available and are - according to Garman - the most powerful instances for generative AI. They offer 30-40 percent better performance than current GPUs. The instances have 16 trainium2 chips connected by a high bandwidth, low latency interconnected NeuronLink, and can deliver 20.8 petaflops.

“The cluster is going to be five times the number of exaflops as the current cluster that Anthropic used to train their leading set of quad models for healthcare, five times the amount of compute that they use in the current generation. I am super excited to see what the Anthropic team comes up with that size,” said Garman.