Google makes Trillium AI accelerators generally available

Google has launched its self-developed Trillium AI accelerators which are designed for artificial intelligence (AI) workloads. Trillium is Google's sixth-generation Tensor Processing Unit (TPU), described as being Google's "most advanced TPU," capable of achieving a 4.7x increase in peak compute performance per chip compared to the TPU v5e.

According to Google, Trillium achieves this by expanding the size of the chip’s matrix multiple units (MXUs), increasing the clock speed, and comes equipped with a third-generation SparseCore – a specialized dataflow accelerator that processes large embeddings often found in ranking and recommender systems.

"As long-time users of TPUs since v4, we're incredibly impressed with the capabilities of Google Cloud's Trillium. The advancements in scale, speed, and cost-efficiency are significant. We believe Trillium will be essential in accelerating the development of our next generation of sophisticated language models, enabling us to deliver even more powerful and accessible AI solutions to our customers," said Barak Lenz, CTO, AI21 Labs.