Google’s Tensor Processing Units (TPUs) are one of the few viable alternatives to advanced AI chips made by Nvidia although developers can only access them through Google’s cloud platform and cannot purchase them outright. Google plans to offer an Arm-based Central Processing Unit (CPU) called Axion through Google Cloud.
In furtherance of announcing an Arm-based core processor, Google on Tuesday unveiled details of a new iteration of its data center AI processors. Though they are exclusively available to developers via Google’s cloud platform, developers may still acquire Google’s tensor processing units (TPUs) as one of the few practical substitutes for Nvidia’s cutting-edge AI hardware.
Google Cloud will be able to purchase the Arm-based central processor unit (CPU) known as Axion. on comparison to general-purpose Arm processors and x86 chips, the business claims that their performance on the cloud is superior.
“We’re making it easier for customers to bring their existing workloads to Arm,” stated Mark Lohmeyer, general manager of compute and machine learning infrastructure at Google Cloud and vice president. Although the core of Axion is open, users of Arm anywhere may readily integrate Axion without having to rewrite or re-architect their programs.
Rival cloud operators such as Amazon.com and Microsoft have created Arm CPUs as a way to differentiate the computing services they provide. Google has made other custom chips for YouTube, AI, and its smartphones, but not CPUs.
Broadcom partners with Google
For earlier iterations of TPU processors, Broadcom and Google collaborated. Regarding Axion and Broadcom’s participation with the TPU v5p, Google declined to comment on whether it engaged design partners.
The subsidiary of Alphabet claimed that the new TPU V5P chip can reach double the raw performance of the previous generation of TPUs and is designed to operate in pods of 8,960 chips. Google employs liquid cooling to help guarantee that the Pod performs at its best.
Compared to general-purpose Arm processors, the Xeon chip performs 30% better; compared to the current generation of x86 chips made by Advanced Micro Devices and Intel, it performs 50% better.
What will happen next?
Google plans to soon use Axion to power services like its YouTube ads in Google Cloud. The TPU v5p became generally available through Google’s cloud on Tuesday.