ARM Unveils Its Own High-Performance CPUs
ARM, the company whose chips power most of the smartphones and tablets we use daily, is stepping into a new arena. They have officially announced their own line of high-performance CPUs, aiming directly at the data center market currently dominated by Intel and AMD’s x86 processors. This move marks a significant shift for ARM, as they traditionally license their chip designs rather than manufacturing and selling complete CPUs themselves.
The new ARM AGI CPU is built for speed, scale, and efficiency. It boasts up to 136 ARM Neoverse V3 cores, each with a substantial 2MB of level 2 cache.
Built on TSMC’s advanced 3nm process, these cores can reach speeds of up to 3.6 GHz. ARM highlights that this consistent clock speed, without aggressive boosting, helps maintain predictable power consumption.
Efficiency and Power: The Data Center Advantage
ARM’s strategy with the AGI CPU focuses on consistent performance and power management. By avoiding highly variable clock speeds, they aim to provide data centers with more predictable power usage. This is a big deal because power and cooling are major concerns as data centers grow rapidly.
Each AGI CPU includes 96 lanes of PCIe Gen 6 and supports CXL 3.0. This technology allows for the creation of large shared memory pools across connected devices. ARM showcased designs featuring two of these CPUs on a single motherboard, working together to handle demanding tasks.
Impressive Density in a Standard Rack
What’s truly remarkable is how much computing power ARM can pack into a standard server rack. A single rack, using ARM’s design, can house 32 server nodes, totaling an astonishing 8,160 CPU cores. This density is achieved while consuming a mere 300W per AGI CPU, which is significantly less than many current high-end x86 CPUs.
When paired with liquid cooling, the numbers become even more astounding. ARM estimates that a 200kW rack could hold 42 server systems, delivering a massive 45,696 cores and over a petabyte of RAM. This setup would use only about half of the available power budget, offering roughly double the performance per watt compared to x86 processors.
Targeting AI Workloads
While CPUs are often seen as secondary to GPUs for AI tasks, ARM sees a key role for their processors. They point out that as AI agents generate requests much faster than humans, the CPUs coordinating these tasks become a bottleneck. This can leave expensive AI accelerators waiting idle.
ARM believes their AGI CPUs can significantly increase the number of cores available per gigawatt, potentially quadrupling the efficiency in systems that handle AI requests. This improved coordination means AI accelerators can be used more effectively, maximizing their potential.
Developer Support and Live Demos
ARM is also focusing on making it easy for developers to adopt their new CPUs. They are building strong support systems and tools to help software run smoothly on ARM architecture. While many demonstrations focused on software porting, ARM also showed off a live encoding demo.
This demo showcased a server encoding a 1080p video from H.264 to H.265 while simultaneously running computer vision tasks on the same CPU. The fact that ARM performed this live on the show floor demonstrated their confidence in the hardware’s stability and performance.
A New Business Model for ARM?
This venture into selling complete CPUs raises questions about ARM’s relationship with its existing customers, who license ARM’s intellectual property. On paper, it appears to put ARM in direct competition with them. However, ARM claims this is a direction many of their customers were actually asking for.
ARM is positioning this as offering customers a choice: they can license ARM’s IP, choose compute subsystems, or buy ARM’s physical CPUs, or even a combination of these. They are open to business in multiple ways, aiming to capture revenue from all angles.
The Future is ARM-Powered CPUs
ARM openly stated that the AGI CPU is just their first step, calling it a “safe first attempt.” They have already announced that their second CPU generation is due next year, promising even greater advancements. This level of forward-looking transparency is unusual in the silicon development world.
This bold move by ARM signals a significant shift in the processor market. By entering the high-performance CPU space, they are directly challenging established players and offering a compelling alternative for data centers focused on efficiency and power. The availability and pricing details are expected to be released through ARM’s partners in the coming months.
Specs & Key Features
- Up to 136 ARM Neoverse V3 cores
- 2MB of L2 cache per core
- Built on TSMC 3nm process
- Up to 3.6 GHz clock speed
- 12-channel DDR5 memory controller
- 96 lanes of PCIe Gen 6
- Support for CXL 3.0
- Estimated 300W power draw per CPU
Source: There’s a new CPU maker. (YouTube)
