Arm expands AI infrastructure for the agentic era with AGI CPU and Neoverse CSS N4 

News highlights 

• Arm Neoverse Compute Subsystems N4 delivers Arm’s most configurable CSS yet, enabling the fastest path from CSS to silicon 
• Arm AGI CPU momentum is accelerating across the AI ecosystem as cloud providers, OEMs and software partners build and deploy AI infrastructure on Arm 
• Arm provides a common compute foundation for the next generation of agentic AI

Agentic AI is reshaping the demands on AI infrastructure. As AI moves from inference to action, agents reason, retrieve data, call tools, and interact with databases and other agents, driving significantly more CPU-based computation across the data center. But the infrastructure requirements vary by workload: scale-out and data-plane use cases favor maximum throughput efficiency, while agentic and performance-critical applications demand highly responsive CPU performance. Arm is already operating at significant scale in the data center: IDC reports that Arm-based rack-scale servers have overtaken x86 as the dominant accelerated computing platform. 

Today we’re sharing how we’re advancing that shift. There is no one-size-fits-all approach to AI infrastructure, so Arm gives customers flexibility to choose what best fits their workloads. With the new Neoverse Compute Subsystems (CSS) N4, customers can build silicon optimized for maximum throughput efficiency, while Arm AGI CPU provides production-ready silicon designed for highly responsive agentic AI – all on a common Neoverse platform and software ecosystem. 

Accelerating differentiated silicon with Neoverse CSS N4 

AI infrastructure is also becoming more heterogeneous, with some deployments requiring silicon tailored to a particular system architecture or function – from bespoke compute platforms to DPUs, networking and other specialized designs. 

Neoverse CSS extends Arm into those designs, giving partners a proven, integrated compute foundation they can configure around their own requirements while reducing engineering effort, integration risk and time to silicon. Neoverse CSS N4 takes that approach further as Arm’s most configurable CSS yet, with our fastest path from CSS to silicon.  

With up to 128 cores per die, CSS N4 supports LPDDR6 memory and PCIe Gen 7 connectivity and delivers up to 2x the performance, up to 1.25x the performance per watt and up to 1.75x memory bandwidth of Neoverse CSS N3. Together, those advances deliver the compute density and high-speed memory and I/O needed as agentic AI drives more data movement, accelerator orchestration and concurrent compute across the system. 

The Arm Total Design ecosystem further accelerates the path to production through earlier IP validation and software development – a collaborative model Arm is now extending to physical AI. 

Arm CPUs powering agentic AI at scale 

Not every customer needs to build custom silicon. For those looking to deploy production-ready compute, Arm AGI CPU brings the performance and efficiency of the Neoverse platform. 

Since its introduction, companies across the AI ecosystem – including OpenAI, Meta, Cloudflare, Oracle, SAP, Lenovo, Supermicro and Verda – have been developing solutions around Arm AGI CPU.  

Across the broader cloud ecosystem, companies are already supporting agentic AI on Arm. Google Cloud is running agent sandboxes on Axion-based GKE, Microsoft Azure is accelerating sandbox tool execution with Cobalt 200, and NVIDIA Vera is designed to accelerate agentic workloads. 

Volcano Engine, the cloud computing division of ByteDance, is enabling its next-generation cloud services on the platform and bringing the first agentic sandboxes powered by Arm AGI CPU to market, providing secure and elastic environments for agent workloads at scale. 

Building for what comes next 

We are still at the beginning of the agentic AI era. As agents proliferate, infrastructure will need to process more data, coordinate more accelerators and support more concurrent compute – increasing the importance of getting maximum value from every watt of power, every rack and every dollar invested. 

The industry is converging on Arm as the common compute platform for the next generation of agentic AI. With Arm AGI CPU and Neoverse CSS N4, customers can choose the path that best fits their infrastructure while maintaining a shared foundation of performance, efficiency and software compatibility.