Why Arm is the Compute Platform for All AI Workloads
For AI, no individual piece of hardware or computing component will be the “one size fits-all” solution for all workloads. AI needs to be distributed across the entire modern topography of computing, from cloud to edge – and that requires a heterogeneous computing platform that offers the flexibility to use different computational engines, including the CPU, GPU and NPU, for different AI use cases and demands.
The Arm CPU already provides a foundation for accelerated AI everywhere, from the smallest embedded device to the largest datacenter. This is due to its performance and efficiency capabilities, pervasiveness, ease of programmability and flexibility.
Focusing on flexibility, there are three key reasons why this is hugely beneficial to the ecosystem. Firstly, it means the Arm CPU can process a broad range of AI inference use cases, many of which are commonly used across billions of devices, like today’s smartphones, and in cloud and data centers worldwide – and not only that, because beyond inference the CPU is often used for additional tasks in the stack, such as data pre-processing and orchestration. Secondly, developers can run a broader range of software in a greater variety of data formats without needing to build multiple versions of the code. And, thirdly, CPU’s flexibility makes it the perfect partner for accelerated AI workloads.
Delivering diversity and choice to enable the industry to deploy AI compute their way
Alongside the CPU portfolio, the Arm compute platform includes AI accelerator technologies, such as GPUs and NPUs, which are being integrated with the CPU across various markets.
In mobile, Arm Compute Subsystems (CSS) for Client features the Armv9.2 CPU cluster integrated with the Arm Immortalis-G925 GPU to offer acceleration capabilities for various AI use cases, including image segmentation, object detection, natural language processing, and speech-to-text. In IoT, the Arm Ethos-U85 NPU is designed to run with Cortex-A-based systems that require accelerated AI performance, such as factory automation.
Also, in addition to Arm’s own accelerator technologies, our CPUs give our partners the flexibility to create their own customized, differentiated silicon solutions. For example, NVIDIA’s Grace Blackwell and Grace Hopper superchips for AI-based infrastructure both incorporate Arm CPUs alongside NVIDIA’s AI accelerator technologies to deliver significant uplifts in AI performance.
The Grace Blackwell superchip combines NVIDIA’s Blackwell GPU architecture with the Arm Neoverse-based Grace CPU. Arm’s unique offering enabled NVIDIA to make system-level design optimizations, reducing energy consumption by 25 times and providing a 30 times increase in performance per GPU compared to NVIDIA H100 GPUs. Specifically, NVIDIA was able to implement their own high-bandwidth NVLink interconnect technology, improving data bandwidth and latency between the CPU, GPU and memory – an optimization made possible thanks to the flexibility of the Arm Neoverse platform.
Click to read Accelerate Your AI Data Center DreamsArm is committed to bringing these AI acceleration opportunities across the ecosystem through Arm Total Design. The program provides faster access to Arm’s CSS technology, unlocking hardware and software advancements to drive AI and silicon innovation and enabling the quicker development and deployment of AI-optimized silicon solutions.
The Arm architecture: Delivering the unique flexibility AI demands
Central to the flexibility of the Arm CPU designs is our industry-leading architecture. It offers a foundational platform that can be closely integrated with AI accelerator technologies and supports various vector lengths, from 128 bit to 2048 bit, which allows for multiple neural networks to be executed easily across many different data points.
The flexibility of the Arm’s architecture enables diverse customization opportunities for the entire silicon ecosystem, with our heritage built on enabling partners to build their own differentiated silicon solutions as quickly as possible. This unique flexibility also allows Arm to continuously innovate the architecture, introducing critical instructions and features on a regular cadence that accelerate AI computation to benefit the entire ecosystem, from leading silicon partners to the 20 million plus software developers building on the Arm compute platform.
This started with the Armv7 architecture, which introduced advanced Single Instruction Multiple Data (SIMD) extensions, such as NEON technology, as Arm’s initial venture into machine learning (ML) workloads. It has been enhanced over the past few years, with additions focused on vector dot product and matrix multiplication as part of Armv8, before the introduction of Arm Scalable Vector Extensions 2 (SVE2) and the new Arm Scalable Matrix Extension (SME) as key elements of Armv9 that drive higher compute performance and reduced power consumption for a range of generative AI workloads and use cases.
Seamless integration with AI accelerator technologies
Arm is the compute platform for the age of AI, driving ongoing architectural innovation that directly corresponds with the evolution of AI-based applications that are becoming faster, more interactive, and more immersive. The Arm CPU can be seamlessly augmented and integrated with AI accelerator technologies, such as GPUs and NPUs, as part of a flexible heterogeneous computing approach to AI workloads.
While the Arm CPU is the practical choice for processing many AI inference workloads, its flexibility means it is the perfect companion for accelerator technologies where more powerful and performant AI is needed to deliver certain use cases and computation demands. For our technology partners, this helps to deliver endless customization options to enable them to build complete silicon solutions for their AI workloads.
Any re-use permitted for informational and non-commercial or personal use only.
Editorial Contact
Latest on X
The combined power and performance of Arm and @GitHub is optimizing the developer experience and unlocking advances in AI.
Here's to many more years of partnership and building the future of AI #onArm. 💪
From versatility and cost-effectiveness to scalability and power efficiency, here's 5 key reasons why CPUs are the top choice for AI ⏬
Top 5 Reasons why CPU is the Best Processor for AI Inference - Embedded
Advanced artificial intelligence (AI), like generative AI, is enhancing all our smart devices. However, a common misco...
www.embedded.com
From on-CPU AI processing to chiplet-enabled designs, hyperscalers get more control, efficiency, and power to meet the demands of AI when building #onArm.
@TheNextPlatform shares how custom Arm CPUs are transforming the data center.
Custom Arm CPUs Drive Many Different AI Approaches In The Datacenter
Sponsored Feature Arm is starting to fulfill its promise of transforming the nature of compute in the datacenter, ...
www.nextplatform.com
Arm founding CEO & former chairman, Sir Robin Saxby, has been inducted into the City of London Engineering Hall of Fame!
This acknowledges the transformational impact of Saxby's work on the Arm compute platform, laying the foundation for who we are today: https://newsroom.arm.com/blog/sir-robin-saxby-city-of-london-engineering-hall-of-fame?utm_source=twitter&utm_medium=social-organic&utm_content=blog&utm_campaign=mk29_exec-comms_na
We're entering a new partnership with @Panasonic Automotive Systems.
To accelerate development cycles in the automotive industry, we'll adopt and extend VirtIO, the device virtualization framework that will help standardize vehicle architecture for SDVs: https://newsroom.arm.com/news/arm-and-panasonic-partner-to-standardize-sdvs?utm_source=twitter&utm_medium=social-organic&utm_content=newsletter&utm_campaign=mk12_automotive_na
We're delighted to welcome Charlotte Eaton back to Arm. 🎉
Charlotte rejoins us as Chief People Officer, drawing on her wealth of experience at Arm and in other leadership roles to empower our people to do the best work of their careers: https://newsroom.arm.com/news/arm-announces-appointment-of-charlotte-eaton-as-chief-people-officer?utm_source=twitter&utm_medium=social-organic&utm_content=newsroom&utm_campaign=mk29_exec-comms_na
Demand for the Arm compute platform remains strong in the age of AI.
In Q2 FYE25, we achieved record royalty revenue for Q2, with strong YoY growth thanks to the increased demand for energy-efficient compute and more complex AI chips built #onArm:
Frederique Olivier relies on Arm to capture the beauty of the natural world. 🌎
With the help of Arm, she can shoot images with better quality and source power in extreme conditions.
Discover the world from Frederique's eyes, made possible #onArm: https://newsroom.arm.com/blog/purpose-on-arm-frederique-olivier-photographer?utm_source=twitter&utm_medium=social-organic&utm_content=blog&utm_campaign=mk08_brand_na
🗓️ Join us on Wednesday November 6 for our next financial results conference call.
After market close, we'll report our earnings for the second quarter of fiscal year 2025, followed by a conference call to review our results and business outlook: https://newsroom.arm.com/news/arm-announces-earnings-release-date-for-second-quarter-fiscal-year-ended-2025?utm_source=twitter&utm_medium=social-organic&utm_content=newsroom&utm_campaign=mk29_exec-comms_na
6G is on the horizon, promising ultra-fast speeds, low latency, and seamless digital and physical experiences.
Learn what it takes to bring new AI capabilities to life on 6G: https://newsroom.arm.com/blog/arm-and-alphawave-semi-unite-on-6g-chiplets?utm_source=twitter&utm_medium=social-organic&utm_content=blog&utm_campaign=mk03_infrastructure_na
Experience new levels of performance and efficiency with the general availability of @GoogleCloud C4A VMs!
C4A features the Arm Neoverse V2-powered Google Axion CPU to support the most demanding AI & general purpose workloads: https://cloud.google.com/blog/products/compute/try-c4a-the-first-google-axion-processor
Congrats @GoogleCloud! 👏
Catch the full conversation to hear why suggesting AI is overhyped "couldn't be further from the truth": https://www.bloomberg.com/news/videos/2024-10-22/arm-ceo-dismisses-ai-bubble-fears-video
#BloombergTech
"AI is going to run on Arm. Period."
Arm is the only company on the planet that can run workloads of any size. There's plenty of opportunity to grow and drive innovation in the space, and we're leading this.
Thanks to #BloombergTech for having us!
At #GitHubUniverse or watching the live stream?
➡️Learn how to maximize performance with GitHub Copilot and GitHub Actions. Catch the team on the Main Stage at 3:45pm PT!
➡️Attending in person? Join our AI roundtable later today - spaces are limited! https://www.arm.com/resources/registration/github-universe-roundtable
Get ready to streamline development with the Arm extension for @GitHub Copilot!
Coming 🔜, the extension will empower developers to build and test software quickly and efficiently on the Arm compute platform, supporting seamless cloud-to-edge deployment: https://newsroom.arm.com/news/ai-driven-tools-on-github?utm_source=twitter&utm_medium=social-organic&utm_content=newsroom&utm_campaign=mk24_developer_na
Ready to future-proof your workloads?
Boost performance and cut costs by migrating to Arm. 💪
Companies like @HoneycombIo and @FusionAuth saw major gains with AWS Graviton and so can you. Explore how and access our migration guide to get started: https://newsroom.arm.com/blog/why-developers-are-migrating-to-arm?utm_source=twitter&utm_medium=social-organic&utm_content=blog&utm_campaign=mk24_developer_cloud-dev
Panasonic Automotive Systems joined us to discuss how AI is revolutionizing the in-vehicle experience in our latest Viewpoints podcast episode.
Discover how AI is shaping the future of driving, making it safer, more intuitive and more comfortable: https://newsroom.arm.com/podcasts/ai-in-the-car?utm_source=twitter&utm_medium=social-organic&utm_content=podcast&utm_campaign=mk12_automotive_na
The Armv9 Cortex-X925 CPU is setting new standards with a 15% IPC improvement!
Get ready for unparalleled performance and efficiency across flagship AI smartphones and PCs. More details: https://newsroom.arm.com/blog/armv9-cortex-x925-cpu-performance?utm_source=twitter&utm_medium=social-organic&utm_content=blog&utm_campaign=mk04_client_na
For @NVIDIA, transparency is the key to success. 🔑
To build one of the largest companies in the world, NVIDIA CEO Jensen Huang sought to build a porous organization that empowers people to experiment and improve.
Listen to the full Tech Unheard podcast: https://newsroom.arm.com/podcasts/tech-unheard-episode-one-jensen-huang?utm_source=twitter&utm_medium=social-organic&utm_content=podcast&utm_campaign=mk08_brand_na
The Arm CPU architecture is enabling quicker AI experiences with enhanced security, unlocking new possibilities for AI workloads at the edge.
Find out why the CPU is front and center in the future of AI on The @Verge.
Why AI starts on the CPU
The rise of AI inference means more AI workloads are being processed at the edge.
www.theverge.com
It's a big day for small models!
With @AIatMeta's new quantized Llama models and the Beta release of ExecuTorch, it's now quicker for 20 million Arm developers to create and deploy performant, intelligent gen AI at the edge.
👇We've put it to the test: https://newsroom.arm.com/news/accelerating-edge-ai-with-executorch?utm_source=twitter&utm_medium=social-organic&utm_content=newsroom&utm_campaign=mk13_tech-strat_na
We're excited to see the new quantized Llama 3.2 1B and 3B models available on the Arm compute platform.
👉 Developers, get ready to seamlessly integrate these new models into your applications #onArm with no additional modifications or optimizations, saving time and resources
Our collaboration with @vivo_Global and @MediaTek is redefining the AI smartphone. 📱
🤝 Together, we've delivered advanced performance and efficiency to vivo's X200 series with MediaTek's Dimensity 9400 with the latest Armv9 CPUs and Immortalis GPU: https://newsroom.arm.com/news/powering-next-generation-ai-smartphones-mediatek-vivo?utm_source=twitter&utm_medium=social-organic&utm_content=newsroom&utm_campaign=mk04_client_na
Collaboration is key to enabling the AI-enabled vehicle. 🚗
At #REAutoUSA, Dipti Vachani, our SVP and GM for Automotive shared how we're working across the stack to deliver solutions that enable software development from day 1, enabled by standards driven by SOAFEE.
