Arm and NVIDIA: Fueling Innovation for the Next Era of Compute
By Rene Haas, President, IPG, Arm
In 2018, Arm had recently announced Arm Neoverse, our first set of platforms and technologies specifically tailored to the needs of cloud-to-edge infrastructure. Shortly after, the first 5G services came online in a few select markets, and NVIDIA announced it was making its full stack of AI and HPC software available to the Arm ecosystem.
Fast forward to today, and Arm Neoverse can be found inside some of the world’s largest cloud operations and most powerful supercomputers, while promising to transform 5G with flexible, power efficient solutions. Meanwhile, carriers, cloud providers and others are racing to develop technologies and forge partnerships to help them manage the flood of internet traffic and datacenter workloads that have emerged in the wake of COVID-19.
To stay ahead of the relentless pace of technology, NVIDIA and the Arm ecosystem have been expanding where we collaborate to help our partners meet the ever-evolving demands of compute, particularly in the digital infrastructure. Some of the highlights were discussed at NVIDIA’s GTC 21 conference:
- The Grace CPU. Named after computing pioneer Grace Hopper, Grace is NVIDIA’s first Arm-based data center CPU. It will deliver 10x the performance of today’s fastest servers running the most complex high performance computing workloads. The Swiss National Supercomputing Centre (CSCS) and the U.S. Department of Energy’s Los Alamos National Laboratory have already announced plans to build Grace-based supercomputers.
- A New Data Processing Unit (DPU). NVIDIA’s BlueField-3 DPU optimized for tasks like networking, security and storage features 400-Gbps links and 5x the Arm computing power of NVIDIA’s current BlueField-2 DPU. Early performance projections show why specialized processing is rapidly gaining popularity: a single BlueField-3 DPU can deliver the equivalent data center services that could consume up to 300 CPU cores based on traditional architectures.
- GPU-Enhanced AWS Graviton2-based Instances. NVIDIA and AWS are working to bring GPU acceleration to cloud instances running on the Arm-based AWS Graviton2 processor for general purpose workloads, which will be available in the second half of the year. GPU-accelerated instances will deliver a range of benefits including lower costs, richer game streaming experiences and greater performance for machine learning.The instances will also enable game developers to run Android games natively, reducing the developer time and expense that can be consumed in compiling and emulation.
- NVIDIA Arm HPC Developer Kit. The HPC SDK is a hardware/software platform for streamlining tasks such as application migration, validation and performance analysis for HPC users and datacenters moving to the Arm architecture. It includes an Ampere Altra CPU containing 80 Arm Neoverse cores running up to 3.3GHz, dual NVIDIA A100 GPUs each delivering 312 teraflops of FP16 deep learning performance, and two NVIDIA BlueField-2 DPUs. Computing centers initially deploying the devkit include Oak Ridge National Laboratory, Los Alamos National Laboratory, the National Center for High Performance Computing in Taiwan and the Korean Institute of Science and Technology.Read more about the HPC Developer Kit on the Arm Community here.
- GPUs for Edge. NVIDIA and Marvell are collaborating to bring GPU acceleration to Octeon, an Arm-based family of DPUs from Marvell for enterprise computing, 5G infrastructure and edge applications. NVIDIA GPUs will offload workloads such as image recognition and security to boost performance and reduce latency, particularly in constrained edge environments.
- A Quadrillion Operations Per Second for Autonomous Cars. Arm technology will be integrated into the DPUs inside NVIDIA DRIVE Atlan, the company’s latest autonomous platform. Capable of more than 1,000 trillion operations per second, Atlan marks the first time DPUs will be included in the DRIVE platform. The automotive industry will be able to take advantage of Arm processors to create new innovations for security, storage and networking in transportation.
- A New Look for Laptops. NVIDIA and MediaTek, one of the world’s largest suppliers of Arm-based SoCs, are developing thin and light laptops powered by Arm Cortex-based MediaTek CPUs and NVIDIA RTX GPUs, based on a reference platform that will support Chromium, Linux and NVIDIA SDKs. The combination will lead to extremely powerful, efficient laptops capable of cutting-edge AI and ray-traced graphics that can serve both gamers and developers.
Find out more details on these and other initiatives between our companies in the keynotes, including my own, blogs and technical sessions at NVIDIA GTC 21.
Two Companies, A Similar Path
Arm and NVIDIA have long shared a vision of delivering the compute innovation that ensures our partners and customers can achieve unimaginable breakthroughs in an economical, efficient and sustainable manner in any market. Through ongoing collaboration and our common experiences, we’ll find new ways to harness the potential of secure, specialized processing for the next decade of unique compute challenges, many defined by the power of AI.
The opportunities for our industry, and our customers, have never been greater. Stay tuned.
Any re-use permitted for informational and non-commercial or personal use only.
Media Contacts
Latest on X
Arm Tech Symposia 2024 was bigger and better than ever!🚀
This year, we brought the technology ecosystem together across China, Japan, South Korea, and Taiwan to explore the huge opportunities AI offers today.
Explore the highlights in our latest blog: https://newsroom.arm.com/blog/arm-tech-symposia-2024?utm_source=twitter&utm_medium=social-organic&utm_content=blog&utm_campaign=mk19_events_apactechsymposia
Where is on-device AI headed next? 📱
In @talkandroid, James McNiven, VP of Product Management, shares details on what to expect from the next-generation of AI-driven smartphone experiences and how the Arm compute platform is enabling these. ⏬
Interview With Arm: What’s Next For On-device AI On Smartphones? - Talk Android
On-device AI on smartphones is going places, and we talked with Arm's Chris Bergey to find out what's next for this powerhouse technology
okt.to
With the momentum we've seen at #MSIgnite around Azure Cobalt 100 VMs, we're excited to work with the ecosystem to enable the AI-accelerated future in a sustainable, scalable way on Arm Neoverse.
Get up to speed on what you might have missed from the show https://newsroom.arm.com/blog/arm-and-microsoft-igniting-a-new-era-of-cloud-computing-for-ai?utm_source=twitter&utm_medium=social-organic&utm_content=blog&utm_campaign=mk03_infrastructure_na
As proud investors in Enfabrica following its Series C Round, we look forward to supporting the team’s incredible growth on Arm Neoverse, enabling scalable networking solutions that meet the needs of demanding AI workloads.
👏 Congratulations, @enfabrica_!
Perseverance is a fundamental part of who we are as a company.
In the new State of European Tech documentary from @atomico, Rene Haas shares how this has enabled us to become the industry's highest-performing and most power-efficient compute platform 🔽
The State of European Tech Anniversary Documentary
As The State of European Tech celebrates its tenth anniversary, the team has gathered the most influential voices ...
okt.to
This is what a day in the life looks like for Graduate Product Manager, Conall Farney. 📹
Since joining us as a Sales Intern, Conall moved into a new role matching his growing passions.
Discover your path with us: https://okt.to/KdWshB
Game-changing quantum breakthrough: Equal1 runs Arm Cortex at 3.3 Kelvin (-269.85°C)!
Equal1's innovative approach could make quantum computing as accessible as traditional servers.
From drug discovery to AI, the future is getting cooler ❄️🌡️ https://newsroom.arm.com/blog/pushing-quantum-computing-boundaries-with-arm-equal1?utm_source=twitter&utm_medium=social-organic&utm_content=blog&utm_campaign=mk13_tech-strat_na
Here at Arm, we know that prioritizing your wellbeing is key to unlocking your potential.
👉 That’s why we’re committed to nurturing our team’s passions to drive innovation. Scroll through to hear what some of our people have to say about how Arm helps them thrive.
When software architecture isn't standardized, hardware changes can cause issues.
@SchneiderUKI collaborated with us to solve this challenge by bringing in Arm SystemReady, where new hardware works with the software:
SystemReady Implementation at Schneider Electric: Accelerating Development and Enhancing Platform...
How Schneider Electric leveraged Arm SystemReady to accelerate development, enhance platform flexibility and overcome supp...
newsroom.arm.com
Game-changing quantum breakthrough: Equal1 runs Arm Cortex at 3.3 Kelvin (-269.85°C)!
Equal1's innovative approach could make quantum computing as accessible as traditional servers. From drug discovery to AI, the future is getting cooler 🌡️❄️ https://newsroom.arm.com/blog/pushing-quantum-computing-boundaries-with-arm-equal1?utm_source=twitter&utm_medium=social-organic&utm_content=blog&utm_campaign=mk13_tech-strat_na
AI is causing a fundamental shift in data center infrastructure.
With the flexibility of the Arm compute platform and our relentless focus on energy efficiency and customization, we're at the center of this transformation. Here's why 👇
Arm in the Data Center: The Dawn of a New Era - Creative Strategies
Introduction: 2024 - The Tipping Point for Arm's Data Center Momentum As we close out 2024, the semiconductor indu...
creativestrategies.com
The combined power and performance of Arm and @GitHub is optimizing the developer experience and unlocking advances in AI.
Here's to many more years of partnership and building the future of AI #onArm. 💪
From versatility and cost-effectiveness to scalability and power efficiency, here's 5 key reasons why CPUs are the top choice for AI ⏬
Top 5 Reasons why CPU is the Best Processor for AI Inference - Embedded
Advanced artificial intelligence (AI), like generative AI, is enhancing all our smart devices. However, a common misco...
www.embedded.com
From on-CPU AI processing to chiplet-enabled designs, hyperscalers get more control, efficiency, and power to meet the demands of AI when building #onArm.
@TheNextPlatform shares how custom Arm CPUs are transforming the data center.
Custom Arm CPUs Drive Many Different AI Approaches In The Datacenter
Sponsored Feature Arm is starting to fulfill its promise of transforming the nature of compute in the datacenter, ...
www.nextplatform.com
Arm founding CEO & former chairman, Sir Robin Saxby, has been inducted into the City of London Engineering Hall of Fame!
This acknowledges the transformational impact of Saxby's work on the Arm compute platform, laying the foundation for who we are today: https://newsroom.arm.com/blog/sir-robin-saxby-city-of-london-engineering-hall-of-fame?utm_source=twitter&utm_medium=social-organic&utm_content=blog&utm_campaign=mk29_exec-comms_na
We're entering a new partnership with @Panasonic Automotive Systems.
To accelerate development cycles in the automotive industry, we'll adopt and extend VirtIO, the device virtualization framework that will help standardize vehicle architecture for SDVs: https://newsroom.arm.com/news/arm-and-panasonic-partner-to-standardize-sdvs?utm_source=twitter&utm_medium=social-organic&utm_content=newsletter&utm_campaign=mk12_automotive_na
We're delighted to welcome Charlotte Eaton back to Arm. 🎉
Charlotte rejoins us as Chief People Officer, drawing on her wealth of experience at Arm and in other leadership roles to empower our people to do the best work of their careers: https://newsroom.arm.com/news/arm-announces-appointment-of-charlotte-eaton-as-chief-people-officer?utm_source=twitter&utm_medium=social-organic&utm_content=newsroom&utm_campaign=mk29_exec-comms_na
Demand for the Arm compute platform remains strong in the age of AI.
In Q2 FYE25, we achieved record royalty revenue for Q2, with strong YoY growth thanks to the increased demand for energy-efficient compute and more complex AI chips built #onArm:
Frederique Olivier relies on Arm to capture the beauty of the natural world. 🌎
With the help of Arm, she can shoot images with better quality and source power in extreme conditions.
Discover the world from Frederique's eyes, made possible #onArm: https://newsroom.arm.com/blog/purpose-on-arm-frederique-olivier-photographer?utm_source=twitter&utm_medium=social-organic&utm_content=blog&utm_campaign=mk08_brand_na
🗓️ Join us on Wednesday November 6 for our next financial results conference call.
After market close, we'll report our earnings for the second quarter of fiscal year 2025, followed by a conference call to review our results and business outlook: https://newsroom.arm.com/news/arm-announces-earnings-release-date-for-second-quarter-fiscal-year-ended-2025?utm_source=twitter&utm_medium=social-organic&utm_content=newsroom&utm_campaign=mk29_exec-comms_na
6G is on the horizon, promising ultra-fast speeds, low latency, and seamless digital and physical experiences.
Learn what it takes to bring new AI capabilities to life on 6G: https://newsroom.arm.com/blog/arm-and-alphawave-semi-unite-on-6g-chiplets?utm_source=twitter&utm_medium=social-organic&utm_content=blog&utm_campaign=mk03_infrastructure_na
Experience new levels of performance and efficiency with the general availability of @GoogleCloud C4A VMs!
C4A features the Arm Neoverse V2-powered Google Axion CPU to support the most demanding AI & general purpose workloads: https://cloud.google.com/blog/products/compute/try-c4a-the-first-google-axion-processor
Congrats @GoogleCloud! 👏
Catch the full conversation to hear why suggesting AI is overhyped "couldn't be further from the truth": https://www.bloomberg.com/news/videos/2024-10-22/arm-ceo-dismisses-ai-bubble-fears-video
#BloombergTech
"AI is going to run on Arm. Period."
Arm is the only company on the planet that can run workloads of any size. There's plenty of opportunity to grow and drive innovation in the space, and we're leading this.
Thanks to #BloombergTech for having us!
