Accelerating Cloud Innovation with AWS Graviton4 Processors, Powered by Arm Neoverse
The cloud computing landscape is undergoing a dramatic transformation, driven by the explosive growth of AI. As AI applications become increasingly sophisticated and demanding, the need for powerful, efficient, and cost-effective computing solutions has never been greater. Customers deploying their workloads in the cloud are rethinking what infrastructure they need to meet the requirements of these modern workloads. Their requirements range from achieving better performance and reduced costs to achieving new benchmarks in energy efficiency for regulatory or sustainability goals.
Arm and AWS have a long-standing collaboration aimed at providing specialized silicon and compute, paving the way for a more efficient, sustainable, and powerful cloud. This week at AWS re:Invent 2024, you’ll see more evidence for how Graviton4 marks a significant leap forward, empowering developers and businesses to unlock the full potential of their cloud workloads.
Exceptional Performance Benefits
The latest Arm Neoverse V2 based AWS Graviton4 processors provide up to 30% better compute performance, 50% more cores, and 75% more memory bandwidth than previous generation Graviton3 processors. Thanks to these advantages, we are now seeing a significant adoption of AWS Graviton processors in the ecosystem and by customers.
The Arm Neoverse V2 platform includes new capabilities of the Armv9 architecture, such as high-performance floating-point and vector instruction support, with features like SVE/SVE2, Bfloat16, and Int8 MatMul delivering strong performance for AI/ML and HPC workloads.
AI/ML Workloads
To further drive adoption of AI workloads Arm launched Arm Kleidi earlier this year, collaborating with leading AI frameworks and the software ecosystem to ensure the full ML stack can benefit from out-of-the-box inference performance optimizations on Arm, allowing developers to build their workloads without needing extra Arm-specific expertise. We’ve showcased how these optimizations in Pytorch enable running LLMs such as Llama 3 80B and Llama 3.1 8B on AWS Graviton4 with significantly improved tokens/sec and time-to-first-token metrics.
The performance metrics have been documented in details in these blogs for LLM Inferencing with PyTorch and LLM3 on Graviton4.
HPC and EDA Workloads
For HPC workloads, Graviton4 marks a significant leap forward in capability compared to Graviton3E providing 16% more main-memory bandwidth per core, and a doubling of L2 cache per vCPU. These are significant for HPC application performance which is often memory-bandwidth bound, and AWS has managed to achieve benefits across these areas as shown below.
For EDA workloads, Graviton4 delivers up to 20% better performance over Graviton3 for RTL simulation workloads as measured by production runs conducted by Arm’s engineering teams.
Ecosystem Adoption
Over the last few years, we have seen a continual ramp in adoption across the software ecosystem with end customers deploying a wide range of cloud workloads on AWS Graviton processors. Customers are saving money, seeing better performance, and improving their carbon and sustainability footprints. Here are a few examples:
Upcoming AWS re:Invent 2024
If you are visiting AWS re:Invent 2024, you can check out the following key sessions on a wide range of topics related to AWS Graviton processors. For a full list of more than 60+ sessions on AWS Graviton, check out the event’s official agenda.
Get ready to harness the power of Graviton
We believe the future of cloud computing is undoubtedly Arm-powered, and are proud to support AWS in placing Graviton at the forefront of this revolution. Arm continues to invest in further strengthening our software ecosystem and removing any friction for developers to build on Arm – and to access all the performance and efficiency benefits the Arm compute platform delivers.
Developer resources
Here are some key resources and avenues to engage directly with us and AWS Graviton teams:
- Learn.arm.com: Explore in-depth technical resources on Arm architecture.
- Arm Software Ecosystem Dashboard: Discover applications and tools optimized for Arm.
- AWS Graviton Dashboard: Access information and support for Graviton instances.
- AWS Getting Started GitHub: Explore Graviton-related code samples and tools.
- AWS Partner Program: Connect with industry leaders building solutions for Graviton.
To arrange a meet-up with an Arm representative at AWS re:Invent 2024, please contact sw-ecosystem@arm.com
Any re-use permitted for informational and non-commercial or personal use only.
Editorial Contact
Latest on X
#AWSReinvent is just around the corner!
👇 Discover how to optimize the performance of your AI/ML workloads with Amazon EC2 instance types running on Arm-based Graviton processors- all while prioritizing sustainability and cost savings.
More details: https://okt.to/Gu59Bl
💪 We’re seeing great strides in XR adoption thanks to significant innovation from the tech industry.
Parag Beeraka shares how it’s happened and what that means for businesses and consumers alike: via @TechRadarPro
Are we on the verge of an XR wearable breakthrough?
How XR and AI will continue to unlock new possibilities
okt.to
We've been recognized by @TIME & @StatistaCharts as one of the World's Best Companies in Sustainable Growth.
By providing the industry with the most power-efficient & highest-performing compute platform, we're paving the way to sustainable & secure AI: https://okt.to/UvMTc9
The way we work is just as important as what we do.
Paula shares a glimpse into what she values most in her role as Senior Principal Engineer & Team Lead.
Visit our careers site and learn how you can make an impact.
It was an incredible week at #SC24 for solutions built on the Arm compute platform.
#ICYMI: At this year's @HPCWire 2024 awards, Arm-based products using NVIDIA Grace swept the floor.
🎉 Congratulations to our partners - we're proud to build the future of computing together.
Las Vegas came alive this weekend with the Formula 1 Grand Prix. 🏎️🏁
Did you catch the Grand Prix? And the key question... did you spot our billboard? 👀
Arm Tech Symposia 2024 was bigger and better than ever!🚀
This year, we brought the technology ecosystem together across China, Japan, South Korea, and Taiwan to explore the huge opportunities AI offers today.
Explore the highlights in our latest blog: https://newsroom.arm.com/blog/arm-tech-symposia-2024?utm_source=twitter&utm_medium=social-organic&utm_content=blog&utm_campaign=mk19_events_apactechsymposia
Where is on-device AI headed next? 📱
In @talkandroid, James McNiven, VP of Product Management, shares details on what to expect from the next-generation of AI-driven smartphone experiences and how the Arm compute platform is enabling these. ⏬
Interview With Arm: What’s Next For On-device AI On Smartphones? - Talk Android
On-device AI on smartphones is going places, and we talked with Arm's James McNiven to find out what's next for this powerhouse technology
okt.to
With the momentum we've seen at #MSIgnite around Azure Cobalt 100 VMs, we're excited to work with the ecosystem to enable the AI-accelerated future in a sustainable, scalable way on Arm Neoverse.
Get up to speed on what you might have missed from the show https://newsroom.arm.com/blog/arm-and-microsoft-igniting-a-new-era-of-cloud-computing-for-ai?utm_source=twitter&utm_medium=social-organic&utm_content=blog&utm_campaign=mk03_infrastructure_na
As proud investors in Enfabrica following its Series C Round, we look forward to supporting the team’s incredible growth on Arm Neoverse, enabling scalable networking solutions that meet the needs of demanding AI workloads.
👏 Congratulations, @enfabrica_!
Perseverance is a fundamental part of who we are as a company.
In the new State of European Tech documentary from @atomico, Rene Haas shares how this has enabled us to become the industry's highest-performing and most power-efficient compute platform 🔽
The State of European Tech Anniversary Documentary
As The State of European Tech celebrates its tenth anniversary, the team has gathered the most influential voices ...
okt.to
This is what a day in the life looks like for Graduate Product Manager, Conall Farney. 📹
Since joining us as a Sales Intern, Conall moved into a new role matching his growing passions.
Discover your path with us: https://okt.to/KdWshB
Game-changing quantum breakthrough: Equal1 runs Arm Cortex at 3.3 Kelvin (-269.85°C)!
Equal1's innovative approach could make quantum computing as accessible as traditional servers.
From drug discovery to AI, the future is getting cooler ❄️🌡️ https://newsroom.arm.com/blog/pushing-quantum-computing-boundaries-with-arm-equal1?utm_source=twitter&utm_medium=social-organic&utm_content=blog&utm_campaign=mk13_tech-strat_na
Here at Arm, we know that prioritizing your wellbeing is key to unlocking your potential.
👉 That’s why we’re committed to nurturing our team’s passions to drive innovation. Scroll through to hear what some of our people have to say about how Arm helps them thrive.
When software architecture isn't standardized, hardware changes can cause issues.
@SchneiderUKI collaborated with us to solve this challenge by bringing in Arm SystemReady, where new hardware works with the software:
SystemReady Implementation at Schneider Electric: Accelerating Development and Enhancing Platform...
How Schneider Electric leveraged Arm SystemReady to accelerate development, enhance platform flexibility and overcome supp...
newsroom.arm.com
Game-changing quantum breakthrough: Equal1 runs Arm Cortex at 3.3 Kelvin (-269.85°C)!
Equal1's innovative approach could make quantum computing as accessible as traditional servers. From drug discovery to AI, the future is getting cooler 🌡️❄️ https://newsroom.arm.com/blog/pushing-quantum-computing-boundaries-with-arm-equal1?utm_source=twitter&utm_medium=social-organic&utm_content=blog&utm_campaign=mk13_tech-strat_na
AI is causing a fundamental shift in data center infrastructure.
With the flexibility of the Arm compute platform and our relentless focus on energy efficiency and customization, we're at the center of this transformation. Here's why 👇
Arm in the Data Center: The Dawn of a New Era - Creative Strategies
Introduction: 2024 - The Tipping Point for Arm's Data Center Momentum As we close out 2024, the semiconductor indu...
creativestrategies.com
The combined power and performance of Arm and @GitHub is optimizing the developer experience and unlocking advances in AI.
Here's to many more years of partnership and building the future of AI #onArm. 💪
From versatility and cost-effectiveness to scalability and power efficiency, here's 5 key reasons why CPUs are the top choice for AI ⏬
Top 5 Reasons why CPU is the Best Processor for AI Inference - Embedded
Advanced artificial intelligence (AI), like generative AI, is enhancing all our smart devices. However, a common misco...
www.embedded.com
From on-CPU AI processing to chiplet-enabled designs, hyperscalers get more control, efficiency, and power to meet the demands of AI when building #onArm.
@TheNextPlatform shares how custom Arm CPUs are transforming the data center.
Custom Arm CPUs Drive Many Different AI Approaches In The Datacenter
Sponsored Feature Arm is starting to fulfill its promise of transforming the nature of compute in the datacenter, ...
www.nextplatform.com
Arm founding CEO & former chairman, Sir Robin Saxby, has been inducted into the City of London Engineering Hall of Fame!
This acknowledges the transformational impact of Saxby's work on the Arm compute platform, laying the foundation for who we are today: https://newsroom.arm.com/blog/sir-robin-saxby-city-of-london-engineering-hall-of-fame?utm_source=twitter&utm_medium=social-organic&utm_content=blog&utm_campaign=mk29_exec-comms_na
We're entering a new partnership with @Panasonic Automotive Systems.
To accelerate development cycles in the automotive industry, we'll adopt and extend VirtIO, the device virtualization framework that will help standardize vehicle architecture for SDVs: https://newsroom.arm.com/news/arm-and-panasonic-partner-to-standardize-sdvs?utm_source=twitter&utm_medium=social-organic&utm_content=newsletter&utm_campaign=mk12_automotive_na
We're delighted to welcome Charlotte Eaton back to Arm. 🎉
Charlotte rejoins us as Chief People Officer, drawing on her wealth of experience at Arm and in other leadership roles to empower our people to do the best work of their careers: https://newsroom.arm.com/news/arm-announces-appointment-of-charlotte-eaton-as-chief-people-officer?utm_source=twitter&utm_medium=social-organic&utm_content=newsroom&utm_campaign=mk29_exec-comms_na
Demand for the Arm compute platform remains strong in the age of AI.
In Q2 FYE25, we achieved record royalty revenue for Q2, with strong YoY growth thanks to the increased demand for energy-efficient compute and more complex AI chips built #onArm:
