Specialized Processing is Driving the Era of Arm-based Cloud Computing, Enabling AWS Graviton Innovation
By Chris Bergey, SVP and GM, Infrastructure Line of Business, Arm
When AWS acquired Annapurna Labs in 2015, they had a vision of changing how the cloud is delivered with the Nitro system. Now, Graviton has become an extension of that innovation, driving more choice and the best possible customer experiences across the entire infrastructure stack. As AWS’ offerings from cloud to edge expanded, our ongoing collaboration surfaced a growing need for specialized processing to unleash the true potential for next-generation infrastructure.
AWS Graviton and Graviton2 revealed the benefits of Arm-based compute in the cloud and the flexibility it continues to bring customers and developers alike across various verticals. The growth and success of those Arm-based processors hasn’t stopped. The price-performance advantages of Arm-based cloud instances have permeated across the AWS service portfolio:
- AWS has seen rapid adoption of Arm-based Graviton2 processors with thousands of customers including Epic Games, whose Fortnite video game has more than 350 million accounts registered, to SmugMug/Flickr, one of the world’s largest photo sites, to Formula 1, Snap Inc., and many more.
- Arm-based Graviton2 powered instances boast nine instance families that span 23 regions across the globe. The growing service portfolio is more diverse than ever with new G5g instances providing the best price performance for Android game streaming and cost-effective machine learning (ML) inference and Im4gn/Is4gen instances for best price performance for storage intensive applications revealed just this week.
- Arm-based Graviton2 powered managed services are making it quicker and easier than ever for customers to realize the benefits of Graviton2.
- Arm-based Graviton2 is now available in AWS Outposts Servers designed for on-premises and edge locations that have limited space or need access to low latency compute, such as retail stores, branch offices, healthcare provider locations, or factory floors.
- And AWS Graviton2 instances are playing an increasingly critical role in supporting the annual Amazon Prime Day, one of the busiest e-commerce days of the year, at scale. Per the AWS team this was a strong indicator that the Arm architecture is well-suited to the cloud.
Datacenter workloads and internet traffic are nearly doubling every two years, so performance per watt benefits are crucial to keep computing from increasing its carbon footprint. The growth of Arm in the cloud is giving developers a choice to continue to innovate sustainably by providing consistent performance and scalability on a per core basis, enabling a combination of scalable performance and efficiency to deliver industry leading TCO. AWS has continued to play an important role in showcasing the benefits of Arm IP to the cloud computing market, from AWS Nitro to the first introduction of Graviton instances in 2018 to today.
This week AWS achieved its next Arm technology milestone with AWS Graviton3, which delivers 25% more performance for compute intensive workloads. Additionally, Graviton3 achieves up to 2x floating point performance on machine learning, gaming, and media encoding workloads and up to 2x faster performance for cryptographic workloads. Graviton3 supports bfloat16 data to deliver 3x better performance for machine learning workloads. All of this while using up to 60% less energy.
Even more, AWS revealed C7g instances powered by new Graviton3 processors and these are available in preview. C7g is the first cloud instance to support DDR5, enabled by Arm Neoverse, to allow for more memory bandwidth and unlock even more performance. Customers like Twitter are already testing C7g instances in beta and seeing 20-80% higher performance over C6g instances.
The performance, cost and efficiency advantages of Arm-based Graviton processors are enhancements we benefit from within our own company as well. Last year, we migrated a significant percentage of design and verification EDA workloads to AWS Graviton2 instances to not only reduce our global datacenter footprint, but also to take advantage of unlimited elasticity. To-date, we have seen a 6x improvement in the time it takes to complete some EDA workflows, while reducing the cost by 30% compared to the use of legacy processors. We look forward to the performance gains that Graviton3 instances will bring as we migrate even more of our complex workloads with maximum performance and minimum energy consumption.
The growing ecosystem of HPC and cloud native applications that have been optimized for the Graviton family of processors has reinforced that high-performance combined with low power, low cost, flexibility and compatibility are key principles in the next era of computing. We expect Graviton3 to continue the upward trajectory of delivering even more compelling price performance for a broad set of applications, highlighting the important role of specialized processing for greater efficiency in the next era of cloud computing.
Additional Resources
Any re-use permitted for informational and non-commercial or personal use only.
Media Contacts
Latest on Twitter
🗓️ Join us on Wednesday July 31 for our next financial results conference call.
After market close, we'll report our earnings results for the first quarter of fiscal year 2025, followed by a conference call to review our results and business outlook: https://okt.to/koqGT0
The "Write Once, Deploy Everywhere" approach to code is key to seamless deployment for developers.
Through expert talks and demos @WeAreDevs, we demonstrated how this is a game-changer for building and deploying next generation apps at scale.
Thanks to everyone who joined us!🙌
With the escalating need for power-efficient systems, @FujitsuFNC's turned to Arm to build the FUJITSU-MONAKA CPU - a processor designed to help achieve energy savings of 40% in Japanese data centers by 2030.
+ That's without compromising AI innovation: https://okt.to/WM0F3A
Arm KleidiAI brings 30% performance improvements to @Google AI Edge's MediaPipe and XNNPACK running the Gemma 2B LLM. 💪
This is the first integration of many, as we enable more LLMs to run as effectively and efficiently as possible on Arm mobile CPUs: https://okt.to/qLW8He
Flooding can happen anytime, but early warning systems can help reduce its impact on communities and protect lives.
We're proud to work with @UNICEF_uk and support the team in Karonga, Malawi to bring the latest in flood alert technology to communities:
How can developers stay ahead in the age of AI?
Andy Wafaa shares details on the tools required to optimize code, increase accessibility, and shape the future of computing at @WeAreDevs World Congress: https://okt.to/wJakX3
Since 2012, Raspberry Pi's been changing the game for businesses in the ecosystem.🚀
Founder & CEO, Eben Upton shares the origin story of Raspberry Pi and why he chose Arm as the architecture of choice:
Interview recorded in Jan 2023.
Arm Education in Conversation with Eben Upton
In this episode, we interview Eben Upton, founder and CEO of Raspberry Pi (Trading) Ltd. Eben shares with us the...
okt.to
In the age of AI, collaboration is crucial to solve technological and societal challenges.
Together with a group of academics at our Cambridge office, we've developed a "Call for Action," identifying the steps needed to ensure AI adoption in both the public and private sectors.
Ready to upscale your mobile game development without losing performance?
👉 Say hello to Arm Accuracy Super Resolution
It's our open source solution derived from FSR2, designed to increase the resolution of images from low to high with our efficient shader code:
.@AWSCloud Graviton4 is here! 🙌
Announced in GA, Graviton4 uses Arm Neoverse V2 to provide the most powerful, energy efficient AWS processor to date.
It follows 5+ years of collaboration on Graviton to enable CPU silicon innovation in the Amazon Cloud: https://okt.to/UWM0FR
Proud to partner with @AlzheimersBRACE to support dementia research and foster community. 🤝
From running the Bristol Half-Marathon to raising £2K+ for charity and spreading awareness, shoutout to our team for making a real impact. 💙
Not sure where to start with running Llama models? We've got you. Our 🆕 learning path teaches you how to build and run a simple Android Chat app with different Llama models using ExecuTorch and XNNPACK.
Dive into the step-by-step guide in the link below.
⚡ Silicon is defining and revolutionizing technology.
With the help of our partners, we're at the forefront of its evolution, driving innovative new approaches to silicon design with CSS and chiplets to define the future of computing.
More in @WSJ. 👇
Paid Program: The Evolution of Silicon
From Moore’s Law to today’s modern designs for AI, silicon is defining technology markets now and in the future.
okt.to
Arm CSS for Client is unleashing the power of the Armv9 architecture for AI innovation.
CSS for Client delivers physical implementations across Arm CPUs and GPUs, simplifying SoC builds for the fastest path to production silicon.
Learn more👇 https://okt.to/Q3yLjc
The advancements in large multimodal models and GenAI herald a new era in AI robotics.
That’s why tomorrow's robotics are harnessing the power of LLMs to improve energy efficiency, security, and functional safety.
🦾 And it's all happening #onArm: https://okt.to/6nbZ9m
The world's leading AI companies are prioritizing data center efficiency to scale and grow. And they're doing it #onArm.
Arm CMO Ami Badani joined The Artificial Human Podcast to discuss why efficiency is crucial to driving AI innovation.
The Artificial Human - How green is my AI? - BBC Sounds
Aleks Krotoski and Kevin Fong ask, how green is my AI?
okt.to
Here's a glimpse of our #INWED24 celebrations in Kenya, Ghana and Switzerland.
The Arm-Ambassador-led events brought everyone together to celebrate the significant impact of women engineers and to inspire future innovators to help bridge the STEM gap: https://okt.to/9ZAuna
Find $ARM in the Nasdaq-100 Index from today. 🙌
As we go from strength-to-strength as a public company, we're excited to join industry leading companies on the @Nasdaq stock exchange, emphasizing the importance of Arm tech among the global ecosystem: https://okt.to/gpRsAe
Create the best possible AI experiences with KleidiAI. ⚡
KleidiAI provides a collection of highly optimized AI kernels that can be embedded directly into popular AI frameworks as part of Kleidi Libraries.
Ready to reap the benefits?
🥳 Our partners @HPE and @NVIDIA are making turnkey private-cloud AI a reality!
Announced this week, NVIDIA AI Computing by HPE brings the power and efficiency of Grace Hopper Superchips, built #onArm, to the HPE ProLiant Compute DL384 Gen12 server.
HPE ProLiant Compute DL384 Gen12 | HPE Store United Kingdom
okt.to
For #WorldRefugeeDay, we're celebrating our partnership with @Refugees & @UNRefugeesUK to ensure AI tools for humanitarian efforts are used responsibly.
By supporting @UNHCRinnovation, we can ensure diversity is built into tools from the ground up:
We're putting the foundations in place for a thriving, diverse, chiplet ecosystem in Automotive.
From participation in @imec_int's Automotive Chiplet Program, to our role in SOAFEE, here's how we're ensuring interoperability and performance for chiplets: https://okt.to/eBfYgd
Here's to our fantastic, award-winning Internal Comms team. 👏
At the #ICEAwards, the team took home 3️⃣ awards for:
⭐ Best event
⭐ Best Internal Comms from the tech, media and telecommunications sector
⭐ Best Internal Comms Campaign in a large business under 10,000 employees
Rene Haas joined the Samsung Foundry Forum to discuss our almost 30-year partnership and the possibilities of Arm CSS.
By removing the complexity from SoC development, Arm CSS enables our partners to move faster in the age of AI, with the support of partners like Samsung.
