Neoverse Expands Further into Cloud with new Network-optimized Instances at AWS re:Invent
By Chris Bergey, SVP and GM, Infrastructure Line of Business, Arm
Just a few days ago, Arm celebrated its 30th anniversary creating an opportunity for us to reflect on many milestones and pivotal moments across the industry. There is one thing that stands out to me in this time of reflection and it is that the Arm ecosystem is powerful, and our ongoing collaboration with AWS is a great testament to this.
In 2015, AWS purchased Annapurna Labs, one of the pioneers in creating Arm-based silicon for hyperscale data centers and the edge. In 2017, AWS introduced Nitro, a new service for offloading networking, storage and security tasks onto an Arm-based, Annapurna-designed board. Nitro is now used extensively across AWS.
And in 2018, we saw the debut of Graviton, AWS’s first Arm Neoverse-based processor for general purpose application workloads which was followed by Graviton2, announced last year, offering 7x the compute performance over the first-generation Graviton processor.
The phrase “time flies” is particularly meaningful when I think about this work with Annapurna Labs and AWS. Only five years ago AWS welcomed Annapurna Labs to the family and today, more and more customers are leveraging the price performance- benefits of the world-class Arm-based processor known as Graviton2.
- Snap Inc. reduced Snapchat messaging fleet size and significantly lowered cost using Arm-based Graviton2 instances compared to previous generation x86-based instances, reducing CPU utilization by roughly 10%
- Honeycomb.io stated if they were to only run the Arm-powered M6g instance, they’d run 30% fewer instances and each instance would cost 10% less versus x86-based C5 instances
- NextRoll is saving almost 50% by switching to Graviton2 instances for web server and stream processing workloads
- Nielsen is achieving 2x performance in recent Graviton2 tests over the first-generation Graviton processor
- Intuit is showing 20% reduced cost Graviton2 instances over previous x86-powered instances
This is a small sample of the success AWS has seen with Graviton2-powered instances, and it is big proof of the efficiency of the Neoverse N1 design (and in fact, you can expect to hear more soon about how Arm is running some of its own internal workloads on Amazon EC2 instances!). These customer success stories parallel significant advancements made in the Arm software ecosystem supported in AWS. This includes support we’re seeing across the ecosystem from leading Linux distributions, Docker, Kubernetes container services, plus a wide range of developer tools, software and monitoring agents.
Just last week AWS added more to its Arm-based Graviton2-powered instances portfolio with the C6gn network-optimized instances delivering up to 100Gbps network bandwidth and up to 40% better price/performance relative to the current generation x86-based network optimized instances. These new instances are designed for workloads such as HPC, network appliance, real-time video communications, and data analytics that can take advantage of improved network bandwidth and packet processing performance, each of which are now 4x higher than the current generation network optimized instances. The EC2 C6gn instances will be available later this month.
Also new last week, AWS added Graviton2 CPUs to their AWS Outpost offering. More specifically, these will be 64 vCPU, 1U, 24” short-depth, low-power servers that should be an ideal fit for their targeted use cases – supporting on-prem compute in power and space constrained telco, manufacturing, retail and hospital locations. The addition of Graviton2 to AWS Outpost demonstrates the quick maturation of Arm Neoverse solutions into mainstream use cases and we’re excited about the possibilities it represents.
Our close collaboration with AWS has surfaced a change we see coming over the next decade and across many cloud providers; a stronger desire for custom silicon in addition to the traditional semiconductor model. This shift is due to insatiable workload demand, lack of Moore’s Law scaling, and the competitive pressure to deliver more differentiated services with greater customer value. Because there is no one-size-fits all approach to computing, it remains important that Arm continues to leverage its unique business model to allow for flexibility so our partners can obtain the right level of performance at the best power efficiency for their applications and workloads. The growing portfolio of Graviton2 EC2 instances are proof of that growth and continued effort to enable the evolving infrastructure.
At Arm, the responsibility to enable our ecosystem with the right compute for the right applications remains the North Star for Neoverse designs. AWS has opened doors for what cloud-optimized compute can do in powering a world of a trillion devices, and we are proud to be part of this collaborative journey that is really just beginning.
Any re-use permitted for informational and non-commercial or personal use only.
Media Contacts
Latest on Twitter
🗓️ Join us on Wednesday July 31 for our next financial results conference call.
After market close, we'll report our earnings results for the first quarter of fiscal year 2025, followed by a conference call to review our results and business outlook: https://okt.to/koqGT0
The "Write Once, Deploy Everywhere" approach to code is key to seamless deployment for developers.
Through expert talks and demos @WeAreDevs, we demonstrated how this is a game-changer for building and deploying next generation apps at scale.
Thanks to everyone who joined us!🙌
With the escalating need for power-efficient systems, @FujitsuFNC's turned to Arm to build the FUJITSU-MONAKA CPU - a processor designed to help achieve energy savings of 40% in Japanese data centers by 2030.
+ That's without compromising AI innovation: https://okt.to/WM0F3A
Arm KleidiAI brings 30% performance improvements to @Google AI Edge's MediaPipe and XNNPACK running the Gemma 2B LLM. 💪
This is the first integration of many, as we enable more LLMs to run as effectively and efficiently as possible on Arm mobile CPUs: https://okt.to/qLW8He
Flooding can happen anytime, but early warning systems can help reduce its impact on communities and protect lives.
We're proud to work with @UNICEF_uk and support the team in Karonga, Malawi to bring the latest in flood alert technology to communities:
How can developers stay ahead in the age of AI?
Andy Wafaa shares details on the tools required to optimize code, increase accessibility, and shape the future of computing at @WeAreDevs World Congress: https://okt.to/wJakX3
Since 2012, Raspberry Pi's been changing the game for businesses in the ecosystem.🚀
Founder & CEO, Eben Upton shares the origin story of Raspberry Pi and why he chose Arm as the architecture of choice:
Interview recorded in Jan 2023.
Arm Education in Conversation with Eben Upton
In this episode, we interview Eben Upton, founder and CEO of Raspberry Pi (Trading) Ltd. Eben shares with us the...
okt.to
In the age of AI, collaboration is crucial to solve technological and societal challenges.
Together with a group of academics at our Cambridge office, we've developed a "Call for Action," identifying the steps needed to ensure AI adoption in both the public and private sectors.
Ready to upscale your mobile game development without losing performance?
👉 Say hello to Arm Accuracy Super Resolution
It's our open source solution derived from FSR2, designed to increase the resolution of images from low to high with our efficient shader code:
.@AWSCloud Graviton4 is here! 🙌
Announced in GA, Graviton4 uses Arm Neoverse V2 to provide the most powerful, energy efficient AWS processor to date.
It follows 5+ years of collaboration on Graviton to enable CPU silicon innovation in the Amazon Cloud: https://okt.to/UWM0FR
Proud to partner with @AlzheimersBRACE to support dementia research and foster community. 🤝
From running the Bristol Half-Marathon to raising £2K+ for charity and spreading awareness, shoutout to our team for making a real impact. 💙
Not sure where to start with running Llama models? We've got you. Our 🆕 learning path teaches you how to build and run a simple Android Chat app with different Llama models using ExecuTorch and XNNPACK.
Dive into the step-by-step guide in the link below.
⚡ Silicon is defining and revolutionizing technology.
With the help of our partners, we're at the forefront of its evolution, driving innovative new approaches to silicon design with CSS and chiplets to define the future of computing.
More in @WSJ. 👇
Paid Program: The Evolution of Silicon
From Moore’s Law to today’s modern designs for AI, silicon is defining technology markets now and in the future.
okt.to
Arm CSS for Client is unleashing the power of the Armv9 architecture for AI innovation.
CSS for Client delivers physical implementations across Arm CPUs and GPUs, simplifying SoC builds for the fastest path to production silicon.
Learn more👇 https://okt.to/Q3yLjc
The advancements in large multimodal models and GenAI herald a new era in AI robotics.
That’s why tomorrow's robotics are harnessing the power of LLMs to improve energy efficiency, security, and functional safety.
🦾 And it's all happening #onArm: https://okt.to/6nbZ9m
The world's leading AI companies are prioritizing data center efficiency to scale and grow. And they're doing it #onArm.
Arm CMO Ami Badani joined The Artificial Human Podcast to discuss why efficiency is crucial to driving AI innovation.
The Artificial Human - How green is my AI? - BBC Sounds
Aleks Krotoski and Kevin Fong ask, how green is my AI?
okt.to
Here's a glimpse of our #INWED24 celebrations in Kenya, Ghana and Switzerland.
The Arm-Ambassador-led events brought everyone together to celebrate the significant impact of women engineers and to inspire future innovators to help bridge the STEM gap: https://okt.to/9ZAuna
Find $ARM in the Nasdaq-100 Index from today. 🙌
As we go from strength-to-strength as a public company, we're excited to join industry leading companies on the @Nasdaq stock exchange, emphasizing the importance of Arm tech among the global ecosystem: https://okt.to/gpRsAe
Create the best possible AI experiences with KleidiAI. ⚡
KleidiAI provides a collection of highly optimized AI kernels that can be embedded directly into popular AI frameworks as part of Kleidi Libraries.
Ready to reap the benefits?
🥳 Our partners @HPE and @NVIDIA are making turnkey private-cloud AI a reality!
Announced this week, NVIDIA AI Computing by HPE brings the power and efficiency of Grace Hopper Superchips, built #onArm, to the HPE ProLiant Compute DL384 Gen12 server.
HPE ProLiant Compute DL384 Gen12 | HPE Store United Kingdom
okt.to
For #WorldRefugeeDay, we're celebrating our partnership with @Refugees & @UNRefugeesUK to ensure AI tools for humanitarian efforts are used responsibly.
By supporting @UNHCRinnovation, we can ensure diversity is built into tools from the ground up:
We're putting the foundations in place for a thriving, diverse, chiplet ecosystem in Automotive.
From participation in @imec_int's Automotive Chiplet Program, to our role in SOAFEE, here's how we're ensuring interoperability and performance for chiplets: https://okt.to/eBfYgd
Here's to our fantastic, award-winning Internal Comms team. 👏
At the #ICEAwards, the team took home 3️⃣ awards for:
⭐ Best event
⭐ Best Internal Comms from the tech, media and telecommunications sector
⭐ Best Internal Comms Campaign in a large business under 10,000 employees
Rene Haas joined the Samsung Foundry Forum to discuss our almost 30-year partnership and the possibilities of Arm CSS.
By removing the complexity from SoC development, Arm CSS enables our partners to move faster in the age of AI, with the support of partners like Samsung.
