Blog October 8, 2020
Arm Neoverse: A New Infrastructure for a New Era
Chris Bergey looks at how Arm Neoverse IP has changed the way data center architects think about performance and efficiency since its introduction in 2018 and the exciting possibilities ahead
By Chris Bergey, SVP and GM of the Client Business, Arm
In 1879, Edison’s light bulb not only lit
the world in a new and more useful way, it led to the construction of power
plants across the globe. Electricity became part of daily life, and this
changed the world profoundly in the decades following its introduction.
The same holds true for the Fifth Wave of Computing, a new digital infrastructure that is paving the way for smart homes and autonomous cars through the convergence of artificial intelligence (AI), 5G and the Internet of things (IoT). The Fifth Wave of Computing is emerging at a time when digital data demands are soaring.
As the demand to compute those soaring
levels of data grew a decade ago, the cloud computing model was able to handle the
load. But the quickening growth of data generation and consumption and the cost
to power ever larger cloud data centers has upset the apple cart. We’ve picked
the low-hanging fruit in the past 10 years to conserve power – finding
efficiency through virtualization, multi-tenancy, offloads and disaggregation.
Some experts say that more efficient AI
models and incremental improvements and storage and memory could keep energy
consumption flat. But others say power could increase by 2, 3 even 7x by the
end of the decade, dramatically raising both operational and capital costs
while slowing demand.
of compute efficiency
It doesn’t have to be this way. Since its
2018 introduction, our infrastructure-centric Arm Neoverse roadmap has
delivered cost savings, power efficiencies and compute-performance gains that
have changed the way data center architects think about compute resources.
Consider the uptake so far:
- AWS Graviton2 instances, using
the Arm Neoverse N1 platform, deliver up to 40 percent better price-performance
over the previous traditional instances.
- Silicon solutions such as
Ampere’s Altra (the industry’s first 80-core server processor based on the Arm
Neoverse N1 platform) are designed to deliver the performance-per-watt,
flexibility, and scalability their customers demand to win in their application
spaces. Oracle recently announced plans to bring an Ampere Altra-based offering
to Oracle Cloud beginning in early 2021.
- The world’s fastest
supercomputer, Japan’s Fugaku, is powered by Arm technology. It’s one of the
most efficient as well, according to the rankings on the annual Green 500 list.
- Marvell’s ThunderX3 features up
to 96 custom Arm v8.3 cores, following on from the Arm-based ThunderX2, which
was used for Microsoft Azure development.
These are just a few of the partner
implementations that have leveraged Arm. They’re doing it because it’s a
disruptive force that answers one of the most crucial design challenges today:
How to get more compute from the same power output. To paraphrase something Arm
CEO Simon Segars said recently on the topic of sustainability, if computers
have helped de-carbonize the world, then we must do more to decarbonize
compute. That comes down to better compute efficiency, more compute per watt.
More efficient compute also translates to
lower costs. Don MacAskill, CEO of SmugMug and Flickr who was Amazon Web
Service’s first customer in 2006, put it this way: “We are achieving same or
better performance (with Arm Neoverse) at a 30 percent cost reduction, which is
like negotiating a new contract for a huge discount without having to renegotiate
But the innovation doesn’t stop there. The Neoverse platform continues to evolve to meet the needs of our partners. The new Neoverse V1 platform is the first in the V-series and delivers a single-threaded performance uplift of more than 50% over N1. Neoverse N2 offers 40% higher single-threaded performance compared to Neoverse N1 and retains the same level of power and area efficiency as Neoverse N1.
The Neoverse platform in some ways is a bit
like Edison’s light bulb: It delivers something that had been available before
in different forms (in the case of Edison’s invention, light) but does so in a more
efficient and scalable way to transform industries fundamentally.
Consider that one of the unsung heroes of
the lightbulb revolution was a small mechanical feature we take for granted
today: electrical sockets. Once electrical sockets and light bulb base contacts
were standardized, the electric lighting market not only flourished but the
technological common ground opened a vast new scale for other electrically
powered appliances, from toasters to refrigerators and more.
It’s this spirit of standardization fueling scalability that led us recently to broaden the value of the Arm Neoverse platform with Project Cassini. Project Cassini is the open, collaborative initiative to ensure a cloud-native software experience across the Arm edge ecosystem. We’ve announced some new elements to Project Cassini this week that I know you’ll be excited to hear about.
Project Cassini is built from three
- Standards that allow for leveraged software development, while enabling hardware diversity to thrive, through the Arm SystemReady program, announced this week at Arm DevSummit. Building on the Arm ServerReady program, Arm SystemReady a foundational compliance certification program to enable software to seamlessly work, across a vibrant, diverse ecosystem of hardware.
- Security: APIs and Certification programs are needed that can be trusted by developers across ecosystems and workloads. These include PSA-Certified, a framework that gives an objective assessment of the quality of implementation for the device root-of-trust, and PARSEC, an open source project that provides secure root-of-trust abstraction and common runtime security services for applications in a platform and architecture-agnostic manner.
- Reference implementations: As market demands from the IoT often vary based on segment, defining use-case architectures could be quite complex. For example, a computer vision system for monitoring air conditioners will be far different than one for monitoring undersea oil wells. Project Cassini provides reference solutions, developed in partnership with the ecosystem, that support cloud-native stacks at the edge.
For silicon partners, ODMs, OEMs, ISVs, and end-users, Project Cassini unlocks the edge compute opportunity by accelerating the deployment of diverse, workload-optimized Arm platforms, enabled by an aggregation of cloud-native software development across the Arm edge ecosystem. It is that light socket-simple way that heterogeneous compute, so vital for the build-out of edge systems today, will scale.
Every decade or so, a powerful
transformation comes to technology. In infrastructure, we’re seeing a quiet
revolution in how we deliver and distribute compute. It can be distilled down
to a single word: choice. The days of homogeneous one-size-fits-all, server farms powered
by a single, legacy, general-purpose compute architecture are being displaced
by solutions that allow greater vendor choice and flexibility in how to distribute
processing at optimal points along the compute spectrum from cloud to edge. In
this way, the right resources can be layered in at the right points along the
The journey ahead is an exciting one.
Relentless IP innovation has been rewarded with partner adoption of the
disruptive, empowering Arm Neoverse platform that is delivering more compute
per watt in each successive generation. Now Project Cassini, developed with the
idea that infrastructure design needs to be easier, more standardized and more
secure, follows on and promises to propel developers into a new era of flexible
We’ve been engaging with leading companies at every level of the software stack, from networking and operating systems to languages and libraries, to ensure that developing on Arm is as easy as possible. We’re now a first-class citizen on many commercial and open source software solutions. Support for Arm is often ready to go on the first day of release. My colleague, Kevin Ryan, provides details about Arm’s progress across the cloud-native software ecosystem here.
This ecosystem has coalesced around hardware and software innovations to establish an intelligent, software-defined and highly sophisticated digital infrastructure. It’s an invisible fabric that makes everything else just work. Just like a light bulb.
Watch Chris Bergey’s Keynote at Arm DevSummit 2020
Register or log in for free and watch Chris Bergey’s keynote, A New Infrastructure for a New Era, at Arm DevSummit 2020.
Any re-use permitted for informational and non-commercial or personal use only.
Brian Fuller and Jack Melling