Arm at Computex 2024: The path to 100+ Billion Arm Devices Ready for AI by 2025
On the opening day of Computex 2024 in Taipei, Arm CEO Rene Haas shared how the company is enabling 100+ billion Arm devices ready for AI from cloud to edge by 2025.
Do we have enough energy for AI?
One of the key questions Haas addressed was if the world has enough energy to power the increasing compute needs of AI. While we have seen some amazing innovation around AI, the industry is in an interesting dilemma where the better the processors get to handle the performance requirements of AI, the greater the energy demands.
With Arm’s DNA born of devices designed to run off batteries, Haas believes this is why we’re seeing greater adoption of Arm by leading cloud service providers such as AWS, Google, and Microsoft. Arm is the world’s most power-efficient CPU, and the power savings it delivers are already driving incredible AI innovation according to Haas.
It’s all about the software
Leading power-efficiency is what Arm has been most known for over the company’s 30+ year history and the foundation of what has enabled it to become the world’s most pervasive compute platform. Yet according to Haas, what really makes Arm unique is a software ecosystem unlike any other.
As Haas pointed out, Arm has become the de-facto choice for every major operating system in the world. The AI PCs recently announced by Microsoft are a great example of this, where the most-used apps are now running natively on Windows on Arm. In fact, with an ecosystem of 18 million software developers, more developers design on Arm CPUs than any other processor today.
This developer support is incredibly important if we want to experience the societal changes AI can unleash from the tiniest devices at the edge to training and inference in the cloud. Developers need to be able to take the innovation they are doing with AI and have it run on the hardware in a performant, power-optimized, highly executable and predictable state.
To ensure this happens on the Arm compute platform, Haas introduced Arm KleidiAI, part of a new suite of AI compute libraries that make it easier for developers to run their AI applications on Arm. Haas said, “If there’s anything we’ve learned over Arm’s 30-plus years, as great as the hardware is, if you don’t have something that developers can get access to, the hardware is not going to do you much good.”
For example, as developers work on their models in frameworks such as TensorFlow, PyTorch, Llama 3 and MediaPipe, KleidiAI enables them to go into the abstraction layer and take advantage of the underlying hardware features for AI workloads to achieve their full performance potential.
To speak to the advantages of KleidiAI from an ecosystem perspective, Haas shared videos of executives from Samsung Mobile, Meta and Google on how Arm and KleidiAI will enable them to accelerate AI innovation on Arm across multiple markets.
Arm Compute Subsystems for Client
In addition to all the great work Arm is doing to enable the AI developer ecosystem, it needs to continue to deliver higher-performing and more power-efficient products. To share more on this, Chris Bergey, SVP and GM for Arm’s Client Line of Business, took the stage to talk about the recently announced Arm Compute Subsystems (CSS) for client devices.
This is the first time that Arm has introduced physical implementations of its CPUs and GPUs in leading edge 3 nanometer nodes. According to Bergey, this is important because the Arm ecosystem can now take proven, physical implementations of these cores on leading 3 nanometer nodes and get to market faster with greater confidence.
CSS for Client enables chipmakers to focus on their differentiation around the platform and what Armv9 architecture can bring to their next-generation products. When you combine this with KIeidiAI, developers have the tools required to take full advantage of these next-generation hardware technologies.
Haas closed by further reinforcing Arm’s commitment to AI by delivering the most complete compute platforms on the planet. With innovations like Arm CSS and Kleidi AI, he expects that more than 100 billion Arm devices will be ready for AI by the end of 2025. It’s an incredible number of devices that Haas said will not only reshape the industry but also the entire planet.
Watch the full keynote here.
Any re-use permitted for informational and non-commercial or personal use only.
Editorial Contact
Latest on Twitter
Proud to partner with @AlzheimersBRACE to support dementia research and foster community. 🤝
From running the Bristol Half-Marathon to raising £2K+ for charity and spreading awareness, shoutout to our team for making a real impact. 💙
Not sure where to start with running Llama models? We've got you. Our 🆕 learning path teaches you how to build and run a simple Android Chat app with different Llama models using ExecuTorch and XNNPACK.
Dive into the step-by-step guide in the link below.
⚡ Silicon is defining and revolutionizing technology.
With the help of our partners, we're at the forefront of its evolution, driving innovative new approaches to silicon design with CSS and chiplets to define the future of computing.
More in @WSJ. 👇
Paid Program: The Evolution of Silicon
From Moore’s Law to today’s modern designs for AI, silicon is defining technology markets now and in the future.
okt.to
Arm CSS for Client is unleashing the power of the Armv9 architecture for AI innovation.
CSS for Client delivers physical implementations across Arm CPUs and GPUs, simplifying SoC builds for the fastest path to production silicon.
Learn more👇 https://okt.to/Q3yLjc
The advancements in large multimodal models and GenAI herald a new era in AI robotics.
That’s why tomorrow's robotics are harnessing the power of LLMs to improve energy efficiency, security, and functional safety.
🦾 And it's all happening #onArm: https://okt.to/6nbZ9m
The world's leading AI companies are prioritizing data center efficiency to scale and grow. And they're doing it #onArm.
Arm CMO Ami Badani joined The Artificial Human Podcast to discuss why efficiency is crucial to driving AI innovation.
The Artificial Human - How green is my AI? - BBC Sounds
Aleks Krotoski and Kevin Fong ask, how green is my AI?
okt.to
Here's a glimpse of our #INWED24 celebrations in Kenya, Ghana and Switzerland.
The Arm-Ambassador-led events brought everyone together to celebrate the significant impact of women engineers and to inspire future innovators to help bridge the STEM gap: https://okt.to/9ZAuna
Find $ARM in the Nasdaq-100 Index from today. 🙌
As we go from strength-to-strength as a public company, we're excited to join industry leading companies on the @Nasdaq stock exchange, emphasizing the importance of Arm tech among the global ecosystem: https://okt.to/gpRsAe
Create the best possible AI experiences with KleidiAI. ⚡
KleidiAI provides a collection of highly optimized AI kernels that can be embedded directly into popular AI frameworks as part of Kleidi Libraries.
Ready to reap the benefits?
🥳 Our partners @HPE and @NVIDIA are making turnkey private-cloud AI a reality!
Announced this week, NVIDIA AI Computing by HPE brings the power and efficiency of Grace Hopper Superchips, built #onArm, to the HPE ProLiant Compute DL384 Gen12 server.
HPE ProLiant Compute DL384 Gen12 | HPE Store United Kingdom
okt.to
For #WorldRefugeeDay, we're celebrating our partnership with @Refugees & @UNRefugeesUK to ensure AI tools for humanitarian efforts are used responsibly.
By supporting @UNHCRinnovation, we can ensure diversity is built into tools from the ground up:
We're putting the foundations in place for a thriving, diverse, chiplet ecosystem in Automotive.
From participation in @imec_int's Automotive Chiplet Program, to our role in SOAFEE, here's how we're ensuring interoperability and performance for chiplets: https://okt.to/eBfYgd
Here's to our fantastic, award-winning Internal Comms team. 👏
At the #ICEAwards, the team took home 3️⃣ awards for:
⭐ Best event
⭐ Best Internal Comms from the tech, media and telecommunications sector
⭐ Best Internal Comms Campaign in a large business under 10,000 employees
Rene Haas joined the Samsung Foundry Forum to discuss our almost 30-year partnership and the possibilities of Arm CSS.
By removing the complexity from SoC development, Arm CSS enables our partners to move faster in the age of AI, with the support of partners like Samsung.
Sentiment analysis is a vital AI technique that figures out emotions and opinions from written text.
With @HuggingFace's pipeline running on Arm Neoverse CPUs, we're making sentiment analysis quicker, with more impactful insights.
👉 See for yourself:
The next generation of Windows on Arm is here. ✨
We caught up with @sinclairinat0r at Microsoft Build to get his take on the latest Windows on Arm AI capabilities and how they are making AI approachable and easy to use.
From the moment he saw his first computer, Samuel fell in love with technology.
Now, it extends to his work at @Simprints, where their biometric solution built #onArm is enabling faster patient tracking and healthcare interventions.
This is how technology can change lives.
🆕 Slack is Windows on Arm ready! 🥳
Available now in beta, the ARM64 version of @SlackHQ lets you maximize performance on Arm-based hardware.
This creates the opportunity for new AI experiences running efficiently on Windows on Arm devices.
More: https://okt.to/oqMg25
Congrats to the winner of the 2024 Arm Flexible Access for Startups Contest, Agate Sensors! 👏
Chosen for its spectral imaging technology that paves the way for edge tech, the team will receive up to $250K of Arm credit to build next-gen SoC solutions: https://okt.to/Fbqrph
No other ecosystem has Arm's level of diversity & collaboration in its supply chain.
It's why Arm Neoverse is best suited to drive the transformation of AI-ready cloud data centers, together with our partners.
Eddie Ramirez shares more at #COMPUTEX2024: https://okt.to/WFqu7R
"We are at a magical time in our industry relative to the growth potential"
Following the biggest IPO of 2023, Rene Haas speaks to the @FT on the AI opportunity for Arm, discussing why the CPU is crucial, sustainable development & what's next for Arm CSS.
Rene Haas: ‘Arm has the most ubiquitous computer architecture on the planet’
Chip designer’s chief executive talks about diversification and how AI is changing the devices we use
okt.to
Our Architecture Formal Team has won the @RAEngNews Colin Campbell Mitchell Award, paving the way for more reliable computing systems.
Their ground-breaking approach to formal specifications enables efficient & secure Arm-based computing systems. https://okt.to/m8y1Qp
Introducing @GitHub-hosted runners for Arm! 🌟
Announced this week, the Arm-based Linux and Windows runners for Git Hub Actions let you build and test cycles directly on Arm Neoverse processors.
Get started and simplify the development process 👉 https://okt.to/7BXgNQ
For AI to scale it needs a mix of computing options.
Small language models, which can run on Arm Neoverse-based server processors, offer tailored solutions with reduced costs.
This sets the stage for generative AI in the cloud running on Arm CPUs:
