New Arm IP Brings Intelligent, Immersive Experiences to Mainstream Markets
By Paul Williamson, vice president and general manager, Client Line of Business, Arm
News Highlights:
- Arm Ethos-N57 and Ethos-N37 NPUs; extending the range of Arm Machine Learning (ML) processors to enable Artificial Intelligence (AI) applications in mainstream devices
- Arm Mali-G57 GPU; the first mainstream Valhall architecture-based GPU delivering 1.3x better performance over previous generations
- Arm Mali-D37 DPU; delivering a rich display feature set within the smallest area for full HD and 2K resolution
Once the preserve of premium devices, immersive experiences such as AR, high-fidelity gaming, and new AI-based use cases across mobile and home are now being demanded by the mainstream market. Giving developers access to high-performance AI and media IP solutions optimized for everyday devices enables new AI driven use cases, with features such as voice recognition and always-on capabilities, no longer unique to mobile.
AI intelligence is now everywhere from gaming devices to digital TVs (DTVs), and increased compute at the endpoint is required to allow for these responsive experiences. For example, intelligent experiences in DTVs range from smart assistant voice commands, real-time translation for shows in another language, and face recognition to enhance parental controls.
To deliver this, I’m pleased to announce that Arm is launching two new mainstream ML processors, as well as our latest Mali graphics and display processors. Together, this IP represents Arm’s ability to scale, bringing premium experiences to everyday and ultra-efficient consumer devices. The new suite of IP includes:
- Ethos-N57 and Ethos-N37 NPUs; enabling AI applications and balancing ML performance with cost, area, bandwidth, and battery life constraints
- Mali-G57 GPU; the first mainstream Valhall architecture-based GPU, bringing immersive experiences through performance improvements
- Mali-D37 DPU; delivering a rich display feature set within the smallest area, making it the perfect DPU for entry-level devices and small display screens
Ethos-N57 and Ethos-N37 NPUs: enabling truly heterogeneous compute
Following the earlier introduction of the Arm ML processor (now referred to as the Ethos-N77), the Ethos-N57 and Ethos-N37 are the newest members of the Ethos NPU family. Arm Ethos is a suite of products designed to solve complex AI and ML compute challenges allowing the creation of more personalized, immersive experiences in everyday devices. As consumer devices become smarter there is a need for additional AI performance and efficiency via dedicated ML processors. Optimized for the most cost and battery life-sensitive designs, the new Ethos NPUs deliver premium AI experiences on our everyday devices.
Both the Ethos-N57 and Ethos-N37 are designed with some basic principals in mind, for example:
- Optimized around support for Int8 and Int16 datatypes
- Advanced data management techniques minimizing data movement and associated power
- Over 200% performance uplift over many other NPUs through techniques such as innovative Winograd implementation
Further, Ethos-N57 features include:
- Designed to provide a balance of ML performance and power efficiency
- Optimized for 2 TOP/s ML performance range
Ethos-N37 features include:
- Design to provide the smallest footprint ML inference processor (<1mm2)
- Optimized for 1 TOP/s ML performance range
For more information on the Ethos-N57 and Ethos-N37 NPUs, read our blog.
Mali-G57: GPU that brings intelligent and immersive experiences to the mass market
Mali-G57 brings premium intelligent and immersive user experiences – such as high-fidelity gaming, console-like graphics on mobile, 4K/8K user interfaces on DTVs, and more complex augmented and virtual reality workloads – to the mainstream. This is the biggest segment of the mobile market and our recent announcement with Unity highlights our work to further optimize performance on Arm-based SoCs, CPUs, and GPUs, allowing developers to spend more time creating new content.
Key features of Mali-G57 include:
- 1.3x better performance density across a range of content compared to Mali-G52
- 1.3x improvements in energy efficiency leading to longer battery life
- Foveated rendering support for VR and 60 percent better on-device ML performance for more complex xR workloads
For more information on the Mali-G57, read our blog.
Mali-D37: Arm’s most area efficient display processor
The Mali-D37 DPU packs a rich array of display and performance features within the smallest area possible. For the end-user, this means better visuals and performance on lower cost devices where area matters most, such as entry-level smartphones, tablets, and small display screens up to 2K.
Key features of Mali-D37 include:
- Extreme area efficiency, with DPU configurable to an area of less than 1mm2 on 16nm for Full HD and 2K resolutions
- System power savings of up to 30% through offloading core display tasks from the GPU and memory management features, including MMU-600
- Preservation of key display features from premium Mali-D71, including mixed HDR and SDR composition when combined with Assertive Display 5
For more information on the Mali-D37, read our blog.
This new set of IP has been designed with a solution approach in mind, in line with our Total Compute initiative, ensuring it is experience driven and optimized to solve the complex compute challenges of tomorrow’s workloads. Offering higher area efficiency and power savings while increasing performance, the new IP drives to reduce cost and time to market; bringing more high fidelity gaming and console-like experiences to mobile, compute capability to DTVs, and more ML performance for personalized immersive content with increased responsiveness consumers have become accustomed to. Keep watching the mainstream space; the evolution of these devices is about to get exciting!
Any re-use permitted for informational and non-commercial or personal use only.
Media Contacts
Latest on Twitter
🚀 @Vivo_GLOBAL's X200 series has launched!
Will Abbey, EVP and Chief Commercial Officer, joined vivo on stage to celebrate the performance and AI capabilities of the new X200 series built #onArm with @MediaTek's Dimensity 9400 chipset.
@RebellionsAI @alphawavesemi @Cadence @ProteanTecs Discover more about Arm Total Design and its role in the future of AI-powered computing at #OCPSummit24, where you can join us for talks, demos, and partner showcases to learn about the next era of built-for-AI silicon - #onArm.
@RebellionsAI @alphawavesemi 3️⃣ Arm Total Design partners including @alphawavesemi, @Cadence and @ProteanTecs are validating their third-party IP products with CSS on advanced nodes - helping to provide an out-of-the-box software experience with Neoverse CSS-based custom silicon on leading edge nodes.
@RebellionsAI 2️⃣ Neoverse CSS and Arm Total Design are helping to create the hardware foundation for the sustainable AI datacenter with 2x new chiplets announced from Alcor Micro and @alphawavesemi, both on Arm CSS. 💪
1️⃣ Together with Samsung Foundry, ADTechnology and @RebellionsAI, we're bringing an AI CPU chiplet platform to market, based on Arm Neoverse CSS V3.
This promises to deliver unparalleled performance and optimal power efficiency for cloud, HPC and AI/ML training and inference.
🆕 After doubling in size in just a year, we're excited to share new updates on the chiplet innovation we're seeing from the Arm Total Design ecosystem. 🧵
By uniting on Arm CSS, we're building solutions for the AI datacenters of the future. Details: https://newsroom.arm.com/news/arm-total-design-sustainable-ai-datacenter?utm_source=twitter&utm_medium=social-organic&utm_content=blog&utm_campaign=mk03_infrastructure_na
Discover why all infrastructure market leaders choose Arm Neoverse to power their data center transformation at #OCPSummit24.
📍 Booth #B12
👉 Catch one of our talks, agenda below
📅 Tuesday-Thursday
See you there!
Arm is ✨the✨ compute platform for AI
From cloud to edge, our CPUs help software developers & our partners create highly customized silicon solutions.
➕They’re the ideal companion if you’re looking for a flexible heterogeneous computing approach to AI: https://newsroom.arm.com/blog/arm-compute-platform-ai-accelerator-technologies?utm_source=twitter&utm_medium=social-organic&utm_content=blog&utm_campaign=mk13_tech-strat_na
We've committed to join @imec_int's Automotive Chiplet Program! 🤝
Announced today, the program brings together industry leaders to evaluate, shape and define the best chiplet architecture for future vehicles, prioritizing performance and safety.
Arm, ASE, BMW Group, Bosch, Cadence, Siemens, SiliconAuto, Synopsys, Tenstorrent and Valeo commit...
Imec invites the global automotive ecosystem to join its effort to mutually explore the opportunities presented by chiplet technology
www.imec-int.com
.@MediaTek's Dimensity 9400 Chipset is here! 🚀
This flagship SoC features Armv9.2 CPU architecture and Immortalis-G925 GPU to to put PC level performance in the palm of your hands.
This enables a new world of immersive gaming and edge AI applications:
Arm and MediaTek Deliver Performance and Efficiency for AI Experiences
From smartphones to IoT, MediaTek leverages the Arm cutting-edge architecture to bring new possibilities to the market.
www.arm.com
"We're at the beginning of a new industrial revolution"
Rene Haas is joined by @NVIDIA CEO Jensen Huang on the 1st episode of Tech Unheard.
🎧 Listen in as Jensen introduces the AI factory, where intelligence is now manufactured at large volumes: https://newsroom.arm.com/podcasts/tech-unheard-episode-one-jensen-huang?utm_source=twitter&utm_medium=social-organic&utm_content=podcast&utm_campaign=mk29_exec-comms_na
🤝 Together with @AIatMeta, we're driving open innovation to optimize LLM performance.
Hear from Sy Choudhury, Director of AI Partnerships, as he shares insights on our long-standing collaboration to accelerate AI software development and empower the developer community.
Arm CMO Ami Badani joins @svtechtalks to explore the future of AI and what's next for on-device inference.
🎥 Tune in as Ami shares why industry-wide collaboration, with the Arm compute platform at the foundation, is essential to enabling AI everywhere.
#ICYMI: Amazon launched its new tablets with gen AI-powered features built #onArm.
With Arm technology, users get faster performance in everything from streaming to AI features, as well as better battery life.
Congrats, @Amazon team!
Meet Amazon’s new lineup of Fire HD 8 tablets, now with 50% more RAM for enhanced performance
Plus, we’re introducing brand-new generative AI-powered experiences to the Fire tablet family.
www.aboutamazon.com
⚡ Get exceptional GPU performance with Arm Immortalis and the Samsung Galaxy Tab S10 Ultra and S10+.
These are the first tablets to benefit from @MediaTek's Dimensity 9300+ SoC, built on Arm Immortalis-G720 GPU and the high-performance Arm CPU Cluster: https://newsroom.arm.com/blog/samsung-galaxy-tab-s10-ultra-arm-immortalis-gpu?utm_source=twitter&utm_medium=social-organic&utm_content=blog&utm_campaign=mk04_client_na
🎙️ Jason Child joined @AfterEarnings to talk about our post-IPO growth and the exciting chapter we're navigating in the age of AI.
Listen in to hear:
➡️ Why the largest tech companies build AI #onArm
➡️ How we get 30K resumes a month
➡️ What's next
🔗 https://www.youtube.com/watch?v=u8KQgw-O29Y
Ethos-U55 NPU + TinyML = High performance ✨
From reducing latency and preserving privacy to facilitating real-time use cases such as face detection, microcontrollers can run more complex models than ever before.
Discover more 👉: https://community.arm.com/arm-community-blogs/b/ai-and-ml-blog/posts/ml-based-embedded-computer-vision?utm_source=twitter&utm_medium=social-organic&utm_content=blog&utm_campaign=mk02_iot_na
📢 Arm ASR is now available as an early access plugin for @EpicGames' @UnrealEngine!
We've put it to the test using Unreal Engine's desktop renderer with our in-house demo project, Mori. 🐿️
See how much it enhances FPS when applied, significantly improving GPU performance. 👇
📹 During wildlife expeditions, the perfect shot can happen in an instant.
With the help of cutting-edge technology built #onArm, cinematographers like Frederique Olivier are capturing those moments, bringing untold stories to audiences across the globe: https://newsroom.arm.com/blog/purpose-on-arm-frederique-olivier-photographer?utm_source=twitter&utm_medium=social-organic&utm_content=blog&utm_campaign=mk08_brand_na
The new @AwsCloud EC2 C8g and M8g instances are now in GA!🚀
Whether you’re running compute intensive workloads on C8g instances or general purpose workloads on M8g instances, you benefit from Arm's performance and efficiency leadership with Graviton4 💪
Introducing Amazon EC2 C8g and M8g Instances - AWS
Discover more about what's new at AWS with Introducing Amazon EC2 C8g and M8g Instances
aws.amazon.com
The next era of LLMs for smaller devices is here, enabled by our partnership with @AIatMeta!
Read how we are enabling developers to expand device capabilities and edge AI use cases in @CNET's conversation with our very own @ctbergey 👇
Meta and Arm Want to Bring More AI to Phones and Beyond
The new models are small enough to assist in tasks on people's phones, with potentially smaller accessories too.
www.cnet.com
📢 Run Llama 3.2 LLMs seamlessly on Arm CPUs!
We’ve collaborated with @AIatMeta on its new open-source LLMs to ensure Arm CPUs deliver high performance and efficient AI inference from cloud to edge.
This is how we help developers scale AI everywhere: https://newsroom.arm.com/news/ai-inference-everywhere-with-new-llama-llms-on-arm?utm_source=twitter&utm_medium=social-organic&utm_content=blog&utm_campaign=mk13_tech-strat_na
🐻 We sponsored the AI for Bears challenge with @fruitpunchai.
Over 10 weeks, 19 participants learned about human-wildlife conflict, AI development flows, and teamwork.
See how they used this knowledge to tackle bear conservation issues 👉 https://community.arm.com/arm-community-blogs/b/ai-and-ml-blog/posts/ai-for-bears-challenge?utm_source=twitter&utm_medium=social-organic&utm_content=blog&utm_campaign=mk02_iot_na
The future of IoT is built #onArm.
To discover how the Arm ecosystem delivers efficient performance in edge AI devices, tune into @pnwilliamson's keynote at @EdgeImpulse's #Imagine2024 event.
🗓️: September 24, 2024
📍: Mountain View, CA or Virtual
👉: https://edgeimpulse.com/imagine
