New Arm IP Brings Intelligent, Immersive Experiences to Mainstream Markets
By Paul Williamson, vice president and general manager, Client Line of Business, Arm
News Highlights:
- Arm Ethos-N57 and Ethos-N37 NPUs; extending the range of Arm Machine Learning (ML) processors to enable Artificial Intelligence (AI) applications in mainstream devices
- Arm Mali-G57 GPU; the first mainstream Valhall architecture-based GPU delivering 1.3x better performance over previous generations
- Arm Mali-D37 DPU; delivering a rich display feature set within the smallest area for full HD and 2K resolution
Once the preserve of premium devices, immersive experiences such as AR, high-fidelity gaming, and new AI-based use cases across mobile and home are now being demanded by the mainstream market. Giving developers access to high-performance AI and media IP solutions optimized for everyday devices enables new AI driven use cases, with features such as voice recognition and always-on capabilities, no longer unique to mobile.
AI intelligence is now everywhere from gaming devices to digital TVs (DTVs), and increased compute at the endpoint is required to allow for these responsive experiences. For example, intelligent experiences in DTVs range from smart assistant voice commands, real-time translation for shows in another language, and face recognition to enhance parental controls.
To deliver this, I’m pleased to announce that Arm is launching two new mainstream ML processors, as well as our latest Mali graphics and display processors. Together, this IP represents Arm’s ability to scale, bringing premium experiences to everyday and ultra-efficient consumer devices. The new suite of IP includes:
- Ethos-N57 and Ethos-N37 NPUs; enabling AI applications and balancing ML performance with cost, area, bandwidth, and battery life constraints
- Mali-G57 GPU; the first mainstream Valhall architecture-based GPU, bringing immersive experiences through performance improvements
- Mali-D37 DPU; delivering a rich display feature set within the smallest area, making it the perfect DPU for entry-level devices and small display screens
Ethos-N57 and Ethos-N37 NPUs: enabling truly heterogeneous compute
Following the earlier introduction of the Arm ML processor (now referred to as the Ethos-N77), the Ethos-N57 and Ethos-N37 are the newest members of the Ethos NPU family. Arm Ethos is a suite of products designed to solve complex AI and ML compute challenges allowing the creation of more personalized, immersive experiences in everyday devices. As consumer devices become smarter there is a need for additional AI performance and efficiency via dedicated ML processors. Optimized for the most cost and battery life-sensitive designs, the new Ethos NPUs deliver premium AI experiences on our everyday devices.
Both the Ethos-N57 and Ethos-N37 are designed with some basic principals in mind, for example:
- Optimized around support for Int8 and Int16 datatypes
- Advanced data management techniques minimizing data movement and associated power
- Over 200% performance uplift over many other NPUs through techniques such as innovative Winograd implementation
Further, Ethos-N57 features include:
- Designed to provide a balance of ML performance and power efficiency
- Optimized for 2 TOP/s ML performance range
Ethos-N37 features include:
- Design to provide the smallest footprint ML inference processor (<1mm2)
- Optimized for 1 TOP/s ML performance range
For more information on the Ethos-N57 and Ethos-N37 NPUs, read our blog.
Mali-G57: GPU that brings intelligent and immersive experiences to the mass market
Mali-G57 brings premium intelligent and immersive user experiences – such as high-fidelity gaming, console-like graphics on mobile, 4K/8K user interfaces on DTVs, and more complex augmented and virtual reality workloads – to the mainstream. This is the biggest segment of the mobile market and our recent announcement with Unity highlights our work to further optimize performance on Arm-based SoCs, CPUs, and GPUs, allowing developers to spend more time creating new content.
Key features of Mali-G57 include:
- 1.3x better performance density across a range of content compared to Mali-G52
- 1.3x improvements in energy efficiency leading to longer battery life
- Foveated rendering support for VR and 60 percent better on-device ML performance for more complex xR workloads
For more information on the Mali-G57, read our blog.
Mali-D37: Arm’s most area efficient display processor
The Mali-D37 DPU packs a rich array of display and performance features within the smallest area possible. For the end-user, this means better visuals and performance on lower cost devices where area matters most, such as entry-level smartphones, tablets, and small display screens up to 2K.
Key features of Mali-D37 include:
- Extreme area efficiency, with DPU configurable to an area of less than 1mm2 on 16nm for Full HD and 2K resolutions
- System power savings of up to 30% through offloading core display tasks from the GPU and memory management features, including MMU-600
- Preservation of key display features from premium Mali-D71, including mixed HDR and SDR composition when combined with Assertive Display 5
For more information on the Mali-D37, read our blog.
This new set of IP has been designed with a solution approach in mind, in line with our Total Compute initiative, ensuring it is experience driven and optimized to solve the complex compute challenges of tomorrow’s workloads. Offering higher area efficiency and power savings while increasing performance, the new IP drives to reduce cost and time to market; bringing more high fidelity gaming and console-like experiences to mobile, compute capability to DTVs, and more ML performance for personalized immersive content with increased responsiveness consumers have become accustomed to. Keep watching the mainstream space; the evolution of these devices is about to get exciting!
Any re-use permitted for informational and non-commercial or personal use only.
Media Contacts
Latest on X
It's a big day for small models!
With @AIatMeta's new quantized Llama models and the Beta release of ExecuTorch, it's now quicker for 20 million Arm developers to create and deploy performant, intelligent gen AI at the edge.
👇We've put it to the test: https://newsroom.arm.com/news/accelerating-edge-ai-with-executorch?utm_source=twitter&utm_medium=social-organic&utm_content=newsroom&utm_campaign=mk13_tech-strat_na
We're excited to see the new quantized Llama 3.2 1B and 3B models available on the Arm compute platform.
👉 Developers, get ready to seamlessly integrate these new models into your applications #onArm with no additional modifications or optimizations, saving time and resources
Our collaboration with @vivo_Global and @MediaTek is redefining the AI smartphone. 📱
🤝 Together, we've delivered advanced performance and efficiency to vivo's X200 series with MediaTek's Dimensity 9400 with the latest Armv9 CPUs and Immortalis GPU: https://newsroom.arm.com/news/powering-next-generation-ai-smartphones-mediatek-vivo?utm_source=twitter&utm_medium=social-organic&utm_content=newsroom&utm_campaign=mk04_client_na
Collaboration is key to enabling the AI-enabled vehicle. 🚗
At #REAutoUSA, Dipti Vachani, our SVP and GM for Automotive shared how we're working across the stack to deliver solutions that enable software development from day 1, enabled by standards driven by SOAFEE.
Thank you, #GITEXGlobal, for including us to speak on this moment in technology where we can truly make a difference. Tamika Curry Smith was on the ground to share our commitments around #DEI and #AI.
The future is bright and built #onArm.
It's almost time! ⏰
In just a few hours, Arm CEO Rene Haas joins #BloombergTech to discuss everything from Arm's story so far to the opportunity in AI and what's next for the semiconductor industry.
👇 Watch the stream at 2:35 pm BST on @BloombergLive: https://x.com/i/broadcasts/1OyKAZovbvLGb
🏆 We've won the 2024 @Reuters Automotive D.R.I.V.E Honours Award for Innovation!
This award recognizes our commitment to advancing automotive design and production with our automotive technologies and CSS roadmap, launched back in March: https://1.reutersevents.com/LP=37549 #DRIVEHonours
We're transforming the automotive industry.
Our compute platform is key to developing SDVs with enhanced capabilities and safety features that will help enhance driving experiences. 🚗
Discover more on our blog ➡️: https://newsroom.arm.com/blog/software-defined-vehicles-future-automotive-industry?utm_source=twitter&utm_medium=social-organic&utm_content=blog&utm_campaign=mk12_automotive_na
Thanks for having us, #OCPSummit24!
With demos, daily speaker sessions, & new chiplet announcements with Arm Neoverse CSS, we showed how to tackle the scalability, design & development challenges of AI on the Arm compute platform.
Catch our highlights: https://newsroom.arm.com/blog/key-takeaways-from-ocp-global-summit-2024?utm_source=twitter&utm_medium=social-organic&utm_content=blog&utm_campaign=mk03_infrastructure_na
Join Rene Haas next week at #BloombergTech to hear how we're building the future of computing #onArm.
🔴🎥 Catch Rene in person on October 22 or tune in to the live stream via @BloombergLive at 2:35 pm BST. https://events.bloomberglive.com/bloomberg-technology-summit-london-2024/agenda/speakers/3407898
✅ Seamless compute scalability
✅ Trusted safety and security
✅ Accelerated software readiness
The Arm compute platform places us at the forefront of technology to deliver scalable, efficient, and innovative automotive solutions.
More in our blog 👉: https://newsroom.arm.com/blog/accelerating-adas-adoption?utm_source=twitter&utm_medium=social-organic&utm_content=blog&utm_campaign=mk12_automotive_na
⏰ There are only a few hours left of #OCPSummit24!
This is your final chance to head to the Arm booth at #B12 to see chiplets for AI, powered by Arm Neoverse CSS, and the Arm-based tech enabling the sustainable AI data center.
🏃🏃🏃
What makes a company truly resilient and strong?
@NVIDIA CEO Jensen Huang reflects on the moments that helped shape him as a leader, and his advice to others for persevering when times get tough.
Catch the full episode on the Tech Unheard podcast: https://newsroom.arm.com/podcasts/tech-unheard-episode-one-jensen-huang?utm_source=twitter&utm_medium=social-organic&utm_content=podcast&utm_campaign=mk08_brand_na
"The insatiable demand for AI performance is putting immense pressure on today's datacenters."
At #OCPSummit24, Eddie Ramirez shared details on the importance of chiplet technology and ecosystem collaboration on the Arm compute platform to scale AI innovation.
Stay tuned for…
We're at #OCPSummit24! 👋
If you're here, swing by and chat with us, or head to one of our talks to learn about the exciting possibilities of custom chiplets with Neoverse CSS and the Arm Total Design ecosystem.
📢 The general availability of Arm Neoverse CSS-based Microsoft @Azure Cobalt 100 VMs has just been announced!
This brings the performance, efficiency and flexibility of Neoverse CSS-based instances to millions of users for the age of AI: https://newsroom.arm.com/blog/arm-powered-microsoft-azure-cobalt-100-vms?utm_source=twitter&utm_medium=social-organic&utm_content=blog&utm_campaign=mk03_infrastructure_na
🚀 @Vivo_GLOBAL's X200 series has launched!
Will Abbey, EVP and Chief Commercial Officer, joined vivo on stage to celebrate the performance and AI capabilities of the new X200 series built #onArm with @MediaTek's Dimensity 9400 chipset.
@RebellionsAI @alphawavesemi @Cadence @ProteanTecs Discover more about Arm Total Design and its role in the future of AI-powered computing at #OCPSummit24, where you can join us for talks, demos, and partner showcases to learn about the next era of built-for-AI silicon - #onArm.
@RebellionsAI @alphawavesemi 3️⃣ Arm Total Design partners including @alphawavesemi, @Cadence and @ProteanTecs are validating their third-party IP products with CSS on advanced nodes - helping to provide an out-of-the-box software experience with Neoverse CSS-based custom silicon on leading edge nodes.
@RebellionsAI 2️⃣ Neoverse CSS and Arm Total Design are helping to create the hardware foundation for the sustainable AI datacenter with 2x new chiplets announced from Alcor Micro and @alphawavesemi, both on Arm CSS. 💪
1️⃣ Together with Samsung Foundry, ADTechnology and @RebellionsAI, we're bringing an AI CPU chiplet platform to market, based on Arm Neoverse CSS V3.
This promises to deliver unparalleled performance and optimal power efficiency for cloud, HPC and AI/ML training and inference.
🆕 After doubling in size in just a year, we're excited to share new updates on the chiplet innovation we're seeing from the Arm Total Design ecosystem. 🧵
By uniting on Arm CSS, we're building solutions for the AI datacenters of the future. Details: https://newsroom.arm.com/news/arm-total-design-sustainable-ai-datacenter?utm_source=twitter&utm_medium=social-organic&utm_content=blog&utm_campaign=mk03_infrastructure_na
Discover why all infrastructure market leaders choose Arm Neoverse to power their data center transformation at #OCPSummit24.
📍 Booth #B12
👉 Catch one of our talks, agenda below
📅 Tuesday-Thursday
See you there!
Arm is ✨the✨ compute platform for AI
From cloud to edge, our CPUs help software developers & our partners create highly customized silicon solutions.
➕They’re the ideal companion if you’re looking for a flexible heterogeneous computing approach to AI: https://newsroom.arm.com/blog/arm-compute-platform-ai-accelerator-technologies?utm_source=twitter&utm_medium=social-organic&utm_content=blog&utm_campaign=mk13_tech-strat_na
