Arm Accelerates Edge AI with Latest Generation Ethos-U NPU and New IoT Reference Design Platform
News highlights:
- New Arm Ethos-U85 NPU delivers 4x performance uplift for high performance edge AI applications such as factory automation and commercial or smart home cameras
- New Arm IoT Reference Design Platform, Corstone-320, brings together leading-edge embedded IP with virtual hardware to accelerate deployment of voice, audio, and vision systems
- With a global ecosystem of more than 15 million developers working on Arm, development is streamlined through extensive software enablement and tools, making it easy to scale edge AI deployments
As edge AI scales, silicon innovators must navigate growing system and software complexity, an ever-increasing demand for AI performance and pressure to accelerate their time-to-market. At the same time, software developers need more consistent, streamlined experiences and easy integration with emerging AI frameworks and libraries.
Introducing our new third generation NPU for edge AI, the Arm Ethos-U85
Today we are announcing our highest performance, most efficient Ethos NPU to date, the Arm Ethos-U85. Delivering a 4x performance uplift and 20% higher power efficiency compared to its predecessor while scaling from 128 to 2048 MAC units (4 TOPs @1GHz), the Ethos-U85 is addressing applications where we see even greater performance demands such as factory automation and commercial or smart home cameras. Ethos-U85 offers the same consistent toolchain so partners can leverage existing investments for a seamless developer experience. Importantly, it provides support for AI frameworks such as TensorFlow Lite and PyTorch.
Ethos-U85 supports Transformer Networks as well as Convolutional Neural Networks (CNNs) for AI inference. Transformer Networks will drive new applications, particularly in vision and generative AI use cases for tasks like understanding videos, filling in missing parts of images or analyzing data from multiple cameras for image classification and object detection.
With the deployment of microprocessors into more high-performance IoT systems for use cases such as industrial machine vision, wearables and consumer robotics, we’ve designed the Ethos-U85 to work with our leading Armv9 Cortex-A CPUs, to accelerate ML tasks and bring power-efficient edge inference into a broader range of higher-performing devices.
The Ethos family of NPUs has been licensed by more than 20 partners to date, and early adopters of the new Ethos-U85 include Alif and Infineon. Read more about the Arm Ethos-U85 here.
“Machine learning workloads for the next generation of edge AI applications demand high performance in a power efficient manner,” said Reza Kazerounian, co-founder and president, Alif Semiconductor. “Alif was the first to market with an edge AI solution based on Arm Cortex-M55 and Ethos-U55, and we welcome Arm’s latest AI technology, Ethos-U85, which will deliver the compute performance required for our next generation Ensemble family of microcontrollers and fusion processors to address future edge AI and vision use cases.”
“Edge AI use cases are becoming increasingly sophisticated and require secure, high performance compute systems to deliver on the opportunities of the AI era,” said Steve Tateosian, SVP of Industrial MCUs, IoT, Wireless and Compute Business, Infineon. “We look forward to building on Infineon’s long-standing partnership with Arm and enabling these sophisticated systems with Arm Ethos-U85 and the transformer network support it provides for edge AI deployments.”
New IoT Reference Design Platform, Corstone-320, accelerates voice, audio, and vision systems
Introducing the Arm Corstone-320 IoT Reference Design Platform, bringing together our highest performance Arm Cortex-M85 CPU, our Mali-C55 Image Signal Processor and the brand-new Ethos-U85 NPU, to deliver the performance required to span the broad range of edge AI applications for voice, audio, and vision, such as real time image classification and object recognition, or enabling voice assistants with natural language translation on smart speakers. The platform includes software, tools, and support including Arm Virtual Hardware. This combination of hardware and software will accelerate product timelines by enabling software development to start ahead of silicon being available, rapidly improving time to market for these increasingly complex edge AI devices. Read more about Arm Corstone-320 here.
The IoT and embedded industry is looking to Arm to scale the edge AI opportunity
As AI adoption grows, everyone from startup innovators to the world’s biggest microcontroller players are converging on Arm as the platform of choice to deliver their AI solutions from cloud to edge.
Any re-use permitted for informational and non-commercial or personal use only.
Media Contacts
Latest on Twitter
Congratulations to Tamika Curry Smith, our Chief DEI Officer who has been chosen as one of @SavoyNetwork's Most Influential Executives in Corporate America for 2024. 👏
The honor recognizes Tamika's commitment to community, leadership, and success: https://okt.to/2NvDOZ
This #EarthDay, we're celebrating our collaboration with @UNICEF, to unlock the life-changing potential of technology in Malawi.💧
Our investment has helped UNICEF install two water supply systems, helping provide 11,000 people with access to safe water and sanitation services.
ISA parity is accelerating silicon and software deployment in automotive! 🚗💨
👇 At #ew24 we showcased what this looks like in practice via virtual platforms with our Neoverse-based cloud instances and new Arm AE IP, which brings almost 100% ISA parity. https://okt.to/cjVaFN
The future of automotive is here. 🚀
Hear from Dipti Vachani on @IBDinvestors as she shares details on the game-changing performance and functional safety features of our new Armv9-based AE processors and server-class Neoverse technology: https://okt.to/WVtw58
AI is expected to increase data center power consumption 3️⃣x by 2030.
To offset this, hyperscalers like Amazon and Google turn to Arm Neoverse to reduce power without compromising performance.
That's why the future of AI is built #onArm. https://okt.to/LPVFWd
We're working with our partners @Simprints, @Gavi and @_GHSofficial to enable healthcare equity in Ghana.
Built #onArm, Simprints technology is enabling vaccine equity by making it easier to verify vaccine delivery by individual: https://okt.to/MIcgxu
If Arm technology is in there, then the future will be too.
Our energy-efficient compute platforms are foundational to the world's technology and AI computing, shaping how we work, play and connect.
That's why the future is built #onArm. https://okt.to/M9wqc8
Here's to a fantastic week at Embedded World! 🎉
From lightning talks and speaker sessions to demos of our latest automotive and IoT technologies, we brought our vast ecosystem together to showcase what's possible when you build #onArm.
Thank you to everyone that joined us. 👏
🚗 Software-defined vehicles (SDVs) are the future of automotive and they're being built #onArm.
Robert Day joins @Sonatus and @MotorTrend on the latest podcast to talk all things SDVs and where the industry is headed.
🔊👇 Listen below.
🏆 And the winner of the Embedded Awards 2024 goes to… @Ambiq_AI's Apollo510 MCU!
This winning tech opens the door to new local AI opportunities on billions of devices.
Listen in as the team talk us through their exceptionally efficient Arm-based SoCs at #EmbeddedWorld.
David Maidment recently shared his thoughts on the future of edge computing at #EmbeddedWorld!
Missed the talk? Catch up on his insights into the evolution of edge computing across billions of diverse connected devices to build a secure AI-enabled future: https://okt.to/EtfSRN
AI is everywhere at this year's #EmbeddedWorld.
🚘 With the demand for more autonomy, increasingly advanced user experiences and the trend toward electrification Dennis Laudick shares why AI will remain crucial to drive innovation in the software-defined vehicle.
#ew24
Two identical demos. One different NPU.
Our new Ethos-U85 NPU is optimized for transformer networks to deliver the performance needed for edge AI use cases - including high performance voice and vision experiences.
This makes it perfect for AI applications like Gen AI. #ew24
We're ready for the final day of #EmbeddedWorld! 🚀
It's been a fantastic show so far showcasing our power-efficient compute platforms that are fueling the future of edge AI.
Reply with an emoji to let us know if you'll be visiting us on the show floor. 👋
#ew24
What's trending at #EmbeddedWorld?
AI, AI and more AI. 🔥
@pnwilliamson shares where you might find edge AI in action from our ecosystem partners building the future #onArm. #ew24
At the Arm booth at #EmbeddedWorld you'll find:
✅ Partner demos from the likes of @NXP, @Ambiq_AI and @_Elektrobit
✅ Partner Lightning Talks from @Microsoft, @EdgeImpulse and more
✅ Our latest IoT and Automotive tech
#ew24
🚀 We're taking edge AI innovation to the next level with the new Arm Ethos-U85 NPU and Corstone-320 IoT Reference Design Platform.
@pnwilliamson shares how these new technologies are transforming future voice, audio and vision applications live from #EmbeddedWorld. #ew24
Get to know LaunchX from NetsPresso by @nota_ai, on show at #EmbeddedWorld. 👇
Designed to help you easily convert and benchmark AI models, it supports a ton of Arm-based devices from our partners including Arduino, NXP, Renesas, Raspberry Pi and NVIDIA. #ew24
🇺🇸🇯🇵 We're proud to support new AI research partnerships between universities in the US and Japan.
Through close collaboration between business, academia and government we can continue to advance AI innovation to transform industries and improve lives. https://okt.to/9JbahF
📢 Custom Arm-based silicon from @GoogleCloud is here!
Axion, built on Armv9 Neoverse V2, will bring performance & energy efficiency gains to AI inferencing & general-purpose workloads, like web and app servers.
Congrats to the team! 👏 https://okt.to/xS4cBN #GoogleCloudNext
It's time for #EmbeddedWorld! 🙌
We're in Nuremberg this week showing you how to build your AI-accelerated future #onArm. 🎉
Can’t join us in person? Keep up to date on social media for live updates from the show! #ew24
🆕 Get ready to accelerate edge AI with the new Arm Ethos-U85 NPU and Corstone-320 IoT Reference Design Platform. ⚡
With performance and efficiency uplifts, developers can now deliver greater AI compute in smaller, more cost-sensitive devices: https://okt.to/cJPTCQ
When it comes to AI and ML at the edge, challenges like hardware fragmentation and performance optimization stand in the way of widespread adoption.
@pnwilliamson shares how developers can navigate this, with an invitation to join us at Embedded World: https://okt.to/tpsPTd
With the AI boom fueling demand for compute, our CEO Rene Haas speaks to @jchatterleyCNN on the importance of ecosystem collaboration to unlock unique capabilities we've not seen before.
Listen to the @CNN podcast at 28:38 for the full interview 👉 https://okt.to/mcH1tF
