Beyond the Newsroom: Exploring 6 Key Arm Innovations for August 2024
The Arm Editorial Team is always on the lookout for the latest most exciting and cutting-edge technology trends. In this edition of “Beyond the Arm Newsroom”, we highlight 6 groundbreaking innovations at Arm from August 2024. These include advancements in scaling IoT edge deployment, optimizing Spark SQL for power and efficiency, and boosting performance in media processing, HPC, and machine learning.
Revolutionizing Edge Computing with Scalable and Efficient Hybrid Processors
Arm advances edge computing with hybrid systems, combining Cortex-A and Cortex-M/R processors to make edge deployment more streamlined and scalable. Security Research Engineer Basma El Gaabouri details how applications can be deployed on Cortex-M from Cortex-A using cloud-native tools to simplify firmware updates and use resources more efficiently. This method ensures secure, scalable firmware updates, allowing applications to run on different cores based on their needs, improving resource use, and energy efficiency – all while simplifying management across varied hardware systems.
Supercharging Spark SQL on Arm with Meta’s Velox Engine
Apache Spark is designed to make big data processing quicker and easier. By leveraging the techniques implemented by the Meta-led Velox vectorized execution engine, users can achieve an effective solution for the Spark SQL accelerator on the Arm platform. Staff Software Engineer Yuqi Gu highlights why this advancement makes Spark SQL more efficient and powerful, improving performance and enabling the use of hardware accelerators like GPUs and FPGAs.
Matrix-Matrix Multiplication Boosts Media and ML Performance
Matrix multiplication refers to the operation of multiplying two matrices together to obtain a third matrix. To boost performance in media processing, HPC, and machine learning applications, matrix-matrix multiplication uses three powerful Arm technologies: Neon, SVE, and SME. Information Developer Khalid Saadi uses a side-by-side comparison to highlight key differences and offer insights to help developers transition from Neon or SVE/SVE2 to SME/SME2.
Leveraging Kubernetes for High-Performance IoT Edge Deployments
Kubernetes is the leading open-source container orchestration software built to automate software deployment, scaling, and management at the cluster level. Principal Research Software Architect Alexandre Peixoto Ferreira describes a compute capacity model tailored for Kubernetes that ensures efficient resource allocation in heterogeneous environments. Arm-based edge solutions enhance Quality of Service (QoS) management, crucial for developers working with multi-application systems in edge and cloud computing.
Harnessing Heterogeneity to Enhance Design for Edge Computing
A major challenge in advancing the Intelligent Edge is managing hardware heterogeneity. Principal Research Software Architect Alexandre Peixoto Ferreira details how hardware heterogeneity expands the design possibilities for edge computing. Solutions like reference cores and hybrid runtime deployments are proposed to mitigate complexity. These approaches aim to ensure portability, ease of programming, and manageable deployment, ultimately improving the efficiency and functionality of edge computing systems.
Demonstrating Hybrid Container Runtime for IoT Edge Applications
Implementing a container runtime for cloud-native deployment on high-performance IoT edge devices allows applications to be deployed on additional processors within a system. In edge environments, cloud-native technology helps tackle the challenges of developing, debugging, deploying, and securing software for these devices. Principal Engineer Chris Adeniyi-Jones demonstrates how deploying a new application component on the Arm Cortex-M4 processor within an SoC can lead to more energy-efficient computing.
Exploring Vulkan SDK, LLM Inference, and Advancing Mobile Graphics
In the latest episode of Innovation Coffee, where we go deep into the Arm developer ecosystem, Karen Ghavam and Richard Wright Jr. from LunarG discuss the Vulkan SDK, Jakub Sujak demonstrates the Learning Path for LLM inference on Android with KleidiAI, MediaPipe, and XNNPACK, Sam Martin covers advancements in mobile graphics with Arm, and Pareena Verma introduces the latest Learning Paths.
Building Computer Vision Applications with OpenCV on Android Devices
Arm Developer Evangelist Gabriel Peterson takes you through the fundamentals of building a computer vision application on Android using OpenCV. Based on the Learning Path by Dawid Borycki, this tutorial serves as an excellent introduction to OpenCV, with advice for adding support to a project, and processing images.
Any re-use permitted for informational and non-commercial or personal use only.
Editorial Contact
Latest on Twitter
Arm makes running MLOps workflows a breeze on @GitHub Actions.🏃
💪 With Arm Runners, developers can benefit from optimized performance, effortlessly turning workflows into powerhouses of efficiency.
@PyTorch 🙋Who's coming? Get more info here:
Schedule | LF Events
18-19 September 2024 | San Francisco, California You must be registered for PyTorch Conference 2024 to participate i...
events.linuxfoundation.org
At #PyTorchConf, join Gian Marco Iodice and Pareena Verma for more details on how to unlock performance gains with @Pytorch and Arm Kleidi. 🚀
Just over a year ago we began our journey as a public company.
⏩ Since, we've moved at pace to continue building the industry's most efficient and performant compute platform for the age of AI.
Here's a look at just some of our highlights along the way:
We're optimizing AI across the ML stack. 💪
That's why we've partnered with @PyTorch and ExecuTorch to integrate Arm Kleidi Libraries directly to each framework.
This gives application developers enhanced AI performance on the CPU without extra work: https://newsroom.arm.com/news/pytorch-kleidi-integrations-cloud-to-edge?utm_source=twitter&utm_medium=social-organic&utm_content=newsroom&utm_campaign=mk13_tech-strat_na
Congrats to our Executive Vice President and Chief Legal Officer, Spencer Collins for the recognition as one of the top in-house legal leaders by the @FT.
Spencer’s leadership and expertise remains crucial to the success of the Arm compute platform: https://www.ft.com/content/e9a36690-fa99-4525-bf68-42132c77e553
We recently hosted an event bringing together experts on Edge AI. 🚀
This included our own SVP & GM of IoT @pnwilliamson, who showcased the power of Arm Ethos-U85 running Tiny Llama2.
See it in action.👇
@TinymlF
We're thrilled to welcome Young Sohn to our Board of Directors! 🎉
With diverse experience in the semiconductor industry and a long history of working with Arm, Young's contributions will be crucial to the growth of the Arm compute platform in the AI era: https://newsroom.arm.com/news/appointment-of-young-sohn-to-arm-board-of-directors?utm_source=twitter&utm_medium=social-organic&utm_content=blog&utm_campaign=mk29_exec-comms_na
We're joining the @PyTorch Foundation as a premier member!
Together we can ensure the integration of PyTorch's framework with Arm's software stack to accelerate AI development on Arm.
This forms part of our continued investment in software & open source: https://pytorch.org/blog/arm-joins-pytorch/
Congrats @Nuro!
We're proud to power the Nuro Driver platform with the server-class performance & safety capabilities of Arm Neoverse V3AE technology.
In this new era, together we're enabling OEMs with the safety-enabled compute performance for autonomous, AI-enabled vehicles.
We're taking gen AI to the next level with 3 🆕 practical demos running entirely on the Armv9 CPU on your smartphone.
1️⃣ Real-time voice assistant
2️⃣ Voice note summarization
3️⃣ Group chat summarization
This just scratches the surface of what's possible: https://okt.to/BeX8UH
Are you ready to build native apps on Windows on Arm?
We've got the tools and resources you need to get started.
This is how you build enhanced user experiences.
Here's to 3+ years of SOAFEE and everything that's to come with http://SOAFEE.next. 🎉
With 120+ members and counting, we're proud to celebrate the collaborative efforts of the entire automotive ecosystem to bring software-defined, AI-enabled vehicles to life:… https://twitter.com/i/web/status/1831330305568874744
Do you build @VulkanAPI apps? We’ve got exciting news for you!
🔜 Native support for Windows on Arm is coming.
🎬 See it in action:
Processing complex AI workloads on the device can be slow. 🦥
Arm KleidiAI is changing this, bringing best performance without additional optimization.
We show what's possible when it's integrated with @Google's MediaPipe & XNNPACK on Android.
Meet the next generation of optimized ML workloads.👇
⚡ 30-50% speedups for various ML libraries
💪 3.1x run time improvement with Photon
💰 Lower cost
Get this and more with Arm Neoverse-based @AWSCloud Graviton on the @databricks ML Runtime cluster.
Unlock Faster Machine Learning with Graviton | Databricks Blog
okt.to
AI is transforming the world of computing, from the edge to the cloud. 🚀
As Arm CMO Ami Badani explains on @theCUBE, this offers unique opportunities, but you have to have the right platform in place to maximize them.
That's where Arm comes in:
Ami Badani, ARM | AI Infrastructure Silicon Valley - Executive Series
Ami Badani, ARM, sits down with John Furrier & Dave Vellante, theCUBE.
okt.to
Reasons we ❤️ the Arm Cortex-M33 based Raspberry Pi Pico 2:
1️⃣ You can deploy more compute-intensive apps
2️⃣ It's faster, thanks to the floating point unit
3️⃣ It's more performant
Try it for yourself testing real-time ML audio noise suppression.
🔍 BTS of July's Amazon Prime Day, over 250K Arm-based AWS Graviton chips powered 5,800 distinct http://Amazon.com services - that's more than double the services in 2023.
By scaling #onArm, @awscloud had the compute capacity to ensure everything ran smoothly:…
⏰ Set your reminder!
Today at 1:05 pm PT, Arm CMO Ami Badani joins @theCUBE's AI Infrastructure Silicon Valley Executive Series to discuss the explosion of generative AI and innovation in chip technology.
Tune in here: https://okt.to/sF1y3c
We've been shortlisted for @Reuters Automotive D.R.I.V.E Honours 2024 for:
🌟 Innovation - for our tech accelerating AI-enabled software-defined vehicles
🌟 Empowering Women - Recognizing Dipti Vachani for her impact on the industry
Here's to our team that make it possible. 👏
AI is bringing many opportunities but there's also challenges with security.
Our report with @PSACertified is how you get ahead. Discover the insights you need to unlock the benefits of AI without compromising on security:
We're accelerating automotive software development cycles by enabling our partners to start innovating ahead of physical silicon availability.
Hear about our role in driving standardized, portable software and facilitating innovation in the SDV ecosystem: https://okt.to/LaZrtQ
MultiCub3r-X is a robot built #onArm.
It uses an image processing application on the Arm-based @Google Pixel 8 to calculate a sequence of moves, to solve the Rubik’s Cube in record time.
+ The @LEGO_Group mechanism turning the cubes is also based on Arm! See it in action. 👇
