Arm DevSummit 2021: Ten Takeaways from Cloud to Edge
From data centers to 5G, HPC to confidential compute at the edge, there was more happening in the cloud to edge space than ever at Arm DevSummit 2021. If you’ve yet to check out the sessions on-demand, read on to discover what was covered and how to watch them for free now.
1. Tencent lays the groundwork for Arm in its Cloud
Li Chengdong, Hardware and Software Co-Optimization Architect in Tencent’s Cloud and Smart Industries Group, showcased how Tencent has ported its TDSQL database and KonaJDK over to Arm. He also provided some interesting benchmarks. In some applications, the Arm Neoverse N1 processor provides a 28 percent performance boost over traditional processors and a 100% increase in the power/performance (performance per watt) ratio.
Unlike some other cloud providers, Tencent has not developed its own chips or servers. It is evaluating the technology from the Arm ecosystem. (Note: Tencent announced trial availability its first instances for Arm in China in October.)
2. Start building DPU expertise
Data Processing Units (DPUs) will increasingly become an integral part of data centers, edge systems and 5G networks, said Gilad Shainer, SVP of Networking at NVIDIA, who explained how devices like NVIDIA’s Bluefield-2 and Bluefield-3 will be used to boost HPC performance.
“DPUS are a full datacenter on a chip…DPUs will become the default NIC,” he said. “(With DPUs) we are not just offloading workloads, we are accelerating them.”
Pensando Systems Fellow Mario Baldi, meanwhile, outlined how Arm-based programmable DPUs and its Distributed Service Platform can reduce latency at the edge while giving carriers the ability to add or change features. DPUs can also reduce East-West traffic, which can be 90% of datacenter traffic. (Side note: during the same week, Aruba announce it is adopting Pensando’s technology.)
3. The 5G revolution will be customized
Radisys’ Rishi Maulick said one of the appeals of private 5G networks will be customization: industrial customers, who might be connecting many assets for the first time, can achieve savings by tailoring systems to their needs for cost savings. Cities, he added, will also bundle emergency services and consumer-facing ones through network slicing.
Open networks are also taking flight. In three years, Jio has gone from having no customers to the largest in terms of revenue in India by leveraging software and general-purpose data center hardware, said Phillip Ritter, a Magma Evangelist and consultant for Facebook. Rakuten, meanwhile, build a network covering Japan in a year.
(Also check out the myth buster 5G panel with Nvidia, Mavenir, GSMA and Arm for insight on MIMO and GPUs and the Arm 5G Solutions Lab.
4. Why HPC in the Cloud? Time, money and performance.
The first Beowulf supercomputer cluster in 1994 had 16 cores. Now, workloads spanning a million processors are common, notes Brendan Bouffler, head of HPC Developer Relations at AWS. Few can afford that, but they can spin up an AWS account. AWS itself, he added, is saving money and time as well by being able to spin up HPC capacity at will. In the past, a comprehensive product testing suite required before a product launch might have taken 41 days on a traditional cluster. With the flexibility in the cloud, it takes 44 hours and it costs “a trivial amount of money.”
Similarly, computational fluid dynamics simulations with OpenFOAM on Graviton2 in the cloud can cost 37% less than it would on traditional processors. Weather forecasts? 40% cheaper and more accurate.
5. What is the key to Oracle’s Flexible Shapes? A fluid CPU to DRAM relationship
No two workloads are the same. In fact, the same workload will vary on its performance requirement minute by minute, says Oracle’s Matt Leonard. The company’s Ampere AI Flexible Shapes effectively allow customers to dynamically change the core to memory ratio. That way you can shift from performing encryption to a DRAM-intense application like an in-memory database without shifting to a different shape or getting dinged on performance. He added that one flexible shape is equivalent to 39 different shapes at rival services.
Leonard also noted that Oracle’s always free tier includes 4 cores and 24GB of memory, enough to run a Kubernetes cluster and get some real work done.
6. Confidential Compute at the Edge: Here’s how to do it.
Microsoft’s Eustace Asanghanwa delivered one of the most concise, precise and helpful explanations about the movement toward confidential compute we’ve seen. Evert Pap from Scalys also provided a demonstration of how to build an enclave at the edge for security data in use with its TrustBox Edge 201, which was also recently certified under SystemReady.
7. Building more robust silicon.
The CPUs, DPUs, and the other chips running cloud infrastructure are becoming proverbial datacenters-on-chips. Thus, it stands to reason that these complex SoCs will need embedded sensors to monitor performance and anticipate problems just like full-fledged data centers.
Brian Millar, principal engineer for R&D at Synopsys, explained how embedded, in-chip sensors can monitor voltage and temperature for performance per watt, pinpoint troublesome hot spots and give chip designers a way to improve overall design and robustness for the long term.
Cadence and Arm’s Satheesh Balasubramanian, meanwhile discussed how designers can use Cadence’s Liberate and Tempus platforms to counter the age-old problem of transistor aging. With VDD decreasing and more devices being used in mission-critical apps like driving, degradation is growing in importance.
Additionally, Nick Heaton of Cadence and Arm’s David Koenen provided an overview of verification for Arm CMN-700 verification.
8. Power consumption: It’s in the details.
Is power consumption inside hyperscale datacenters on the verge of escalating or will innovation continue to keep electricity, emissions, and costs level? It’s one of the most important—and hotly debated–questions in computing. But the one thing everyone agrees upon is that the titanic size of these centers–which account for $100 billion of the $120 spent per year on data centers—mean that small changes can have an outsized impact.
Consider an individual chip. A 5% reduction in power could mean 2 watts of savings or a half of a cent per server per hour, said Synopsys Strategic Programs Director Stephen Crosher. Multiply that by 100,000 and you’re talking $2.4 million saved per year in one center alone.
Arm’s Hannah Peeler and Josh Randall, meanwhile, outlined how Arm is working on carbon calculators to help cloud providers, carriers, and their customers make more informed choices about their infrastructure.
9. The software for Neoverse continues to expand.
Check out the latest from Canonical on microclouds, Redis Labs on cloud-native computer vision at the edge, RedHat, VMWare, GitLab, circleCI, NVIDIA and more.
10. And finally, what’s going on with cloud native at the edge?
Glad you asked. Mark Abrams from SuSE has the answers.
Arm DevSummit 2021: Now On-Demand, Free!
Engineers, developers, and tech enthusiasts: Arm DevSummit 2021 serves up insights into the latest technology trends, gives you an opportunity to up-level your skills in technical sessions and hands-on workshops, and offers the chance to network with like-minded software developers and hardware designers.
Any re-use permitted for informational and non-commercial or personal use only.
Editorial Contact
Latest on X
It's a big day for small models!
With @AIatMeta's new quantized Llama models and the Beta release of ExecuTorch, it's now quicker for 20 million Arm developers to create and deploy performant, intelligent gen AI at the edge.
👇We've put it to the test: https://newsroom.arm.com/news/accelerating-edge-ai-with-executorch?utm_source=twitter&utm_medium=social-organic&utm_content=newsroom&utm_campaign=mk13_tech-strat_na
We're excited to see the new quantized Llama 3.2 1B and 3B models available on the Arm compute platform.
👉 Developers, get ready to seamlessly integrate these new models into your applications #onArm with no additional modifications or optimizations, saving time and resources
Our collaboration with @vivo_Global and @MediaTek is redefining the AI smartphone. 📱
🤝 Together, we've delivered advanced performance and efficiency to vivo's X200 series with MediaTek's Dimensity 9400 with the latest Armv9 CPUs and Immortalis GPU: https://newsroom.arm.com/news/powering-next-generation-ai-smartphones-mediatek-vivo?utm_source=twitter&utm_medium=social-organic&utm_content=newsroom&utm_campaign=mk04_client_na
Collaboration is key to enabling the AI-enabled vehicle. 🚗
At #REAutoUSA, Dipti Vachani, our SVP and GM for Automotive shared how we're working across the stack to deliver solutions that enable software development from day 1, enabled by standards driven by SOAFEE.
Thank you, #GITEXGlobal, for including us to speak on this moment in technology where we can truly make a difference. Tamika Curry Smith was on the ground to share our commitments around #DEI and #AI.
The future is bright and built #onArm.
It's almost time! ⏰
In just a few hours, Arm CEO Rene Haas joins #BloombergTech to discuss everything from Arm's story so far to the opportunity in AI and what's next for the semiconductor industry.
👇 Watch the stream at 2:35 pm BST on @BloombergLive: https://x.com/i/broadcasts/1OyKAZovbvLGb
🏆 We've won the 2024 @Reuters Automotive D.R.I.V.E Honours Award for Innovation!
This award recognizes our commitment to advancing automotive design and production with our automotive technologies and CSS roadmap, launched back in March: https://1.reutersevents.com/LP=37549 #DRIVEHonours
We're transforming the automotive industry.
Our compute platform is key to developing SDVs with enhanced capabilities and safety features that will help enhance driving experiences. 🚗
Discover more on our blog ➡️: https://newsroom.arm.com/blog/software-defined-vehicles-future-automotive-industry?utm_source=twitter&utm_medium=social-organic&utm_content=blog&utm_campaign=mk12_automotive_na
Thanks for having us, #OCPSummit24!
With demos, daily speaker sessions, & new chiplet announcements with Arm Neoverse CSS, we showed how to tackle the scalability, design & development challenges of AI on the Arm compute platform.
Catch our highlights: https://newsroom.arm.com/blog/key-takeaways-from-ocp-global-summit-2024?utm_source=twitter&utm_medium=social-organic&utm_content=blog&utm_campaign=mk03_infrastructure_na
Join Rene Haas next week at #BloombergTech to hear how we're building the future of computing #onArm.
🔴🎥 Catch Rene in person on October 22 or tune in to the live stream via @BloombergLive at 2:35 pm BST. https://events.bloomberglive.com/bloomberg-technology-summit-london-2024/agenda/speakers/3407898
✅ Seamless compute scalability
✅ Trusted safety and security
✅ Accelerated software readiness
The Arm compute platform places us at the forefront of technology to deliver scalable, efficient, and innovative automotive solutions.
More in our blog 👉: https://newsroom.arm.com/blog/accelerating-adas-adoption?utm_source=twitter&utm_medium=social-organic&utm_content=blog&utm_campaign=mk12_automotive_na
⏰ There are only a few hours left of #OCPSummit24!
This is your final chance to head to the Arm booth at #B12 to see chiplets for AI, powered by Arm Neoverse CSS, and the Arm-based tech enabling the sustainable AI data center.
🏃🏃🏃
What makes a company truly resilient and strong?
@NVIDIA CEO Jensen Huang reflects on the moments that helped shape him as a leader, and his advice to others for persevering when times get tough.
Catch the full episode on the Tech Unheard podcast: https://newsroom.arm.com/podcasts/tech-unheard-episode-one-jensen-huang?utm_source=twitter&utm_medium=social-organic&utm_content=podcast&utm_campaign=mk08_brand_na
"The insatiable demand for AI performance is putting immense pressure on today's datacenters."
At #OCPSummit24, Eddie Ramirez shared details on the importance of chiplet technology and ecosystem collaboration on the Arm compute platform to scale AI innovation.
Stay tuned for…
We're at #OCPSummit24! 👋
If you're here, swing by and chat with us, or head to one of our talks to learn about the exciting possibilities of custom chiplets with Neoverse CSS and the Arm Total Design ecosystem.
📢 The general availability of Arm Neoverse CSS-based Microsoft @Azure Cobalt 100 VMs has just been announced!
This brings the performance, efficiency and flexibility of Neoverse CSS-based instances to millions of users for the age of AI: https://newsroom.arm.com/blog/arm-powered-microsoft-azure-cobalt-100-vms?utm_source=twitter&utm_medium=social-organic&utm_content=blog&utm_campaign=mk03_infrastructure_na
🚀 @Vivo_GLOBAL's X200 series has launched!
Will Abbey, EVP and Chief Commercial Officer, joined vivo on stage to celebrate the performance and AI capabilities of the new X200 series built #onArm with @MediaTek's Dimensity 9400 chipset.
@RebellionsAI @alphawavesemi @Cadence @ProteanTecs Discover more about Arm Total Design and its role in the future of AI-powered computing at #OCPSummit24, where you can join us for talks, demos, and partner showcases to learn about the next era of built-for-AI silicon - #onArm.
@RebellionsAI @alphawavesemi 3️⃣ Arm Total Design partners including @alphawavesemi, @Cadence and @ProteanTecs are validating their third-party IP products with CSS on advanced nodes - helping to provide an out-of-the-box software experience with Neoverse CSS-based custom silicon on leading edge nodes.
@RebellionsAI 2️⃣ Neoverse CSS and Arm Total Design are helping to create the hardware foundation for the sustainable AI datacenter with 2x new chiplets announced from Alcor Micro and @alphawavesemi, both on Arm CSS. 💪
1️⃣ Together with Samsung Foundry, ADTechnology and @RebellionsAI, we're bringing an AI CPU chiplet platform to market, based on Arm Neoverse CSS V3.
This promises to deliver unparalleled performance and optimal power efficiency for cloud, HPC and AI/ML training and inference.
🆕 After doubling in size in just a year, we're excited to share new updates on the chiplet innovation we're seeing from the Arm Total Design ecosystem. 🧵
By uniting on Arm CSS, we're building solutions for the AI datacenters of the future. Details: https://newsroom.arm.com/news/arm-total-design-sustainable-ai-datacenter?utm_source=twitter&utm_medium=social-organic&utm_content=blog&utm_campaign=mk03_infrastructure_na
Discover why all infrastructure market leaders choose Arm Neoverse to power their data center transformation at #OCPSummit24.
📍 Booth #B12
👉 Catch one of our talks, agenda below
📅 Tuesday-Thursday
See you there!
Arm is ✨the✨ compute platform for AI
From cloud to edge, our CPUs help software developers & our partners create highly customized silicon solutions.
➕They’re the ideal companion if you’re looking for a flexible heterogeneous computing approach to AI: https://newsroom.arm.com/blog/arm-compute-platform-ai-accelerator-technologies?utm_source=twitter&utm_medium=social-organic&utm_content=blog&utm_campaign=mk13_tech-strat_na
