Microsoft Hololens 2 Brings AR to Industry
While consumer take-up of augmented reality (AR) wearables is growing, we’re still several years away from commercially viable AR devices at consumer price points. The adoption of AR wearables and devices within industrial markets, meanwhile, is maturing far more rapidly. At Mobile World Congress in 2019, Microsoft announced the mixed reality headset HoloLens 2, one such AR device that’s geared squarely towards IAR (industrial augmented reality) applications rather than consumers.
The original Microsoft Hololens was released in 2016 as an Intel-powered, head-mounted computer running Windows 10 and the Windows Mixed Reality platform. Looking at the device’s impressive new features and updates, HoloLens 2 takes some significant steps towards a brighter AR future with much improved display FoV (field of view) and brightness, user comfort, environment comprehension, and, most importantly, more natural HMI (Human Machine Interface) through NLP (Natural Language Processing), hand and eye tracking. All of these improvements are sitting on top of a developer-friendly Windows on Arm compute platform. Significant interest in developing for Windows on Arm devices such as the Microsoft HoloLens 2 is driving new innovation in software and services similar to early smartphone eco-systems.
With all of this in mind, let’s look at what this means…
Improved field of view
Microsoft has been able to more than double the FoV in the HoloLens 2, representing a big step-up for HMDs (head mounted displays). According to a fairly detailed Microsoft blog post on the Microsoft HoloLens 2, this has been achieved while maintaining the industry-leading holographic density of 47 pixels per degree per eye. The device also contains a new laser plus MEMS display sub-system to help achieve these performance advancements in a power-efficient manner.
Tracking advancements
The HoloLens 2 features a number of tracking additions and improvements. The addition of eye tracking is good to see, which is in line with industry trends. Moreover, improvements in hand and gesture tracking is due to the introduction of a much-improved Time of Flight (ToF) sensor and software enhancements. Other tracking and mapping improvements are as expected, but the inclusion of semantics – segmenting objects in the 3D map of the environment – is an interesting addition and showcase of how edge + cloud can offer significant benefits for the right use-case
Improving and aligning the HMI
The HMI improvements on the HoloLens 2 are likely to make the device very beneficial to workers. Enabling eye tracking, hand tracking, gesture recognition and semantics to all work together provides a more natural, contextual way for workers to interact with virtual objects. This could mean that work tasks are completed more efficiently and to a higher standard.
Security
With the introduction of eye tracking, comes the wearable AR device’s answer to fingerprint and face unlock on smartphones known as Iris scanning. This has been my long-time prediction for user ID on wearable AR, but Microsoft have delivered it much earlier than anticipated.
Moving to a Snapdragon SoC
From an Arm perspective, we are most excited at the switch to a Qualcomm Snapdragon 850 SoC, which means the Microsoft HoloLens has moved from an x86 processor to an Arm processor. This move brings a number of benefits including performance and, most importantly, greater power efficiency. As you can see from the features and capabilities noted previously, increased compute performance will be a necessary requirement; however, the various compute-intensive tasks need to be carried out in a power efficient manner. As the features on wearable AR devices continue to evolve, the highly-integrated compute solutions based on Arm IP delivered by our innovative partners will continue to increase this much-needed efficiency.
In an article about the HoloLens 2 announcement in The Verge, Alex Kipman, a Technical Fellow at Microsoft and the person in charge of the whole HoloLens 2 project, was complimentary about Arm and explained the decision to move to the Arm-based Snapdragon SoC:
“Arm rules in battery-operated devices. The Arm decision became fairly easy. If you’re going to be on battery, [it’s] hard to find a product that’s not running Arm today.”
Away from Microsoft HoloLens, Qualcomm has made no secret of its desire to work with smartphone-powered VR (Virtual Reality) and AR headset devices, particularly those that will rely on the 5G network. As reported in The Verge, Qualcomm will be creating an “XR-optimized” certification program for smartphones using its Snapdragon 855 processors, which means it could potentially work with any headset within this ecosystem.
Exciting time for industry xR wearables
The advancements in the HoloLens 2 show the fast-pace speed of development and innovation among xR wearables for industry. While the cost might be high – around the $3,500 mark – industry can point to the proven time and cost savings from using AR wearables, particularly in manufacturing and training. The proven return on investment and significant technology and user benefits make AR wearables, like the HoloLens 2, an attractive investment for businesses. From an Arm perspective, we’re excited to be a part of the HoloLens product development through the adoption of the Snapdragon 850 based on Arm Cortex processor technology. We look forward to future ground-breaking devices featuring Arm’s unrivalled performance and efficiency optimized products.
Any re-use permitted for informational and non-commercial or personal use only.
Editorial Contact
Latest on Twitter
We’re at the forefront of the global semiconductor evolution.
Whether it’s enabling efficient AI or building the semiconductor skills of the future, we’re committed to enabling more AI innovation #onArm: https://okt.to/Zh7CuU
@techUK #UnleashInnovation
#ICYMI: Native @Unity Editor support is here! 🙌
With Unity 6 Preview, developers can build the ultimate gaming experiences on Arm-based Windows devices.
As a founding member of SOAFEE, we are proud to champion collaboration across the traditional automotive and software industries. 🤝
Hear from Robert Day as he discusses everything from software development to Arm-based automotive silicon at Embedded World.
We’re thrilled to be working in close partnership with Google to offer hardware support for Google AI Edge Torch. 🎉
This makes it easier to deploy AI enabled features #onArm. 💪
#GoogleIO
Arm CEO Rene Haas was at Bloomberg Tech last week to talk about the AI revolution.
He shared his vision for the semiconductor industry and how we're at the heart of powering a revolution that will change computing forever: https://okt.to/E9QtXh
#BloombergTech
The automotive product development lifecycle is evolving, and the industry needs a technology platform to develop software quickly and efficiently.
Discover why we're a trusted partner and at the heart of innovation in the space. 👇
Let's hear it for Tom Mahatdejkul, Principal Design Engineer, for winning @Benevity's Employee Catalyst Award.
The awards recognize his efforts to help colleagues to give back to communities & his dedication leading Arm's Pride Network in San Jose: https://okt.to/jnUKtx
With a fingerprint scan, @Simprints biometric solution can instantly recall a child's vaccination record, supporting local medical ID systems.
This is how together we're helping to make sure all children are fully immunized: https://okt.to/K1t9Jz
Arm CFO Jason Child was at Phoenix Global Forum last week where he spoke about the future of the semiconductor industry.
🔓 He talked about our long history in power-efficient compute and how this is the key to unlocking AI at scale in a sustainable way.
#PHXGlobalForum
Arm Neoverse-based Axion processors from @GoogleCloud
➕ Arm's hardware and firmware interoperability standards
🟰 Quick and easy deployment of Arm workloads on Google Cloud
💪 Hear from Mark Lohmeyer on why this is key to the deep partnership between Arm and Google Cloud.
Meet the SpiNNaker2, @SpiNNcloud's brain-inspired hybrid AI processor powered by Arm Cortex-M4.
It's delivering algorithms 10x more efficient than conventional AI, with our Arm Flexible Access for Startups Program helping to make this a reality: https://okt.to/jCyUc3
AI 🤝 IoT
As AI touches a growing number of connected applications, developers are turning to our software ecosystem for innovation and a consistent experience.
@pnwilliamson shares insights into AI in the embedded space at Embedded World.
We've done it again with record revenue in Q4! 🚀
As we build upon our power efficient CPU, Q4 saw us unlock new levels in royalty revenue and licensing growth. With 280+ bn Arm-based chips shipped to date, the future is built #onArm.
In April, we celebrated Neurodiversity Awareness Month with internal events including a session on parenting children with neurodiverse needs.
This is part of our ERGs efforts to create a supportive community that allows everyone to thrive and reach their full potential.
🤝 We're taking our partnership with @GoogleCloud to the next level.
Axion processors, built #onArm Neoverse V2, are the newest example of how we're working together to optimize for workload performance and efficiency.
@AwadMo shares the details. 👇
👇 Get started with ExecuTorch Alpha for optimal performance of LLMs on the CPU, alongside delegation to GPU and NPU.
With LLMs already running on our efficient CPUs, our close partnership with @PyTorch is making this easier on @Meta’s Llama 2, 3 and other broad models.
We recently released the first episode of our new 'In Conversation With...' series.
Hear from renowned computer scientist and engineer Sophie Wilson as she discusses co-designing the first Arm processor and the importance of 'making things'.
Watch now 👉 https://okt.to/5ozcsy
'@Simprints fingerprint scanning solution, SimprintsID makes it easier to verify individual vaccinations using digital records rather than physical ID.
With 850M people without formal ID, this solution, built #onArm, is game-changing for healthcare equity.
#HealthierTogether
📅 Join us on Wednesday May 8 for our financial results conference call.
After market close, we'll report our results for the fourth quarter of fiscal year 2024, followed by an audio webcast discussing our business outlook.
Details ➡️ : https://okt.to/58GW2q
"Hello World, I am ARM"
39 years ago today, the first Arm microprocessor introduced itself. We've since enabled advanced, efficient computing in 280+ billion chips, with the patents to prove it.
These foundations make us the AI platform the world relies on, today & in the
By building #onArm Neoverse, @GoogleCloud's Axion processors are well-suited for the age of AI, benefitting from:
⚡ Higher performance
🔋 Lower power consumption
⬆️ Greater scalability
@AwadMo shares why. 👇
Full interview: https://okt.to/0LPnpo
As the number of connected devices grows, so does the need for more edge compute solutions. 🚀
This is where @LinaroOrg's ONELab comes in.
Designed as a collaborative initiative, it's making it easier to build cloud-native edge deployments #onArm:
Our graduate scheme produces many exceptional engineers. Omar Ali is a great example. His impact goes far beyond his technical skills.
So, it was no surprise he was a finalist for the Rising Star Award at the @targetjobsUK National Graduate Recruitment Awards. Congrats, Omar!
Congratulations to Tamika Curry Smith, our Chief DEI Officer who has been chosen as one of @SavoyNetwork's Most Influential Executives in Corporate America for 2024. 👏
The honor recognizes Tamika's commitment to community, leadership, and success: https://okt.to/2NvDOZ
