Microsoft is adding new augmented reality (AR) tools to Teams’ iOS and Android apps to support frontline workers.
Leveraged through Microsoft Dynamics 365 Remote Assist, Spatial Annotations allows team members, managers and external experts to apply insightful instructions or suggestions to a caller’s feed or view.
Remote Assist features such as Spatial Annotations previously required a standalone Dynamics 365 Remote Assist mobile app or a HoloLens 2 extended reality (XR) device. Frontline workers can leverage the Spatial Annotations feature directly within their Teams mobile app.
Amanda Hillman, Head of Growth for Microsoft Mixed Reality Apps and Industrial Metaverse, wrote in an accompanying blog post:
The powerful see-what-I-see capability of Dynamics 365 Remote Assist lets users call an expert, share their view, and annotate in space. Where before Remote Assist capabilities required a standalone mobile app or a HoloLens 2 device, now frontline workers can benefit from using the Spatial Annotations feature inside their Teams mobile app.”
Hillman says the Remote Assist app is popular among frontline workers for its quick and easy call initiation, task display, and annotation features. These workers can access this functionality directly from the Teams mobile app. Consolidating core collaboration capabilities into one app simplifies tasks for workers on the go, removing the need for app switching while ensuring all Teams collaboration features are readily available.
The public preview for iOS users is currently being rolled out, with the public preview for Android users expected later this summer. Suppose a user has a Dynamics 365 Field Service, Dynamics 365 Guides, or Dynamics 365 Remote Assist license. In that case, they’ll automatically gain access to the new remote assistance capabilities in their mobile Teams app upon release at no extra cost.
General availability is scheduled for later in 2024.
More Details On Spatial Annotations in Teams
Hillman stressed that users can leverage Spatial Annotations as simply as joining a Teams meeting or making a call. With the front-facing camera, users can share their views with remote participants, enabling real-time collaboration enhanced by 3D annotations overlaid on physical objects, improving comprehension.
Like the Remote Assist app, users can adjust angles without losing their annotations, which remain anchored to their surroundings. This advanced interaction capability encourages Teams mobile users to share insights and minimises communications that might result in rework.
If a user’s company already utilises Teams for communication and collaboration, integrating remote assistance capabilities into the Teams mobile app can serve a broader range of collaborative use cases for frontline workers. IT admins no longer need to manage an extra app to enable remote assistance capabilities for their mobile workforce. By adding Spatial Annotations to the Teams mobile app, IT teams can reduce the number of apps they need to provision, update, and audit.
To enhance security measures, companies can also leverage Teams’ capabilities, such as end-to-end encryption, data loss prevention, and compliance certifications. This ensures protection against unauthorised access to confidential company information.
“Infusing mixed reality capabilities into the apps workers are already using, on devices they already have in their pockets, is just one way we’re working to bring mixed reality to frontline workers,” Hillman added. “We are excited to take this next step to democratise mixed reality and bring leading-edge mixed reality solutions to more people across industries.”
Microsoft Mesh For Teams and Microsoft’s XR Meetings Solution
Microsoft Mesh for Teams became generally available in January.
The XR meetings solution is available through both PC and Meta Quest VR devices. Users can leverage the exact same Teams features they’re used to but within a 3D space, including accessing shared content for collaboration, utilising live reactions to express themselves, and communicating through Teams chat.
Initially announced at last year’s Microsoft Build, Mesh in Teams aims to enhance engagement in Teams meetings through ready-made 3D immersive spaces tailored to suit organisational needs, such as team social gatherings, brainstorming sessions, or round-table discussions.
Organisations can also seamlessly orchestrate large-scale events with personalised, immersive experiences using Microsoft Mesh. The platform provides a user-friendly, no-code editor that enables users to start with pre-designed immersive spaces and customise them with visual elements like organisation logos, product videos, presentation content, and more.
