Microsoft AR Spatial Copilot (2024) – Overview

In this video we see a live demo in 2024 by Darren Bennett using Guides Spatial Copilot on Volo’s Penta D16 Engine (Marine) at HMI (Hannover Messe Industry). CAD and reference material such as technical documents, reference manuals and work orders are provided to Copilot as additional knowledge.

Leveraging the capabilities of Copilot and Dynamics 365 Guides Spatial framework, Spatial Copilot can provide conversational step by step instruction from manuals, product history from work orders, or exploration through point and ask questioning with spatial context. Although this product shipped to private beta with a number of customers, (Volo Penta being one) Guides and HoloLens will reach end of support in the coming years.

For this demo I was tasked with constructing the Copilot Shaders, Copilot spatial logic and animation, UX performance and 3D asset pipeline and management.

Leave a Comment

Your email address will not be published. Required fields are marked *