HSD Pioneering Sight Controlled UI Within Augmented Reality
HS Design partnered with SentiAR's development team to develop a novel, first of kind, 3D augmented reality platform featuring real-time holographic visualization of a patient’s anatomy during electrophysiology interventional procedures. The SentiAR system is intended to be used as an adjunct product to assist the clinician in visualization of the heart anatomy during cardiac mapping and ablation procedures. Images are imported from an EAMS (electroanatomic mapping system) and displayed through the SentiAR system.
The system includes proprietary software that is loaded on a Data Manager PC and the Head Mounted Display (HMD, Microsoft HoloLens). The HMD enables users to have meaningful interactions with patient specific 3D cardiac models and electrical maps that are presented in a mixed reality environment. In addition, the system displays a real-time representation of catheter locations based on electro-anatomic mapping and uses shared models to allow for collaboration.
The SentiAR system can be fully controlled through the user’s gaze allowing the user to interact with the system while simultaneously performing important procedural tasks with their hands. This gaze-controlled user experience is an ergonomic breakthrough for interventional procedures. HSD helped SentiAR to pioneer and develop the user interface and interaction within this realm of intra-procedural sight-controlled operation. HSD's UI/UX and Human Factors Teams combined resources with SentiAR's Software team to understand the technological and environment surrounding the EI procedures. From there, the team provided user testing to best develop an intuitive and simple to use gaze controlled interface for the wearable control center that met with FDA HFE guidance.
Real-Time Holographic Visualization
Published by HS Design Inc. on Dec 18, 2019
