130. From Gaming to Treating Patients – Clinical Challenge for Virtual Reality Systems

Abstract

Virtual and Augmented Reality, while mostly used for entertainment purposes, is finding growing applications in many different industries. Physics-based simulations and high-quality rendering can deliver an experience that is immersive and realistic. State-of-the-art elements such as remote collaboration, environmental design and unique interaction tools can further improve knowledge transfer using VR.

The medical field is a very promising area, with effective communication and preparation integral to patient care. The presented environment must be built in a way that is intuitive, easy to use and promotes achieving set goals.

The target of the research presented is to develop a low-cost collaborative Virtual Reality environment for Multi-Disciplinary Teams (MDT) for pre-operative planning that will provide tools like a passive haptic keyboard for easy note-taking and environmental interaction during an MDT meeting.

A prototype passive haptic keyboard was developed and tested, analysing the precision of tracking relative to the true key position. The tested solution provided promising performance, but it is still in need of improvement and potential design changes.

Several questionnaire studies with collaborative VR environments were conducted. Target audiences varied and included Sano PhD students, A-level and undergraduate students from Sheffield, and a group of trainee radiologists. The obtained feedback was mostly positive, with a couple of points that need additional attention for further development.

About the author

Kuba graduated from AGH University of Science and Technology with a Master’s degree in Biomedical Engineering. His main areas of professional interest are processing of medical imaging, machine learning and AI in medicine and joining those two in a VR environment. Kuba is passionate about using technology to help people live longer, healthier lives. He joined Sano in October 2022 as a PhD student. His PhD project is being conducted in collaboration with the University of Sheffield on the topic of Haptically-enhanced VR/AR for Improved Information Capture and Exchange in Medical/Social Environments. Privately he is interested in trekking, wine tasting, cooking and Formula 1.