2/5/2025 | 3:30 PM - 5:10 PM | Grand Peninsula D

VR/AR-NRP: Improving training for the neonatal resuscitation program using virtual and augmented reality

Author(s)

Mustafa Yalin Aydin | Department of Computer Science, Memorial University of Newfoundland
Vernon Curran | OPED, Faculty of Medicine, Memorial University of Newfoundland
Peter Attia | Department of Computer Science, Memorial University of Newfoundland
Susan White | Eastern Health, Newfoudland and Labrador
Lourdes Pena-Castillo | Departments of Computer Science and Biology, Memorial University of Newfoundland
Oscar Meruvia-Pastor | Department of Computer Science, Memorial University of Newfoundland

Abstract

The Neonatal Resuscitation Program (NRP) program is an evidence-based and standardized approach for training healthcare providers on the resuscitation of the newborn. Research shows that VR can be used to support resuscitation training for healthcare providers, including those who are required to undergo NRP certification.

The latest generation of VR head-Mounted Displays (HMDs) come with an array of built-in cameras that allow for real-time capture and tracking of hand movements as well as interpretation of hand gestures. In this research, we explore how to improve Neonatal Resuscitation training using Virtual and Augmented Reality.

Two skills that are crucial in the delivery of Positive Pressure Ventilation (PPV) during neonatal resuscitation are the rate at which the provider provides oxygen to the newborn and the appropriate timing of the ventilation. These skills must be learned and practiced by providers in a regular fashion to maintain certification. In this work we propose to use VR/AR HMDs to detect the subtle motions of providers hands to simulate the appropriate rate and rhythm of ventilation for the newborn. In this approach the user does not use standard VR controllers, but instead uses their bare hands to simulate the prescribed rate and rhythm of PPV.