CARAI: A Formative Evaluation Methodology for VR Simulations

Virtual reality (VR) has a long history of being used to simulate real-world tasks, often for training and educational purposes. Yet, developing a VR system that is usable and effective is not trivial and is still a challenging task. We present a methodology for formatively evaluating the usability of VR simulations by capturing a real-world task, automating data logging, running a rigorous user study, analyzing subtask user performances, and inspecting subpar subtasks for usability issues.