Exercise Black Skies 2008: Enhancing Live Training Through Virtual Preparation. Part Two: An Evaluation of Tools and Techniques

Exercise Black Skies 2008 (EBS08) was a simulation exercise conducted in the weeks prior to the live air combat training exercise, Pitch Black 2008 (PB08). During EBS08, a Royal Australian Air Force (RAAF) air battle management (ABM) team conducted a series of vignettes designed to prepare them for their tactical command and control role in PB08. A broad goal of EBS08 was to provide an environment within which a number of new simulation tools and training techniques could be evaluated and developed for future implementation within the Royal Australian Air Force (RAAF). The tools and techniques evaluated were: the Air Defence Ground Environment Simulator (ADGESIM), Toteboard, Air Warfare Assessment and Review tool, After Action Review tools and the Team-Dimensional Training framework. These evaluations, which form the basis or this report, were informed by the observations of human factors scientists and interviews with the RAAF participants. Participants provided extensive feedback on each tool, highlighting shortcomings and providing valuable suggestions for improvement. This feedback will guide the further development of these tools for implementation in future research exercises and in RAAF training programs. Overall, the participants found EBS08 extremely valuable and were satisfied with the quality of training they received. The simulation tools and training techniques assisted in promoting the quality of this experience and prompted participants to consider methods by which the current RAAF approach to training could be improved.